00000001:02000400:0.0F:1788869298.012566:0:2959:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg139-server.virtnet: executing set_hostid 00000001:02000400:1.0F:1788869304.838865:0:3158:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg139-server.virtnet: executing load_modules_local 00000001:01000000:2.0F:1788869305.596303:0:3220:0:(lnet-crypto.c:359:cfs_crypto_performance_test()) Crypto hash algorithm adler32 speed = 1479 MB/s 00000001:01000000:2.0:1788869305.846452:0:3220:0:(lnet-crypto.c:359:cfs_crypto_performance_test()) Crypto hash algorithm crc32 speed = 2027 MB/s 00000001:01000000:2.0:1788869306.096309:0:3220:0:(lnet-crypto.c:359:cfs_crypto_performance_test()) Crypto hash algorithm crc32c speed = 10987 MB/s 00000020:02000000:3.0F:1788869306.290756:0:3252:0:(class_obd.c:804:obdclass_init()) Lustre: Build Version: 2.17.55_24_g1bda257 00000400:02000000:1.0:1788869306.598122:0:3267:0:(api-ni.c:2766:lnet_startup_lndni()) Added LNI 192.168.201.139@tcp [8/256/0/180] 00008000:02000000:3.0:1788869308.733227:0:3417:0:(echo_client.c:2574:obdecho_init()) Echo OBD driver; http://www.lustre.org/ 00000001:02000400:0.0:1788869323.968339:0:5219:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg139-server.virtnet: executing load_modules_local 00000020:01000004:2.0:1788869328.233789:0:5735:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1788869328.233794:0:5735:0:(obd_mount.c:926:lmd_print()) device: lustre-mdt1/mdt1 00000080:01200004:2.0:1788869328.233945:0:5735:0:(super25.c:130:lustre_fill_super()) VFS Op: sb 00000000f4ebc304 00000080:02000400:2.0:1788869328.233957:0:5735:0:(super25.c:148:lustre_fill_super()) lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' 00000020:01000004:2.0:1788869328.237113:0:5735:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-MDT0000, type=osd-zfs, lsifl=200065, mountfl=0 00000020:01000004:2.0:1788869328.237125:0:5735:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-zfs) 00000020:00000080:2.0:1788869328.237155:0:5735:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (00000000d2b7219d) 00000020:00000080:2.0:1788869328.237174:0:5735:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-zfs with refcount 2 00100000:10000000:0.0:1788869328.248917:0:5735:0:(scrub.c:229:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00100000:10000000:0.0:1788869328.249348:0:5735:0:(scrub.c:229:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00100000:10000000:0.0:1788869328.264045:0:5735:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:0.0:1788869328.264085:0:5735:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:0.0:1788869328.264107:0:5735:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:0.0:1788869328.264159:0:5735:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:0.0:1788869328.264184:0:5735:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:0.0:1788869328.264521:0:5735:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:0.0:1788869328.264528:0:5735:0:(osd_handler.c:1569:osd_obd_connect()) connect #0 00000020:00000080:0.0:1788869328.264538:0:5735:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x3d2d1916761d60e6 00000020:01000004:0.0:1788869328.264544:0:5735:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-MDT0000 on device lustre-mdt1/mdt1 00000020:01000000:0.0:1788869328.264549:0:5735:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:0.0:1788869328.264553:0:5735:0:(tgt_mount.c:101:server_register_mount()) register mount 00000000f4ebc304 from MGS 00000020:01000004:0.0:1788869328.264557:0:5735:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:0.0:1788869328.264574:0:5735:0:(genops.c:413:class_newdev()) Allocate new device MGS (00000000968655b2) 00000020:00000080:0.0:1788869328.264584:0:5735:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:0.0:1788869328.264686:0:5735:0:(tgt_mount.c:153:server_get_mount()) get mount 00000000f4ebc304 from MGS, refs=2 00080000:01000000:0.0:1788869328.264691:0:5735:0:(osd_handler.c:1569:osd_obd_connect()) connect #1 00000020:00000080:0.0:1788869328.264696:0:5735:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x3d2d1916761d60f4 00000100:00100000:0.0:1788869328.264781:0:5735:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:0.0:1788869328.264901:0:5735:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:0.0:1788869328.264907:0:5735:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:2.0:1788869328.265269:0:5735:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:2.0:1788869328.265278:0:5735:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:2.0:1788869328.265959:0:5735:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788869328.266082:0:5735:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:2.0:1788869328.266087:0:5735:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:2.0:1788869328.266513:0:5735:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:2.0:1788869328.266519:0:5735:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:2.0:1788869328.266719:0:5735:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:2.0:1788869328.266726:0:5735:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:1.0:1788869328.267112:0:5742:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788869328.267116:0:5742:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788869328.267118:0:5742:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788869328.267282:0:5743:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788869328.267285:0:5743:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788869328.267287:0:5743:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788869328.267653:0:5735:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:1.0:1788869328.270419:0:5742:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:01000000:0.0:1788869328.518064:0:5735:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip512 speed = 5531 MB/s 00000001:01000000:1.0:1788869328.767394:0:5735:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip4K speed = 7115 MB/s 00000001:01000000:1.0:1788869329.017383:0:5735:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc512 speed = 1407 MB/s 00000001:01000000:1.0:1788869329.267685:0:5735:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc4K speed = 1615 MB/s 00080000:10000000:1.0:1788869329.272557:0:5735:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x3:0x0] (8/8/4) registered 00000040:01000000:1.0:1788869329.281469:0:5735:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 20000000:01000000:1.0:1788869329.281496:0:5735:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:1.0:1788869329.281500:0:5735:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 10000000:01000000:0.0:1788869329.283082:0:5746:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:1.0:1788869329.283145:0:5735:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:1.0:1788869329.283209:0:5735:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000040:00080000:1.0:1788869329.283489:0:5735:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:1.0:1788869329.283514:0:5735:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:1.0:1788869329.283937:0:5735:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788869329.284221:0:5735:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:1.0:1788869329.284227:0:5735:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:1.0:1788869329.288561:0:5735:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:1.0:1788869329.288576:0:5735:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:1.0:1788869329.288945:0:5735:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:1.0:1788869329.288952:0:5735:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:1.0:1788869329.289629:0:5735:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:1.0:1788869329.289648:0:5735:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.201.139@tcp' 00000020:01000004:1.0:1788869329.289650:0:5735:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:1.0:1788869329.289696:0:5735:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.201.139@tcp (typ=mgc) 00000020:00000080:1.0:1788869329.289715:0:5735:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.201.139@tcp (00000000e79ff9e8) 00000020:00000080:1.0:1788869329.289733:0:5735:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:1.0:1788869329.289859:0:5735:0:(ldlm_lib.c:102:import_set_conn()) imp 0000000098f67866@MGC192.168.201.139@tcp: add connection 192.168.201.139@tcp at head 00010000:00010000:1.0:1788869329.289999:0:5735:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.201.139@tcp-0 is initialized 00000040:01000000:1.0:1788869329.290004:0:5735:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.201.139@tcp ctxt 1 is initialized 10000000:01000000:0.0:1788869329.291507:0:5752:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:1.0:1788869329.291560:0:5735:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.201.139@tcp (uuid 121cd5bc-7f07-4cf7-8e2e-4356c89c0696) 00000020:00000080:1.0:1788869329.291575:0:5735:0:(genops.c:1406:class_connect()) connect: client 121cd5bc-7f07-4cf7-8e2e-4356c89c0696, cookie 0x3d2d1916761d6102 00000100:00080000:1.0:1788869329.291584:0:5735:0:(import.c:510:import_select_connection()) MGC192.168.201.139@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788869329.291588:0:5735:0:(import.c:624:import_select_connection()) MGC192.168.201.139@tcp: import 0000000098f67866 using connection 192.168.201.139@tcp/0@lo 00000100:00100000:1.0:1788869329.291623:0:5735:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@000000006994760e x1875765421408384/t0(0) o250->MGC192.168.201.139@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788869329.291648:0:5735:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import 121cd5bc-7f07-4cf7-8e2e-4356c89c0696->MGS 00000020:01000004:1.0:1788869329.291662:0:5735:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:1.0:1788869329.291666:0:5735:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:1.0:1788869329.291674:0:5735:0:(genops.c:413:class_newdev()) Allocate new device MDS (000000009325392a) 00000020:00000080:1.0:1788869329.291682:0:5735:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00080000:2.0:1788869329.291816:0:5751:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 00000100:00100000:0.0:1788869329.291893:0:3282:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000006994760e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:121cd5bc-7f07-4cf7-8e2e-4356c89c0696:3282:1875765421408384:0@lo:250: 00000100:00100000:0.0:1788869329.291942:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869329.292048:0:5748:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765421408384 00000100:00100000:2.0:1788869329.292055:0:5748:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765421408384 00000100:00100000:2.0:1788869329.292089:0:5748:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788869329.292095:0:5748:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000755552af pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3282:x1875765421408384:12345-0@lo:250: 00010000:00080000:2.0:1788869329.292113:0:5748:0:(ldlm_lib.c:1445:target_handle_connect()) MGS: connection from 121cd5bc-7f07-4cf7-8e2e-4356c89c0696@0@lo t0 exp 0000000000000000 cur 77 last 0 00000020:00000080:2.0:1788869329.292132:0:5748:0:(genops.c:1406:class_connect()) connect: client 121cd5bc-7f07-4cf7-8e2e-4356c89c0696, cookie 0x3d2d1916761d6110 00000100:00080000:2.0:1788869329.292237:0:5748:0:(import.c:65:import_set_state_nolock()) 0000000089ff72ac : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788869329.292346:0:5748:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000755552af pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:121cd5bc-7f07-4cf7-8e2e-4356c89c0696+5:3282:x1875765421408384:12345-0@lo:250: Request processed in 249us (403us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869329.292355:0:5748:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788869329.292468:0:3282:0:(client.c:3112:ptlrpc_free_committed()) MGC192.168.201.139@tcp: committing for last_committed 0 gen 1 00000100:00080000:0.0:1788869329.292481:0:3282:0:(import.c:1132:ptlrpc_connect_interpret()) MGC192.168.201.139@tcp: connect to target with instance 0 00000100:00080000:0.0:1788869329.292488:0:3282:0:(import.c:956:ptlrpc_connect_set_flags()) MGC192.168.201.139@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:0.0:1788869329.292492:0:3282:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:0.0:1788869329.292495:0:3282:0:(import.c:65:import_set_state_nolock()) 0000000098f67866 MGS: changing import state from CONNECTING to FULL 10000000:01000000:0.0:1788869329.292498:0:3282:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:0.0:1788869329.292513:0:3282:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:0.0:1788869329.292517:0:3282:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000006994760e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:121cd5bc-7f07-4cf7-8e2e-4356c89c0696:3282:1875765421408384:0@lo:250: 00000100:00100000:1.0:1788869329.303198:0:5735:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788869329.303926:0:5735:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:1.0:1788869329.303934:0:5735:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:1.0:1788869329.304805:0:5735:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:1.0:1788869329.304812:0:5735:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:1.0:1788869329.305218:0:5735:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:1.0:1788869329.305225:0:5735:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:1.0:1788869329.306060:0:5735:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788869329.306224:0:5735:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:1.0:1788869329.306229:0:5735:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:1.0:1788869329.306853:0:5735:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:1.0:1788869329.306876:0:5735:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00010000:00010000:3.0:1788869329.307643:0:5743:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788869329.334594:0:5735:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788869329.334944:0:5735:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:0.0:1788869329.334966:0:5735:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:0.0:1788869329.336733:0:5735:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:0.0:1788869329.336789:0:5735:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:0.0:1788869329.338457:0:5735:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788869329.338588:0:5735:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:0.0:1788869329.338592:0:5735:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:0.0:1788869329.341718:0:5735:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:0.0:1788869329.341749:0:5735:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:0.0:1788869329.342382:0:5735:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788869329.342502:0:5735:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:0.0:1788869329.342505:0:5735:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:0.0:1788869329.342898:0:5735:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:0.0:1788869329.342905:0:5735:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:0.0:1788869329.343444:0:5735:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788869329.343541:0:5735:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:0.0:1788869329.343544:0:5735:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:0.0:1788869329.343859:0:5735:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:0.0:1788869329.343872:0:5735:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:0.0:1788869329.357818:0:5735:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788869329.357974:0:5735:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:0.0:1788869329.357979:0:5735:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:0.0:1788869329.359652:0:5735:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:0.0:1788869329.359674:0:5735:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:0.0:1788869329.360204:0:5735:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:0.0:1788869329.360212:0:5735:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:0.0:1788869329.361225:0:5735:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:0.0:1788869329.361286:0:5735:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-mdt1/mdt1 10000000:01000000:0.0:1788869329.361292:0:5735:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.201.139@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:0.0:1788869329.361443:0:5735:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.201.139@tcp ctxt 0 is initialized 00000020:01000004:0.0:1788869329.361485:0:5735:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.201.139@tcp, index=0000, flags=0x20065 00000020:01000004:0.0:1788869329.361490:0:5735:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:0.0:1788869329.361491:0:5735:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1788869329.361493:0:5735:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788869329.361494:0:5735:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788869329.361495:0:5735:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788869329.361496:0:5735:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788869329.361497:0:5735:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788869329.361499:0:5735:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1788869329.361500:0:5735:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1788869329.361501:0:5735:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1788869329.361503:0:5735:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788869329.361504:0:5735:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1788869329.361507:0:5735:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020065 00000020:01000004:0.0:1788869329.361509:0:5735:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1788869329.361510:0:5735:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1788869329.361511:0:5735:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788869329.361512:0:5735:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788869329.361513:0:5735:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788869329.361514:0:5735:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788869329.361515:0:5735:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788869329.361516:0:5735:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1788869329.361517:0:5735:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1788869329.361518:0:5735:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1788869329.361519:0:5735:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788869329.361520:0:5735:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1788869329.361555:0:5735:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:0.0:1788869329.361570:0:5735:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000036e14302 pname:cluuid:pid:xid:nid:opc:job mount.lustre:121cd5bc-7f07-4cf7-8e2e-4356c89c0696:5735:1875765421408512:0@lo:253: 00000100:00100000:0.0:1788869329.361643:0:5735:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869329.361685:0:5750:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765421408512 00000100:00100000:2.0:1788869329.361693:0:5750:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765421408512 00000100:00100000:0.0:1788869329.361708:0:5735:0:(client.c:2702:ptlrpc_set_wait()) set 000000002b3c6692 going to sleep for 11 seconds 00000100:00100000:2.0:1788869329.361734:0:5750:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788869329.361742:0:5750:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000092f49ed1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:121cd5bc-7f07-4cf7-8e2e-4356c89c0696+5:5735:x1875765421408512:12345-0@lo:253: 20000000:01000000:2.0:1788869329.361784:0:5750:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:2.0:1788869329.361787:0:5750:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 10000000:01000000:3.0:1788869329.362112:0:5771:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:2.0:1788869329.362161:0:5750:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 00000040:00080000:2.0:1788869329.362562:0:5750:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788869329.363654:0:5772:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 1 20000000:01000000:0.0:1788869329.363801:0:5750:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:0.0:1788869329.363809:0:5750:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-MDT0000, index=0 20000000:01000000:0.0:1788869329.363814:0:5750:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-MDT0000 to 0 20000000:01000000:0.0:1788869329.363817:0:5750:0:(mgs_llog.c:3608:mgs_write_log_mdt()) writing new mdt lustre-MDT0000 20000000:01000000:0.0:1788869329.363832:0:5750:0:(mgs_llog.c:3168:mgs_write_log_lov()) Writing lov(lustre-MDT0000-mdtlov) log for lustre-MDT0000 00000040:00080000:0.0:1788869329.363969:0:5750:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788869329.364186:0:5750:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 20000000:01000000:0.0:1788869329.364198:0:5750:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf001 lov lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:0.0:1788869329.364245:0:5750:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 136 off8552 00000040:00080000:0.0:1788869329.364370:0:5750:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 176 off8728 00000040:00080000:0.0:1788869329.364405:0:5750:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8952 00000040:00080000:0.0:1788869329.364493:0:5750:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9176 20000000:01000000:0.0:1788869329.364502:0:5750:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000 0xcf001 mdt lustre-MDT0000_UUID (null) (null) 00000040:00080000:0.0:1788869329.364543:0:5750:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9296 20000000:01000000:0.0:1788869329.364550:0:5750:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-MDT0000 lustre-MDT0000-mdtlov (null) (null) 00000040:00080000:0.0:1788869329.364579:0:5750:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 112 off9408 20000000:01000000:0.0:1788869329.364585:0:5750:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000 0xcf003 lustre-MDT0000_UUID 0 lustre-MDT0000-mdtlov f 00000040:00080000:0.0:1788869329.364617:0:5750:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 160 off9568 00000040:00080000:0.0:1788869329.364665:0:5750:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9792 00000040:00080000:0.0:1788869329.364692:0:5750:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:0.0:1788869329.364697:0:5750:0:(mgs_llog.c:3168:mgs_write_log_lov()) Writing lov(lustre-clilov) log for lustre-client 00000040:00080000:0.0:1788869329.364707:0:5750:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788869329.364902:0:5750:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 20000000:01000000:0.0:1788869329.364911:0:5750:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf001 lov lustre-clilov_UUID (null) (null) 00000040:00080000:0.0:1788869329.364942:0:5750:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 120 off8536 00000040:00080000:0.0:1788869329.364971:0:5750:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 168 off8704 00000040:00080000:0.0:1788869329.365025:0:5750:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].4, 224 off8928 20000000:01000000:0.0:1788869329.365037:0:5750:0:(mgs_llog.c:3125:mgs_write_log_lmv()) Writing lmv(lustre-clilmv) log for lustre-client 00000040:00080000:0.0:1788869329.365108:0:5750:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].5, 224 off9152 20000000:01000000:0.0:1788869329.365118:0:5750:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf001 lmv lustre-clilmv_UUID (null) (null) 00000040:00080000:0.0:1788869329.365160:0:5750:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].6, 120 off9272 00000040:00080000:0.0:1788869329.365194:0:5750:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].7, 168 off9440 00000040:00080000:0.0:1788869329.365227:0:5750:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].8, 224 off9664 20000000:01000000:0.0:1788869329.365246:0:5750:0:(mgs_llog.c:3090:mgs_write_log_mount_opt()) Writing mount options log for lustre-client 00000040:00080000:0.0:1788869329.365508:0:5750:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].9, 224 off9888 20000000:01000000:0.0:1788869329.365518:0:5750:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-client lustre-clilov lustre-clilmv (null) 00000040:00080000:0.0:1788869329.365547:0:5750:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].10, 120 off10008 00000040:00080000:0.0:1788869329.365578:0:5750:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].11, 224 off10232 00000040:00080000:0.0:1788869329.365712:0:5750:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 20000000:01000000:0.0:1788869329.365756:0:5750:0:(mgs_llog.c:3305:mgs_write_log_mdc_to_lmv()) adding mdc for lustre-MDT0000 to log lustre-client:lmv(lustre-clilmv) 20000000:01000000:0.0:1788869329.365763:0:5750:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre-MDT0000/add mdc fl=4 00000040:00080000:2.0:1788869329.367322:0:5773:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 00000040:00080000:0.0:1788869329.367574:0:5750:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].12, 224 off10456 20000000:01000000:0.0:1788869329.367594:0:5750:0:(mgs_llog.c:3351:mgs_write_log_mdc_to_lmv()) add nid 192.168.201.139@tcp for mdt 20000000:01000000:0.0:1788869329.367596:0:5750:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.201.139@tcp (null) (null) (null) 00000040:00080000:0.0:1788869329.367629:0:5750:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].13, 88 off10544 20000000:01000000:0.0:1788869329.367638:0:5750:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf001 mdc lustre-clilmv_UUID (null) (null) 00000040:00080000:0.0:1788869329.367670:0:5750:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].14, 128 off10672 20000000:01000000:0.0:1788869329.367678:0:5750:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf003 lustre-MDT0000_UUID 192.168.201.139@tcp (null) (null) 00000040:00080000:0.0:1788869329.367717:0:5750:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].15, 144 off10816 20000000:01000000:0.0:1788869329.367726:0:5750:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf014 lustre-MDT0000_UUID 0 1 lustre-MDT0000-mdc_UUID 00000040:00080000:0.0:1788869329.367754:0:5750:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].16, 160 off10976 00000040:00080000:0.0:1788869329.367785:0:5750:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].17, 224 off11200 20000000:01000000:0.0:1788869329.367837:0:5750:0:(mgs_llog.c:5248:mgs_write_log_target()) remaining string: ' mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity ', param: 'sys.timeout=20' 20000000:01000000:0.0:1788869329.367840:0:5750:0:(mgs_llog.c:4744:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:0.0:1788869329.367843:0:5750:0:(mgs_llog.c:4177:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:0.0:1788869329.367854:0:5750:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:0.0:1788869329.367857:0:5750:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:0.0:1788869329.367895:0:5750:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:0.0:1788869329.367897:0:5750:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 00000040:00080000:2.0:1788869329.368193:0:5774:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 18 count 18 00000040:00080000:0.0:1788869329.368428:0:5750:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].18, 224 off11424 00000040:00080000:0.0:1788869329.368466:0:5750:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].19, 80 off11504 00000040:00080000:0.0:1788869329.368497:0:5750:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].20, 224 off11728 20000000:01000000:0.0:1788869329.368508:0:5750:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:0.0:1788869329.368509:0:5750:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 00000040:00080000:2.0:1788869329.368781:0:5775:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 10 count 10 00000040:00080000:0.0:1788869329.368906:0:5750:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 224 off10016 00000040:00080000:0.0:1788869329.368939:0:5750:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 80 off10096 00000040:00080000:0.0:1788869329.368984:0:5750:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10320 00000020:00000080:0.0:1788869329.368996:0:5750:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1788869329.368999:0:5750:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 100 to 20 20000000:01000000:0.0:1788869329.369002:0:5750:0:(mgs_llog.c:5248:mgs_write_log_target()) remaining string: ' ', param: 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:0.0:1788869329.369004:0:5750:0:(mgs_llog.c:4744:mgs_write_log_param()) next param 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:0.0:1788869329.369007:0:5750:0:(mgs_llog.c:5068:mgs_write_log_param()) mdt param identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity 20000000:01000000:0.0:1788869329.369013:0:5750:0:(mgs_llog.c:1379:mgs_modify_param()) modify lustre-MDT0000/lustre-MDT0000/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity del=0 00000040:00080000:2.0:1788869329.369239:0:5776:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 13 count 13 20000000:02000000:0.0:1788869329.369293:0:5750:0:(mgs_llog.c:4116:mgs_wlp_lcfg()) Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 00000040:00080000:0.0:1788869329.373109:0:5750:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 224 off10544 00000040:00080000:0.0:1788869329.373154:0:5750:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 160 off10704 00000040:00080000:0.0:1788869329.373216:0:5750:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 224 off10928 10000000:01000000:0.0:1788869329.373236:0:5750:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:0.0:1788869329.373346:0:5750:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 00000000bef7cb12/0x3d2d1916761d6117 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869329.373362:0:5750:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000bef7cb12/0x3d2d1916761d6117 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869329.373372:0:5750:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000bef7cb12/0x3d2d1916761d6117 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869329.373378:0:5750:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000bef7cb12/0x3d2d1916761d6117 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869329.373384:0:5750:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 00000000bef7cb12/0x3d2d1916761d6117 lrc: 3/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869329.373390:0:5750:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 00000000bef7cb12/0x3d2d1916761d6117 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869329.373410:0:5750:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000bef7cb12 already unused, calling callback (000000004926af38) 00010000:00010000:0.0:1788869329.373414:0:5750:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 00000000bef7cb12/0x3d2d1916761d6117 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869329.373420:0:5750:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 00000000bef7cb12/0x3d2d1916761d6117 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869329.373432:0:5750:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 00000000bef7cb12/0x3d2d1916761d6117 lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869329.373439:0:5750:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 00000000bef7cb12/0x3d2d1916761d6117 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869329.373445:0:5750:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000bef7cb12/0x3d2d1916761d6117 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1788869329.373461:0:5750:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:3.0:1788869329.457645:0:5750:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000092f49ed1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:121cd5bc-7f07-4cf7-8e2e-4356c89c0696+5:5735:x1875765421408512:12345-0@lo:253: Request processed in 95897us (95996us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869329.457666:0:5750:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788869329.457924:0:5735:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000036e14302 pname:cluuid:pid:xid:nid:opc:job mount.lustre:121cd5bc-7f07-4cf7-8e2e-4356c89c0696:5735:1875765421408512:0@lo:253: 10000000:01000000:0.0:1788869329.457941:0:5735:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:0.0:1788869329.457944:0:5735:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1788869329.457946:0:5735:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1788869329.457947:0:5735:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788869329.457949:0:5735:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-MDT0000_UUID 00000020:01000004:0.0:1788869329.457950:0:5735:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788869329.457951:0:5735:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788869329.457952:0:5735:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788869329.457954:0:5735:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1788869329.457955:0:5735:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:0.0:1788869329.457956:0:5735:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788869329.457958:0:5735:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1788869329.457975:0:5735:0:(tgt_mount.c:101:server_register_mount()) register mount 00000000f4ebc304 from lustre-MDT0000 10000000:01000000:0.0:1788869329.458007:0:5735:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:0.0:1788869329.458014:0:5735:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:0.0:1788869329.458019:0:5735:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff94c81f1a99c0 10000000:01000000:0.0:1788869329.458023:0:5735:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1788869329.458030:0:5735:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-sptlrpc-ffff94c81f1a99c0 from 1 10000000:01000000:0.0:1788869329.458033:0:5735:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1788869329.458065:0:5735:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.139@tcp lock: 00000000bef7cb12/0x3d2d1916761d611e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869329.458076:0:5735:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.139@tcp lock: 00000000bef7cb12/0x3d2d1916761d611e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869329.458084:0:5735:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.139@tcp lock: 00000000bef7cb12/0x3d2d1916761d611e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788869329.458101:0:5735:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000036e14302 pname:cluuid:pid:xid:nid:opc:job mount.lustre:121cd5bc-7f07-4cf7-8e2e-4356c89c0696:5735:1875765421408640:0@lo:101: 00000100:00100000:0.0:1788869329.458133:0:5735:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869329.458182:0:5749:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765421408640 00000100:00100000:2.0:1788869329.458189:0:5749:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765421408640 00000100:00100000:0.0:1788869329.458190:0:5735:0:(client.c:2702:ptlrpc_set_wait()) set 000000000fbf4dae going to sleep for 11 seconds 00000100:00100000:2.0:1788869329.458230:0:5749:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788869329.458240:0:5749:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000de4616ff pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:121cd5bc-7f07-4cf7-8e2e-4356c89c0696+5:5735:x1875765421408640:12345-0@lo:101: 00010000:00010000:2.0:1788869329.458285:0:5749:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788869329.458298:0:5749:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000007538ee0e/0x3d2d1916761d6125 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x3d2d1916761d611e expref: -99 pid: 5749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869329.458319:0:5749:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000007538ee0e/0x3d2d1916761d6125 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3d2d1916761d611e expref: 6 pid: 5749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869329.458329:0:5749:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000007538ee0e/0x3d2d1916761d6125 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3d2d1916761d611e expref: 6 pid: 5749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869329.458336:0:5749:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000007538ee0e, rc 0) 00000100:00100000:2.0:1788869329.458366:0:5749:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000de4616ff pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:121cd5bc-7f07-4cf7-8e2e-4356c89c0696+6:5735:x1875765421408640:12345-0@lo:101: Request processed in 129us (233us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869329.458381:0:5749:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788869329.458908:0:5735:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000036e14302 pname:cluuid:pid:xid:nid:opc:job mount.lustre:121cd5bc-7f07-4cf7-8e2e-4356c89c0696:5735:1875765421408640:0@lo:101: 00010000:00010000:0.0:1788869329.458920:0:5735:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.139@tcp lock: 00000000bef7cb12/0x3d2d1916761d611e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3d2d1916761d6125 expref: -99 pid: 5735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869329.458930:0:5735:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.139@tcp lock: 00000000bef7cb12/0x3d2d1916761d611e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x3d2d1916761d6125 expref: -99 pid: 5735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788869329.458967:0:5735:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000036e14302 pname:cluuid:pid:xid:nid:opc:job mount.lustre:121cd5bc-7f07-4cf7-8e2e-4356c89c0696:5735:1875765421408768:0@lo:501: 00000100:00100000:0.0:1788869329.458990:0:5735:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869329.459012:0:5735:0:(client.c:2702:ptlrpc_set_wait()) set 000000000fbf4dae going to sleep for 11 seconds 00000100:00100000:3.0:1788869329.459037:0:5750:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765421408768 00000100:00100000:3.0:1788869329.459042:0:5750:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765421408768 00000100:00100000:3.0:1788869329.459081:0:5750:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788869329.459088:0:5750:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000007a1562c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:121cd5bc-7f07-4cf7-8e2e-4356c89c0696+6:5735:x1875765421408768:12345-0@lo:501: 00000100:00100000:3.0:1788869329.459314:0:5750:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000007a1562c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:121cd5bc-7f07-4cf7-8e2e-4356c89c0696+6:5735:x1875765421408768:12345-0@lo:501: Request processed in 226us (323us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788869329.459322:0:5750:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788869329.459491:0:5735:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000036e14302 pname:cluuid:pid:xid:nid:opc:job mount.lustre:121cd5bc-7f07-4cf7-8e2e-4356c89c0696:5735:1875765421408768:0@lo:501: 10000000:01000000:0.0:1788869329.459513:0:5735:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.139@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:0.0:1788869329.459529:0:5735:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.139@tcp lock: 00000000bef7cb12/0x3d2d1916761d611e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3d2d1916761d6125 expref: -99 pid: 5735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869329.459537:0:5735:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.139@tcp lock: 00000000bef7cb12/0x3d2d1916761d611e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3d2d1916761d6125 expref: -99 pid: 5735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788869329.459545:0:5735:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff94c805125000 10000000:01000000:0.0:1788869329.459548:0:5735:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:0.0:1788869329.459553:0:5735:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff94c805125000 10000000:01000000:0.0:1788869329.459555:0:5735:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:0.0:1788869329.459558:0:5735:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-barrier-ffff94c805125000 from 1 10000000:01000000:0.0:1788869329.459561:0:5735:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:0.0:1788869329.459575:0:5735:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.139@tcp lock: 000000002bcd1bb5/0x3d2d1916761d612c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869329.459582:0:5735:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.139@tcp lock: 000000002bcd1bb5/0x3d2d1916761d612c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869329.459588:0:5735:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.139@tcp lock: 000000002bcd1bb5/0x3d2d1916761d612c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788869329.459598:0:5735:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000036e14302 pname:cluuid:pid:xid:nid:opc:job mount.lustre:121cd5bc-7f07-4cf7-8e2e-4356c89c0696:5735:1875765421408896:0@lo:101: 00000100:00100000:0.0:1788869329.459623:0:5735:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869329.459643:0:5735:0:(client.c:2702:ptlrpc_set_wait()) set 000000000fbf4dae going to sleep for 11 seconds 00000100:00100000:2.0:1788869329.459663:0:5749:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765421408896 00000100:00100000:2.0:1788869329.459668:0:5749:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765421408896 00000100:00100000:2.0:1788869329.459695:0:5749:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788869329.459702:0:5749:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000059c20f76 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:121cd5bc-7f07-4cf7-8e2e-4356c89c0696+6:5735:x1875765421408896:12345-0@lo:101: 00010000:00010000:2.0:1788869329.459709:0:5749:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788869329.459717:0:5749:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000a3ad53d4/0x3d2d1916761d6133 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x3d2d1916761d612c expref: -99 pid: 5749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869329.459731:0:5749:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000a3ad53d4/0x3d2d1916761d6133 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3d2d1916761d612c expref: 7 pid: 5749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869329.459739:0:5749:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000a3ad53d4/0x3d2d1916761d6133 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3d2d1916761d612c expref: 7 pid: 5749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869329.459745:0:5749:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000a3ad53d4, rc 0) 00000100:00100000:2.0:1788869329.459791:0:5749:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000059c20f76 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:121cd5bc-7f07-4cf7-8e2e-4356c89c0696+7:5735:x1875765421408896:12345-0@lo:101: Request processed in 90us (169us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869329.459797:0:5749:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788869329.459842:0:5735:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000036e14302 pname:cluuid:pid:xid:nid:opc:job mount.lustre:121cd5bc-7f07-4cf7-8e2e-4356c89c0696:5735:1875765421408896:0@lo:101: 00010000:00010000:0.0:1788869329.459851:0:5735:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.139@tcp lock: 000000002bcd1bb5/0x3d2d1916761d612c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3d2d1916761d6133 expref: -99 pid: 5735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869329.459868:0:5735:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.139@tcp lock: 000000002bcd1bb5/0x3d2d1916761d612c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x3d2d1916761d6133 expref: -99 pid: 5735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788869329.459890:0:5735:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.139@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:0.0:1788869329.459905:0:5735:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.139@tcp lock: 000000002bcd1bb5/0x3d2d1916761d612c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3d2d1916761d6133 expref: -99 pid: 5735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869329.459914:0:5735:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.139@tcp lock: 000000002bcd1bb5/0x3d2d1916761d612c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3d2d1916761d6133 expref: -99 pid: 5735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788869329.459920:0:5735:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:0.0:1788869329.459924:0:5735:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1788869329.459928:0:5735:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff94c805125000 10000000:01000000:0.0:1788869329.459933:0:5735:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:0.0:1788869329.459937:0:5735:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:0.0:1788869329.459939:0:5735:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:0.0:1788869329.459949:0:5735:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.139@tcp lock: 000000001729661f/0x3d2d1916761d613a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869329.459956:0:5735:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.139@tcp lock: 000000001729661f/0x3d2d1916761d613a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869329.459962:0:5735:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.139@tcp lock: 000000001729661f/0x3d2d1916761d613a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788869329.459972:0:5735:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000036e14302 pname:cluuid:pid:xid:nid:opc:job mount.lustre:121cd5bc-7f07-4cf7-8e2e-4356c89c0696:5735:1875765421409024:0@lo:101: 00000100:00100000:0.0:1788869329.459996:0:5735:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869329.460013:0:5735:0:(client.c:2702:ptlrpc_set_wait()) set 000000000fbf4dae going to sleep for 11 seconds 00000100:00100000:3.0:1788869329.460040:0:5750:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765421409024 00000100:00100000:3.0:1788869329.460046:0:5750:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765421409024 00000100:00100000:3.0:1788869329.460073:0:5750:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788869329.460079:0:5750:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c85e5618 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:121cd5bc-7f07-4cf7-8e2e-4356c89c0696+7:5735:x1875765421409024:12345-0@lo:101: 00010000:00010000:3.0:1788869329.460087:0:5750:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788869329.460095:0:5750:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000055df5354/0x3d2d1916761d6141 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x3d2d1916761d613a expref: -99 pid: 5750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869329.460110:0:5750:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000055df5354/0x3d2d1916761d6141 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3d2d1916761d613a expref: 8 pid: 5750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869329.460117:0:5750:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000055df5354/0x3d2d1916761d6141 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3d2d1916761d613a expref: 8 pid: 5750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869329.460123:0:5750:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000055df5354, rc 0) 00000100:00100000:3.0:1788869329.460155:0:5750:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c85e5618 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:121cd5bc-7f07-4cf7-8e2e-4356c89c0696+8:5735:x1875765421409024:12345-0@lo:101: Request processed in 77us (159us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869329.460169:0:5750:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788869329.460188:0:5735:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000036e14302 pname:cluuid:pid:xid:nid:opc:job mount.lustre:121cd5bc-7f07-4cf7-8e2e-4356c89c0696:5735:1875765421409024:0@lo:101: 00010000:00010000:0.0:1788869329.460199:0:5735:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.139@tcp lock: 000000001729661f/0x3d2d1916761d613a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x3d2d1916761d6141 expref: -99 pid: 5735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869329.460215:0:5735:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.139@tcp lock: 000000001729661f/0x3d2d1916761d613a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x3d2d1916761d6141 expref: -99 pid: 5735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788869329.460244:0:5735:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000036e14302 pname:cluuid:pid:xid:nid:opc:job mount.lustre:121cd5bc-7f07-4cf7-8e2e-4356c89c0696:5735:1875765421409152:0@lo:501: 00000100:00100000:0.0:1788869329.460297:0:5735:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869329.460317:0:5735:0:(client.c:2702:ptlrpc_set_wait()) set 000000000fbf4dae going to sleep for 11 seconds 00000100:00100000:2.0:1788869329.460337:0:5749:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765421409152 00000100:00100000:2.0:1788869329.460342:0:5749:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765421409152 00000100:00100000:2.0:1788869329.460369:0:5749:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788869329.460375:0:5749:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000685302c3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:121cd5bc-7f07-4cf7-8e2e-4356c89c0696+8:5735:x1875765421409152:12345-0@lo:501: 00000100:00100000:2.0:1788869329.460531:0:5749:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000685302c3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:121cd5bc-7f07-4cf7-8e2e-4356c89c0696+9:5735:x1875765421409152:12345-0@lo:501: Request processed in 156us (234us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869329.460538:0:5749:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788869329.460563:0:5735:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000036e14302 pname:cluuid:pid:xid:nid:opc:job mount.lustre:121cd5bc-7f07-4cf7-8e2e-4356c89c0696:5735:1875765421409152:0@lo:501: 00000100:00100000:0.0:1788869329.460587:0:5735:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000036e14302 pname:cluuid:pid:xid:nid:opc:job mount.lustre:121cd5bc-7f07-4cf7-8e2e-4356c89c0696:5735:1875765421409280:0@lo:503: 00000100:00100000:0.0:1788869329.460624:0:5735:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869329.460640:0:5735:0:(client.c:2702:ptlrpc_set_wait()) set 000000000fbf4dae going to sleep for 11 seconds 00000100:00100000:3.0:1788869329.460667:0:5750:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765421409280 00000100:00100000:3.0:1788869329.460672:0:5750:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765421409280 00000100:00100000:3.0:1788869329.460698:0:5750:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788869329.460715:0:5750:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000037010890 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:121cd5bc-7f07-4cf7-8e2e-4356c89c0696+9:5735:x1875765421409280:12345-0@lo:503: 00000100:00100000:3.0:1788869329.460852:0:5750:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000037010890 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:121cd5bc-7f07-4cf7-8e2e-4356c89c0696+9:5735:x1875765421409280:12345-0@lo:503: Request processed in 149us (228us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869329.460871:0:5750:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788869329.460896:0:5735:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000036e14302 pname:cluuid:pid:xid:nid:opc:job mount.lustre:121cd5bc-7f07-4cf7-8e2e-4356c89c0696:5735:1875765421409280:0@lo:503: 00000100:00100000:3.0:1788869329.461233:0:5778:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000002e631480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:121cd5bc-7f07-4cf7-8e2e-4356c89c0696:5778:1875765421409408:0@lo:502: 00000100:00100000:3.0:1788869329.461288:0:5778:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869329.461311:0:5778:0:(client.c:2702:ptlrpc_set_wait()) set 00000000d33e441b going to sleep for 11 seconds 00000100:00100000:2.0:1788869329.461333:0:5749:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765421409408 00000100:00100000:2.0:1788869329.461338:0:5749:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765421409408 00000100:00100000:2.0:1788869329.461371:0:5749:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788869329.461376:0:5749:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000000ec79df pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:121cd5bc-7f07-4cf7-8e2e-4356c89c0696+9:5778:x1875765421409408:12345-0@lo:502: 00000100:00100000:2.0:1788869329.461516:0:5749:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000000ec79df pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:121cd5bc-7f07-4cf7-8e2e-4356c89c0696+9:5778:x1875765421409408:12345-0@lo:502: Request processed in 139us (227us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869329.461523:0:5749:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788869329.461548:0:5778:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000002e631480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:121cd5bc-7f07-4cf7-8e2e-4356c89c0696:5778:1875765421409408:0@lo:502: 00000020:01000000:3.0:1788869329.461574:0:5778:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788869329.461583:0:5778:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788869329.461586:0:5778:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:3.0:1788869329.461591:0:5778:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:3.0:1788869329.461594:0:5778:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788869329.461612:0:5778:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (00000000443f3ba6) 00000020:00000080:3.0:1788869329.461629:0:5778:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:3.0:1788869329.461635:0:5778:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00080000:01000000:3.0:1788869329.461691:0:5778:0:(osd_handler.c:1569:osd_obd_connect()) connect #2 00000020:00000080:3.0:1788869329.461697:0:5778:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x3d2d1916761d614f 00000020:00000080:3.0:1788869329.461968:0:5778:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:3.0:1788869329.461972:0:5778:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788869329.461975:0:5778:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788869329.461976:0:5778:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:3.0:1788869329.461979:0:5778:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788869329.461982:0:5778:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788869329.461988:0:5778:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:3.0:1788869329.461991:0:5778:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788869329.461997:0:5778:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (000000009109df74) 00000020:00000080:3.0:1788869329.462006:0:5778:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:3.0:1788869329.462009:0:5778:0:(obd_config.c:1470:class_process_config()) processing cmd: cf007 00000020:00000080:3.0:1788869329.462011:0:5778:0:(obd_config.c:1514:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:3.0:1788869329.462013:0:5778:0:(obd_config.c:1148:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:3.0:1788869329.462018:0:5778:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1788869329.462062:0:5778:0:(tgt_mount.c:153:server_get_mount()) get mount 00000000f4ebc304 from lustre-MDT0000, refs=3 00000020:00000080:3.0:1788869329.462074:0:5778:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (00000000392b63f0) 00000020:00000080:3.0:1788869329.462080:0:5778:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:3.0:1788869329.462135:0:5778:0:(lod_dev.c:2292:lod_obd_connect()) connect #0 00000020:00000080:3.0:1788869329.462142:0:5778:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x3d2d1916761d6164 00000020:00000080:3.0:1788869329.462240:0:5778:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:3.0:1788869329.462246:0:5778:0:(mdd_device.c:1596:mdd_obd_connect()) connect #0 00000020:00000080:3.0:1788869329.462277:0:5778:0:(genops.c:1406:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0x3d2d1916761d616b 00080000:01000000:3.0:1788869329.462282:0:5778:0:(osd_handler.c:1569:osd_obd_connect()) connect #3 00000020:00000080:3.0:1788869329.462286:0:5778:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x3d2d1916761d6172 00080000:10000000:3.0:1788869329.462612:0:5778:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000001:0x3:0x0] (8/8/3) registered 40000000:02000000:3.0:1788869329.462841:0:5778:0:(fid_handler.c:560:seq_server_init()) ctl-lustre-MDT0000: No data found on store. Initialize space. 40000000:02000000:3.0:1788869329.464711:0:5778:0:(fid_handler.c:560:seq_server_init()) srv-lustre-MDT0000: No data found on store. Initialize space. 00010000:00010000:2.0:1788869329.505662:0:5778:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:02000400:2.0:1788869329.506171:0:5778:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-MDT0000: new disk, initializing 00000001:00000004:2.0:1788869329.508651:0:5778:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 0 00000001:00080000:2.0:1788869329.508977:0:5778:0:(tgt_lastrcvd.c:240:tgt_reply_header_write()) lustre-MDT0000: write reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:3.0:1788869329.532032:0:5778:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (00000000a4dc14f0) 00000020:00000080:3.0:1788869329.532057:0:5778:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:3.0:1788869329.532141:0:5778:0:(osd_handler.c:1569:osd_obd_connect()) connect #4 00000020:00000080:3.0:1788869329.532148:0:5778:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x3d2d1916761d6180 00000020:00000080:1.0:1788869329.532996:0:5778:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00080000:10000000:1.0:1788869329.534874:0:5778:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x10000:0x0] (8/8/4) registered 00080000:10000000:1.0:1788869329.582628:0:5778:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1010000:0x0] (8/8/4) registered 00080000:10000000:1.0:1788869329.624006:0:5778:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2010000:0x0] (8/8/4) registered 00080000:10000000:1.0:1788869329.655531:0:5778:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x20000:0x0] (8/8/4) registered 00080000:10000000:1.0:1788869329.677758:0:5778:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1020000:0x0] (8/8/4) registered 00080000:10000000:1.0:1788869329.703409:0:5778:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2020000:0x0] (8/8/4) registered 00000020:00000080:2.0:1788869329.726931:0:5778:0:(genops.c:1406:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0x3d2d1916761d6187 00000020:00000080:1.0:1788869329.727555:0:5778:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:1.0:1788869329.727565:0:5778:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788869329.727571:0:5778:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788869329.727573:0:5778:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:1.0:1788869329.727576:0:5778:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788869329.727580:0:5778:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788869329.727581:0:5778:0:(obd_config.c:1561:class_process_config()) marker 9 (0x1) lustre sys.timeout 00000020:00000080:1.0:1788869329.727584:0:5778:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1788869329.727585:0:5778:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1788869329.727587:0:5778:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788869329.727589:0:5778:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788869329.727590:0:5778:0:(obd_config.c:1561:class_process_config()) marker 9 (0x2) lustre sys.timeout 00000020:01000000:1.0:1788869329.727592:0:5778:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788869329.727597:0:5778:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788869329.727598:0:5778:0:(obd_config.c:1561:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:1.0:1788869329.727601:0:5778:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000004:01000000:1.0:1788869329.727635:0:5778:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000100:00100000:1.0:1788869329.727738:0:5778:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000ece4f73d pname:cluuid:pid:xid:nid:opc:job llog_process_th:121cd5bc-7f07-4cf7-8e2e-4356c89c0696:5778:1875765421409536:0@lo:502: 00000100:00100000:1.0:1788869329.728121:0:5778:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869329.728195:0:5778:0:(client.c:2702:ptlrpc_set_wait()) set 00000000a18e141a going to sleep for 11 seconds 00000100:00100000:3.0:1788869329.728245:0:5750:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765421409536 00000100:00100000:3.0:1788869329.728287:0:5750:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765421409536 00000100:00100000:3.0:1788869329.728336:0:5750:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788869329.728345:0:5750:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b3af41d0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:121cd5bc-7f07-4cf7-8e2e-4356c89c0696+9:5778:x1875765421409536:12345-0@lo:502: 00000100:00100000:3.0:1788869329.728916:0:5750:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b3af41d0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:121cd5bc-7f07-4cf7-8e2e-4356c89c0696+9:5778:x1875765421409536:12345-0@lo:502: Request processed in 571us (794us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869329.728924:0:5750:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788869329.729109:0:5778:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000ece4f73d pname:cluuid:pid:xid:nid:opc:job llog_process_th:121cd5bc-7f07-4cf7-8e2e-4356c89c0696:5778:1875765421409536:0@lo:502: 00000020:01000000:1.0:1788869329.729146:0:5778:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788869329.729151:0:5778:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788869329.729153:0:5778:0:(obd_config.c:1561:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000040:00080000:1.0:1788869329.729157:0:5778:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 16 count 16 00000020:01000000:0.0:1788869329.729230:0:5735:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-15 (rc=0) 10000000:01000000:0.0:1788869329.729264:0:5735:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.139@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:0.0:1788869329.729281:0:5735:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.139@tcp lock: 000000001729661f/0x3d2d1916761d613a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x3d2d1916761d6141 expref: -99 pid: 5735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869329.729289:0:5735:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.139@tcp lock: 000000001729661f/0x3d2d1916761d613a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x3d2d1916761d6141 expref: -99 pid: 5735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788869329.729295:0:5735:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff94c805125000 from 1 10000000:01000000:0.0:1788869329.729297:0:5735:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1788869329.729317:0:5735:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.139@tcp lock: 000000002f2afe60/0x3d2d1916761d618e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869329.729321:0:5735:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.139@tcp lock: 000000002f2afe60/0x3d2d1916761d618e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869329.729335:0:5735:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.139@tcp lock: 000000002f2afe60/0x3d2d1916761d618e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788869329.729353:0:5735:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000036e14302 pname:cluuid:pid:xid:nid:opc:job mount.lustre:121cd5bc-7f07-4cf7-8e2e-4356c89c0696:5735:1875765421409664:0@lo:101: 00000100:00100000:0.0:1788869329.729380:0:5735:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869329.729408:0:5735:0:(client.c:2702:ptlrpc_set_wait()) set 00000000ad5d93ef going to sleep for 11 seconds 00000100:00100000:3.0:1788869329.729457:0:5749:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765421409664 00000100:00100000:3.0:1788869329.729462:0:5749:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765421409664 00000100:00100000:3.0:1788869329.729498:0:5749:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788869329.729507:0:5749:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000008ab2368b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:121cd5bc-7f07-4cf7-8e2e-4356c89c0696+9:5735:x1875765421409664:12345-0@lo:101: 00010000:00010000:3.0:1788869329.729516:0:5749:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788869329.729529:0:5749:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000003199bc3e/0x3d2d1916761d6195 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x3d2d1916761d618e expref: -99 pid: 5749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869329.729549:0:5749:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000003199bc3e/0x3d2d1916761d6195 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3d2d1916761d618e expref: 10 pid: 5749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869329.729558:0:5749:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000003199bc3e/0x3d2d1916761d6195 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3d2d1916761d618e expref: 10 pid: 5749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869329.729566:0:5749:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000003199bc3e, rc 0) 00000100:00100000:0.0:1788869329.729619:0:5735:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000036e14302 pname:cluuid:pid:xid:nid:opc:job mount.lustre:121cd5bc-7f07-4cf7-8e2e-4356c89c0696:5735:1875765421409664:0@lo:101: 00010000:00010000:0.0:1788869329.729628:0:5735:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.139@tcp lock: 000000002f2afe60/0x3d2d1916761d618e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3d2d1916761d6195 expref: -99 pid: 5735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869329.729634:0:5735:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.139@tcp lock: 000000002f2afe60/0x3d2d1916761d618e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x3d2d1916761d6195 expref: -99 pid: 5735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788869329.729760:0:5749:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000008ab2368b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:121cd5bc-7f07-4cf7-8e2e-4356c89c0696+10:5735:x1875765421409664:12345-0@lo:101: Request processed in 255us (378us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869329.729767:0:5749:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788869329.730335:0:5735:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000036e14302 pname:cluuid:pid:xid:nid:opc:job mount.lustre:121cd5bc-7f07-4cf7-8e2e-4356c89c0696:5735:1875765421409792:0@lo:256: 00000100:00100000:0.0:1788869329.730410:0:5735:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869329.730432:0:5735:0:(client.c:2702:ptlrpc_set_wait()) set 00000000ad5d93ef going to sleep for 11 seconds 00000100:00100000:3.0:1788869329.730468:0:5750:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765421409792 00000100:00100000:3.0:1788869329.730473:0:5750:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765421409792 00000100:00100000:3.0:1788869329.730508:0:5750:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788869329.730515:0:5750:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000001c10ae01 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:121cd5bc-7f07-4cf7-8e2e-4356c89c0696+10:5735:x1875765421409792:12345-0@lo:256: 20000000:01000000:3.0:1788869329.730529:0:5750:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:3.0:1788869329.730535:0:5750:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:3.0:1788869329.730678:0:5750:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000001c10ae01 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:121cd5bc-7f07-4cf7-8e2e-4356c89c0696+10:5735:x1875765421409792:12345-0@lo:256: Request processed in 164us (268us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869329.730686:0:5750:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788869329.730916:0:5735:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000036e14302 pname:cluuid:pid:xid:nid:opc:job mount.lustre:121cd5bc-7f07-4cf7-8e2e-4356c89c0696:5735:1875765421409792:0@lo:256: 10000000:01000000:0.0:1788869329.731485:0:5735:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.139@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1788869329.731497:0:5735:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.139@tcp lock: 000000002f2afe60/0x3d2d1916761d618e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3d2d1916761d6195 expref: -99 pid: 5735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869329.731503:0:5735:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.139@tcp lock: 000000002f2afe60/0x3d2d1916761d618e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3d2d1916761d6195 expref: -99 pid: 5735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788869329.731508:0:5735:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff94c805125000 from 1 10000000:01000000:0.0:1788869329.731510:0:5735:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788869329.731530:0:5735:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.139@tcp lock: 0000000081575a94/0x3d2d1916761d619c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869329.731534:0:5735:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.139@tcp lock: 0000000081575a94/0x3d2d1916761d619c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869329.731540:0:5735:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.139@tcp lock: 0000000081575a94/0x3d2d1916761d619c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788869329.731553:0:5735:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000036e14302 pname:cluuid:pid:xid:nid:opc:job mount.lustre:121cd5bc-7f07-4cf7-8e2e-4356c89c0696:5735:1875765421409920:0@lo:101: 00000100:00100000:0.0:1788869329.731579:0:5735:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869329.731602:0:5735:0:(client.c:2702:ptlrpc_set_wait()) set 00000000ad5d93ef going to sleep for 11 seconds 00000100:00100000:3.0:1788869329.731621:0:5749:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765421409920 00000100:00100000:3.0:1788869329.731626:0:5749:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765421409920 00000100:00100000:3.0:1788869329.731662:0:5749:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788869329.731668:0:5749:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000005d346ebd pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:121cd5bc-7f07-4cf7-8e2e-4356c89c0696+10:5735:x1875765421409920:12345-0@lo:101: 00010000:00010000:3.0:1788869329.731675:0:5749:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788869329.731685:0:5749:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000da038adf/0x3d2d1916761d61a3 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x3d2d1916761d619c expref: -99 pid: 5749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869329.731700:0:5749:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000da038adf/0x3d2d1916761d61a3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3d2d1916761d619c expref: 11 pid: 5749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869329.731809:0:5749:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000da038adf/0x3d2d1916761d61a3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3d2d1916761d619c expref: 11 pid: 5749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869329.731817:0:5749:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000da038adf, rc 0) 00000100:00100000:3.0:1788869329.731867:0:5749:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000005d346ebd pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:121cd5bc-7f07-4cf7-8e2e-4356c89c0696+11:5735:x1875765421409920:12345-0@lo:101: Request processed in 199us (288us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869329.731873:0:5749:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788869329.731898:0:5735:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000036e14302 pname:cluuid:pid:xid:nid:opc:job mount.lustre:121cd5bc-7f07-4cf7-8e2e-4356c89c0696:5735:1875765421409920:0@lo:101: 00010000:00010000:1.0:1788869329.731912:0:5735:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.139@tcp lock: 0000000081575a94/0x3d2d1916761d619c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3d2d1916761d61a3 expref: -99 pid: 5735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869329.731938:0:5735:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.139@tcp lock: 0000000081575a94/0x3d2d1916761d619c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x3d2d1916761d61a3 expref: -99 pid: 5735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788869329.731980:0:5735:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000ece4f73d pname:cluuid:pid:xid:nid:opc:job mount.lustre:121cd5bc-7f07-4cf7-8e2e-4356c89c0696:5735:1875765421410048:0@lo:501: 00000100:00100000:1.0:1788869329.732008:0:5735:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869329.732029:0:5735:0:(client.c:2702:ptlrpc_set_wait()) set 00000000a18e141a going to sleep for 11 seconds 00000100:00100000:3.0:1788869329.732057:0:5750:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765421410048 00000100:00100000:3.0:1788869329.732062:0:5750:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765421410048 00000100:00100000:3.0:1788869329.732087:0:5750:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1788869329.732093:0:5750:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f8629a9d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:121cd5bc-7f07-4cf7-8e2e-4356c89c0696+11:5735:x1875765421410048:12345-0@lo:501: 00000100:00100000:1.0:1788869329.734214:0:5735:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000ece4f73d pname:cluuid:pid:xid:nid:opc:job mount.lustre:121cd5bc-7f07-4cf7-8e2e-4356c89c0696:5735:1875765421410048:0@lo:501: 00000100:00100000:3.0:1788869329.734223:0:5750:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f8629a9d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:121cd5bc-7f07-4cf7-8e2e-4356c89c0696+11:5735:x1875765421410048:12345-0@lo:501: Request processed in 2129us (2213us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869329.734234:0:5750:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788869329.738648:0:5735:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000ece4f73d pname:cluuid:pid:xid:nid:opc:job mount.lustre:121cd5bc-7f07-4cf7-8e2e-4356c89c0696:5735:1875765421410176:0@lo:503: 00000100:00100000:1.0:1788869329.738905:0:5735:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869329.738955:0:5748:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765421410176 00000100:00100000:0.0:1788869329.738963:0:5748:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765421410176 00000100:00100000:0.0:1788869329.739007:0:5748:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788869329.739009:0:5735:0:(client.c:2702:ptlrpc_set_wait()) set 00000000a18e141a going to sleep for 11 seconds 00000100:00100000:0.0:1788869329.739021:0:5748:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000009d9d3f77 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:121cd5bc-7f07-4cf7-8e2e-4356c89c0696+11:5735:x1875765421410176:12345-0@lo:503: 00000040:00080000:0.0:1788869329.739063:0:5748:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1788869329.739112:0:5748:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000009d9d3f77 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:121cd5bc-7f07-4cf7-8e2e-4356c89c0696+11:5735:x1875765421410176:12345-0@lo:503: Request processed in 100us (225us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869329.739118:0:5748:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788869329.739173:0:5735:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000ece4f73d pname:cluuid:pid:xid:nid:opc:job mount.lustre:121cd5bc-7f07-4cf7-8e2e-4356c89c0696:5735:1875765421410176:0@lo:503: 00000040:00080000:2.0:1788869329.740445:0:5782:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 1 00000020:01000000:1.0:1788869329.740579:0:5735:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-0 (rc=0) 10000000:01000000:1.0:1788869329.740694:0:5735:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.139@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788869329.740749:0:5735:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.139@tcp lock: 0000000081575a94/0x3d2d1916761d619c lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3d2d1916761d61a3 expref: -99 pid: 5735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869329.740761:0:5735:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.139@tcp lock: 0000000081575a94/0x3d2d1916761d619c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3d2d1916761d61a3 expref: -99 pid: 5735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788869329.740832:0:5735:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1788869329.740835:0:5735:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff94c805125000 10000000:01000000:1.0:1788869329.740849:0:5735:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff94c805125000 10000000:01000000:1.0:1788869329.740878:0:5735:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1788869329.740896:0:5735:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff94c805125000 from 1 10000000:01000000:1.0:1788869329.740899:0:5735:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1788869329.740948:0:5735:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.139@tcp lock: 00000000b50aff88/0x3d2d1916761d61aa lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869329.741014:0:5735:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.139@tcp lock: 00000000b50aff88/0x3d2d1916761d61aa lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869329.741022:0:5735:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.139@tcp lock: 00000000b50aff88/0x3d2d1916761d61aa lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788869329.741110:0:5735:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000002ffb3830 pname:cluuid:pid:xid:nid:opc:job mount.lustre:121cd5bc-7f07-4cf7-8e2e-4356c89c0696:5735:1875765421410304:0@lo:101: 00000100:00100000:1.0:1788869329.741161:0:5735:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869329.741191:0:5735:0:(client.c:2702:ptlrpc_set_wait()) set 000000002b0fd235 going to sleep for 11 seconds 00000100:00100000:3.0:1788869329.741203:0:5750:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765421410304 00000100:00100000:3.0:1788869329.741211:0:5750:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765421410304 00000100:00100000:3.0:1788869329.741246:0:5750:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788869329.741282:0:5750:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ee557b4a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:121cd5bc-7f07-4cf7-8e2e-4356c89c0696+11:5735:x1875765421410304:12345-0@lo:101: 00010000:00010000:3.0:1788869329.741294:0:5750:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788869329.741314:0:5750:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000009f4f776c/0x3d2d1916761d61b1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x3d2d1916761d61aa expref: -99 pid: 5750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869329.741337:0:5750:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000009f4f776c/0x3d2d1916761d61b1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3d2d1916761d61aa expref: 12 pid: 5750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869329.741349:0:5750:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000009f4f776c/0x3d2d1916761d61b1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3d2d1916761d61aa expref: 12 pid: 5750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869329.741461:0:5750:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000009f4f776c, rc 0) 00000100:00100000:3.0:1788869329.741501:0:5750:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ee557b4a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:121cd5bc-7f07-4cf7-8e2e-4356c89c0696+12:5735:x1875765421410304:12345-0@lo:101: Request processed in 222us (340us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869329.741508:0:5750:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788869329.741611:0:5735:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000002ffb3830 pname:cluuid:pid:xid:nid:opc:job mount.lustre:121cd5bc-7f07-4cf7-8e2e-4356c89c0696:5735:1875765421410304:0@lo:101: 00010000:00010000:1.0:1788869329.741651:0:5735:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.139@tcp lock: 00000000b50aff88/0x3d2d1916761d61aa lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x3d2d1916761d61b1 expref: -99 pid: 5735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869329.741660:0:5735:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.139@tcp lock: 00000000b50aff88/0x3d2d1916761d61aa lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x3d2d1916761d61b1 expref: -99 pid: 5735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788869329.741775:0:5735:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000002ffb3830 pname:cluuid:pid:xid:nid:opc:job mount.lustre:121cd5bc-7f07-4cf7-8e2e-4356c89c0696:5735:1875765421410432:0@lo:501: 00000100:00100000:1.0:1788869329.741822:0:5735:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869329.741847:0:5735:0:(client.c:2702:ptlrpc_set_wait()) set 000000002b0fd235 going to sleep for 11 seconds 00000100:00100000:0.0:1788869329.741880:0:5748:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765421410432 00000100:00100000:0.0:1788869329.741886:0:5748:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765421410432 00000100:00100000:0.0:1788869329.741915:0:5748:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1788869329.741921:0:5748:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000649ce5d8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:121cd5bc-7f07-4cf7-8e2e-4356c89c0696+12:5735:x1875765421410432:12345-0@lo:501: 00000100:00100000:0.0:1788869329.742164:0:5748:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000649ce5d8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:121cd5bc-7f07-4cf7-8e2e-4356c89c0696+12:5735:x1875765421410432:12345-0@lo:501: Request processed in 243us (340us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869329.742172:0:5748:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1788869329.742187:0:5735:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000002ffb3830 pname:cluuid:pid:xid:nid:opc:job mount.lustre:121cd5bc-7f07-4cf7-8e2e-4356c89c0696:5735:1875765421410432:0@lo:501: 00000100:00100000:1.0:1788869329.742209:0:5735:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000002ffb3830 pname:cluuid:pid:xid:nid:opc:job mount.lustre:121cd5bc-7f07-4cf7-8e2e-4356c89c0696:5735:1875765421410560:0@lo:503: 00000100:00100000:1.0:1788869329.742236:0:5735:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869329.742270:0:5735:0:(client.c:2702:ptlrpc_set_wait()) set 000000002b0fd235 going to sleep for 11 seconds 00000100:00100000:3.0:1788869329.742310:0:5750:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765421410560 00000100:00100000:3.0:1788869329.742316:0:5750:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765421410560 00000100:00100000:3.0:1788869329.742341:0:5750:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1788869329.742348:0:5750:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000003611b45b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:121cd5bc-7f07-4cf7-8e2e-4356c89c0696+12:5735:x1875765421410560:12345-0@lo:503: 00000100:00100000:3.0:1788869329.742912:0:5750:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000003611b45b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:121cd5bc-7f07-4cf7-8e2e-4356c89c0696+12:5735:x1875765421410560:12345-0@lo:503: Request processed in 564us (674us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869329.742919:0:5750:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1788869329.743054:0:5735:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000002ffb3830 pname:cluuid:pid:xid:nid:opc:job mount.lustre:121cd5bc-7f07-4cf7-8e2e-4356c89c0696:5735:1875765421410560:0@lo:503: 00000100:00100000:3.0:1788869329.743913:0:5783:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000002e631480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:121cd5bc-7f07-4cf7-8e2e-4356c89c0696:5783:1875765421410688:0@lo:502: 00000100:00100000:3.0:1788869329.743952:0:5783:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869329.743993:0:5783:0:(client.c:2702:ptlrpc_set_wait()) set 000000004c7d0ee1 going to sleep for 11 seconds 00000100:00100000:0.0:1788869329.744023:0:5748:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765421410688 00000100:00100000:0.0:1788869329.744028:0:5748:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765421410688 00000100:00100000:0.0:1788869329.744116:0:5748:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1788869329.744124:0:5748:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000007d128182 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:121cd5bc-7f07-4cf7-8e2e-4356c89c0696+12:5783:x1875765421410688:12345-0@lo:502: 00000100:00100000:0.0:1788869329.744725:0:5748:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000007d128182 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:121cd5bc-7f07-4cf7-8e2e-4356c89c0696+12:5783:x1875765421410688:12345-0@lo:502: Request processed in 603us (773us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869329.744731:0:5748:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1788869329.744774:0:5783:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000002e631480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:121cd5bc-7f07-4cf7-8e2e-4356c89c0696:5783:1875765421410688:0@lo:502: 00000020:01000004:3.0:1788869329.744827:0:5783:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:3.0:1788869329.744847:0:5783:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (000000001887a9ea) 00000020:00000080:3.0:1788869329.744878:0:5783:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type lwp with refcount 2 00000020:01000004:3.0:1788869329.745065:0:5783:0:(tgt_mount.c:153:server_get_mount()) get mount 00000000f4ebc304 from lustre-MDT0000, refs=4 00000020:01000004:3.0:1788869329.745074:0:5783:0:(tgt_mount.c:187:server_put_mount()) put mount 00000000f4ebc304 from lustre-MDT0000, refs=4 00000020:01000004:3.0:1788869329.745076:0:5783:0:(obd_mount.c:710:lustre_put_lsi()) put 00000000f4ebc304 4 00010000:00080000:3.0:1788869329.745102:0:5783:0:(ldlm_lib.c:102:import_set_conn()) imp 00000000aaca51b3@lustre-MDT0000-lwp-MDT0000: add connection 192.168.201.139@tcp at head 00010000:00010000:3.0:1788869329.746783:0:5783:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-1 is initialized 00000020:00000080:3.0:1788869329.746876:0:5783:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:3.0:1788869329.746906:0:5783:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1788869329.746916:0:5783:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0x3d2d1916761d61bf 00000100:00080000:3.0:1788869329.746925:0:5783:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788869329.746929:0:5783:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 00000000aaca51b3 using connection 192.168.201.139@tcp/0@lo 00000100:00100000:3.0:1788869329.746959:0:5783:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@000000002e631480 x1875765421410816/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788869329.747005:0:5783:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:1.0:1788869329.747023:0:3282:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000002e631480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3282:1875765421410816:0@lo:38: 00000100:00100000:1.0:1788869329.747098:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869329.747207:0:5755:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765421410816 00000100:00100000:3.0:1788869329.747213:0:5755:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765421410816 00000100:00100000:3.0:1788869329.747279:0:5755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788869329.747285:0:5755:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000002ffb3830 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3282:x1875765421410816:12345-0@lo:38: 00000100:00100000:2.0:1788869329.747290:0:5756:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:2.0:1788869329.747300:0:5756:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:3.0:1788869329.747341:0:5755:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000002ffb3830 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3282:x1875765421410816:12345-0@lo:38: Request processed in 55us (243us total) trans 0 rc -11/-11 00000100:00100000:3.0:1788869329.747349:0:5755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788869329.747367:0:3282:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1788869329.747374:0:3282:0:(import.c:65:import_set_state_nolock()) 00000000aaca51b3 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788869329.747378:0:3282:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:1.0:1788869329.747381:0:3282:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000002e631480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3282:1875765421410816:0@lo:38: 00000100:00100000:2.0:1788869329.748906:0:5783:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000002d7d9f2 pname:cluuid:pid:xid:nid:opc:job llog_process_th:121cd5bc-7f07-4cf7-8e2e-4356c89c0696:5783:1875765421410944:0@lo:502: 00000100:00100000:2.0:1788869329.749019:0:5783:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869329.749056:0:5783:0:(client.c:2702:ptlrpc_set_wait()) set 00000000141c8dd0 going to sleep for 11 seconds 00000100:00100000:0.0:1788869329.749071:0:5750:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765421410944 00000100:00100000:0.0:1788869329.749078:0:5750:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765421410944 00000100:00100000:0.0:1788869329.749117:0:5750:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1788869329.749126:0:5750:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000067f5adab pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:121cd5bc-7f07-4cf7-8e2e-4356c89c0696+12:5783:x1875765421410944:12345-0@lo:502: 00000100:00100000:0.0:1788869329.749546:0:5750:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000067f5adab pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:121cd5bc-7f07-4cf7-8e2e-4356c89c0696+12:5783:x1875765421410944:12345-0@lo:502: Request processed in 422us (527us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869329.749553:0:5750:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1788869329.749580:0:5783:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000002d7d9f2 pname:cluuid:pid:xid:nid:opc:job llog_process_th:121cd5bc-7f07-4cf7-8e2e-4356c89c0696:5783:1875765421410944:0@lo:502: 00000040:00080000:2.0:1788869329.749673:0:5783:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 21 count 21 00000020:01000000:1.0:1788869329.749910:0:5735:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-20 (rc=0) 10000000:01000000:1.0:1788869329.749935:0:5735:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.139@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1788869329.749951:0:5735:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.139@tcp lock: 00000000b50aff88/0x3d2d1916761d61aa lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x3d2d1916761d61b1 expref: -99 pid: 5735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869329.749961:0:5735:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.139@tcp lock: 00000000b50aff88/0x3d2d1916761d61aa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x3d2d1916761d61b1 expref: -99 pid: 5735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1788869329.750007:0:5735:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1788869329.750010:0:5735:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1788869329.750011:0:5735:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788869329.750022:0:5735:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788869329.750024:0:5735:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788869329.750025:0:5735:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788869329.750026:0:5735:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1788869329.750027:0:5735:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1788869329.750028:0:5735:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1788869329.750029:0:5735:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1788869329.750030:0:5735:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788869329.750032:0:5735:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1788869329.750035:0:5735:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020065 00000020:01000004:1.0:1788869329.750037:0:5735:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1788869329.750038:0:5735:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1788869329.750039:0:5735:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788869329.750040:0:5735:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788869329.750042:0:5735:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788869329.750042:0:5735:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788869329.750043:0:5735:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1788869329.750044:0:5735:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1788869329.750051:0:5735:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1788869329.750051:0:5735:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1788869329.750052:0:5735:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788869329.750053:0:5735:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1788869329.750068:0:5735:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:1.0:1788869329.750076:0:5735:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000003851d209 pname:cluuid:pid:xid:nid:opc:job mount.lustre:121cd5bc-7f07-4cf7-8e2e-4356c89c0696:5735:1875765421411072:0@lo:253: 00000100:00100000:1.0:1788869329.750110:0:5735:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869329.750134:0:5735:0:(client.c:2702:ptlrpc_set_wait()) set 000000002442f6e5 going to sleep for 11 seconds 00000100:00100000:0.0:1788869329.750204:0:5748:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765421411072 00000100:00100000:0.0:1788869329.750216:0:5748:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765421411072 00000100:00100000:0.0:1788869329.750247:0:5748:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1788869329.750276:0:5748:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000008ac7d81b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:121cd5bc-7f07-4cf7-8e2e-4356c89c0696+12:5735:x1875765421411072:12345-0@lo:253: 20000000:01000000:0.0:1788869329.750302:0:5748:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:0.0:1788869329.750312:0:5748:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:2.0:1788869329.765268:0:5748:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1788869329.765284:0:5748:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:0.0:1788869329.765300:0:5771:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1788869329.765306:0:5771:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1788869329.765325:0:5771:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 000000002bff636d/0x3d2d1916761d61c6 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869329.765342:0:5771:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 000000003199bc3e/0x3d2d1916761d6195 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3d2d1916761d618e expref: 12 pid: 5749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869329.765351:0:5771:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 000000002bff636d/0x3d2d1916761d61c6 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869329.765401:0:5771:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 000000003199bc3e/0x3d2d1916761d6195 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x3d2d1916761d618e expref: 12 pid: 5749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869329.765415:0:5771:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 000000003199bc3e/0x3d2d1916761d6195 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x3d2d1916761d618e expref: 12 pid: 5749 timeout: 228 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788869329.765430:0:5771:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000001bcea257 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5771:1875765421411200:0@lo:104: 00000100:00100000:0.0:1788869329.765485:0:5771:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869329.765533:0:5771:0:(client.c:2702:ptlrpc_set_wait()) set 00000000ad5d93ef going to sleep for 11 seconds 00000100:00100000:3.0:1788869329.765574:0:5737:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765421411200 00000100:00100000:3.0:1788869329.765583:0:5737:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765421411200 00000100:00100000:3.0:1788869329.765643:0:5737:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788869329.765650:0:5738:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 2 min 2 max 56 00000100:00100000:0.0:1788869329.765656:0:5738:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_002' 00000100:00100000:3.0:1788869329.765660:0:5737:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000037042331 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:121cd5bc-7f07-4cf7-8e2e-4356c89c0696+3:5771:x1875765421411200:12345-0@lo:104: 00010000:00010000:3.0:1788869329.765673:0:5737:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.139@tcp lock: 000000002f2afe60/0x3d2d1916761d618e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x3d2d1916761d6195 expref: -99 pid: 5735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869329.765757:0:5737:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788869329.765764:0:5737:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000037042331 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:121cd5bc-7f07-4cf7-8e2e-4356c89c0696+3:5771:x1875765421411200:12345-0@lo:104: Request processed in 113us (277us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869329.765779:0:5737:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788869329.765798:0:5771:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000001bcea257 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5771:1875765421411200:0@lo:104: 00010000:00010000:1.0:1788869329.765821:0:5771:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 000000002bff636d/0x3d2d1916761d61c6 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869329.765879:0:5742:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788869329.765884:0:5742:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.139@tcp lock: 000000002f2afe60/0x3d2d1916761d618e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x3d2d1916761d6195 expref: -99 pid: 5735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869329.765892:0:5742:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000002f2afe60 already unused, calling callback (000000003cccefb1) 10000000:00010000:1.0:1788869329.765895:0:5742:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.139@tcp lock: 000000002f2afe60/0x3d2d1916761d618e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x3d2d1916761d6195 expref: -99 pid: 5735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869329.765909:0:5742:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.139@tcp lock: 000000002f2afe60/0x3d2d1916761d618e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x3d2d1916761d6195 expref: -99 pid: 5735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788869329.765916:0:5742:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.139@tcp lock: 000000002f2afe60/0x3d2d1916761d618e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x3d2d1916761d6195 expref: -99 pid: 5735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788869329.765921:0:5742:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1788869329.765953:0:5742:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.139@tcp lock: 000000002f2afe60/0x3d2d1916761d618e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3d2d1916761d6195 expref: -99 pid: 5735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869329.765964:0:5742:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788869329.766000:0:5742:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.139@tcp lock: 000000002f2afe60/0x3d2d1916761d618e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3d2d1916761d6195 expref: -99 pid: 5735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788869329.766009:0:3284:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000030558a4 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:121cd5bc-7f07-4cf7-8e2e-4356c89c0696:3284:1875765421411328:0@lo:103: 00010000:00010000:1.0:1788869329.766021:0:5742:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.139@tcp lock: 000000002f2afe60/0x3d2d1916761d618e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3d2d1916761d6195 expref: -99 pid: 5735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869329.766036:0:5742:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788869329.766040:0:5742:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788869329.766040:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788869329.766045:0:5742:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788869329.766099:0:5739:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765421411328 00000100:00100000:1.0:1788869329.766104:0:5739:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765421411328 00010000:00010000:1.0:1788869329.766120:0:5739:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 000000003199bc3e/0x3d2d1916761d6195 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3d2d1916761d618e expref: 13 pid: 5749 timeout: 228 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788869329.766162:0:5739:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788869329.766169:0:5739:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000069afe6b4 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:121cd5bc-7f07-4cf7-8e2e-4356c89c0696+13:3284:x1875765421411328:12345-0@lo:103: 00000100:00100000:0.0:1788869329.766171:0:5740:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:0.0:1788869329.766179:0:5740:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_003' 00010000:00010000:1.0:1788869329.766181:0:5739:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788869329.766188:0:5739:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 000000003199bc3e/0x3d2d1916761d6195 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3d2d1916761d618e expref: 13 pid: 5749 timeout: 228 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869329.766198:0:5739:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 000000003199bc3e/0x3d2d1916761d6195 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x3d2d1916761d618e expref: 13 pid: 5749 timeout: 228 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869329.766210:0:5739:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000003199bc3e/0x3d2d1916761d6195 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x3d2d1916761d618e expref: 13 pid: 5749 timeout: 228 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869329.766222:0:5739:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 000000002bff636d/0x3d2d1916761d61c6 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869329.766230:0:5739:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000002bff636d/0x3d2d1916761d61c6 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1788869329.766280:0:5739:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.000974943s 00010000:00010000:1.0:1788869329.766284:0:5739:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000002bff636d/0x3d2d1916761d61c6 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869329.766291:0:5739:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000002bff636d/0x3d2d1916761d61c6 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869329.766297:0:5739:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 000000002bff636d/0x3d2d1916761d61c6 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869329.766303:0:5739:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 000000002bff636d/0x3d2d1916761d61c6 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869329.766308:0:5739:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000002bff636d already unused, calling callback (000000004926af38) 00010000:00010000:1.0:1788869329.766311:0:5739:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 000000002bff636d/0x3d2d1916761d61c6 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869329.766317:0:5739:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 000000002bff636d/0x3d2d1916761d61c6 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869329.766324:0:5739:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 000000002bff636d/0x3d2d1916761d61c6 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869329.766349:0:5739:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788869329.766387:0:5739:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000069afe6b4 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:121cd5bc-7f07-4cf7-8e2e-4356c89c0696+12:3284:x1875765421411328:12345-0@lo:103: Request processed in 220us (349us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869329.766394:0:5739:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:1.0:1788869329.766411:0:5771:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 000000002bff636d/0x3d2d1916761d61c6 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788869329.766426:0:3284:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000030558a4 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:121cd5bc-7f07-4cf7-8e2e-4356c89c0696:3284:1875765421411328:0@lo:103: 00010000:00010000:1.0:1788869329.766428:0:5771:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 000000002bff636d/0x3d2d1916761d61c6 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869329.766436:0:5771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000002bff636d/0x3d2d1916761d61c6 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788869329.772734:0:5748:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000008ac7d81b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:121cd5bc-7f07-4cf7-8e2e-4356c89c0696+11:5735:x1875765421411072:12345-0@lo:253: Request processed in 22451us (22618us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869329.772751:0:5748:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1788869329.772781:0:5735:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000003851d209 pname:cluuid:pid:xid:nid:opc:job mount.lustre:121cd5bc-7f07-4cf7-8e2e-4356c89c0696:5735:1875765421411072:0@lo:253: 10000000:01000000:1.0:1788869329.772799:0:5735:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:1.0:1788869329.772803:0:5735:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1788869329.772806:0:5735:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1788869329.772807:0:5735:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788869329.772809:0:5735:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788869329.772810:0:5735:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788869329.772812:0:5735:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788869329.772814:0:5735:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1788869329.772816:0:5735:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1788869329.772817:0:5735:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1788869329.772819:0:5735:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1788869329.772820:0:5735:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788869329.772821:0:5735:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:1.0:1788869329.772835:0:5735:0:(tgt_mount.c:2689:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:1.0:1788869329.776591:0:5735:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/8/4) registered 00080000:10000000:1.0:1788869329.777009:0:5735:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:1.0:1788869329.777206:0:5735:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00080000:10000000:1.0:1788869329.777521:0:5735:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:1.0:1788869329.777782:0:5735:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/8/4) registered 00080000:10000000:1.0:1788869329.777971:0:5735:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00080000:10000000:3.0:1788869329.780938:0:5735:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/8/4) registered 00080000:10000000:3.0:1788869329.781190:0:5735:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8/1) registered 00080000:10000000:3.0:1788869329.781492:0:5735:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/8/4) registered 00080000:10000000:3.0:1788869329.781738:0:5735:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8/1) registered 00080000:10000000:3.0:1788869329.782000:0:5735:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xf:0x0] (8/8/4) registered 00080000:10000000:3.0:1788869329.782182:0:5735:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8/1) registered 40000000:02000000:3.0:1788869329.811094:0:5735:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt 00000040:01000000:1.0:1788869329.830910:0:5735:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000020:00080000:3.0:1788869329.830925:0:5791:0:(update_trans.c:1538:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 0 00000020:00080000:3.0:1788869329.830930:0:5791:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000040:01000000:3.0:1788869329.831200:0:5792:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:0.0:1788869329.834527:0:5735:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:0.0:1788869329.834727:0:5735:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:0.0:1788869329.835352:0:5735:0:(mdd_device.c:553:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:0.0:1788869329.835360:0:5735:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:0.0:1788869329.835483:0:5735:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788869329.836712:0:5735:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:0.0:1788869329.837337:0:5735:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:0.0:1788869329.837366:0:5735:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000040:00080000:0.0:1788869329.837592:0:5735:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:0.0:1788869329.837819:0:5735:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x11:0x0] (8/8/4) registered 00100000:10000000:0.0:1788869329.840245:0:5735:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_00: rc = 0 00100000:10000000:0.0:1788869329.840606:0:5735:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_01: rc = 0 00100000:10000000:0.0:1788869329.840829:0:5735:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_02: rc = 0 00100000:10000000:0.0:1788869329.841130:0:5735:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_03: rc = 0 00100000:10000000:0.0:1788869329.841532:0:5735:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_04: rc = 0 00100000:10000000:0.0:1788869329.842508:0:5735:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_05: rc = 0 00100000:10000000:0.0:1788869329.842760:0:5735:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_06: rc = 0 00100000:10000000:0.0:1788869329.842979:0:5735:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_07: rc = 0 00100000:10000000:0.0:1788869329.843216:0:5735:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_08: rc = 0 00100000:10000000:0.0:1788869329.843528:0:5735:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_09: rc = 0 00100000:10000000:0.0:1788869329.843700:0:5735:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_10: rc = 0 00100000:10000000:0.0:1788869329.843929:0:5735:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_11: rc = 0 00100000:10000000:0.0:1788869329.844169:0:5735:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_12: rc = 0 00100000:10000000:0.0:1788869329.844348:0:5735:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_13: rc = 0 00100000:10000000:0.0:1788869329.844621:0:5735:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_14: rc = 0 00100000:10000000:0.0:1788869329.844928:0:5735:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_15: rc = 0 00100000:10000000:0.0:1788869329.845515:0:5735:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_00: rc = 0 00100000:10000000:0.0:1788869329.845758:0:5735:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_01: rc = 0 00100000:10000000:0.0:1788869329.845928:0:5735:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_02: rc = 0 00100000:10000000:0.0:1788869329.846160:0:5735:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_03: rc = 0 00100000:10000000:0.0:1788869329.846338:0:5735:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_04: rc = 0 00100000:10000000:0.0:1788869329.846548:0:5735:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_05: rc = 0 00100000:10000000:0.0:1788869329.846681:0:5735:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_06: rc = 0 00100000:10000000:0.0:1788869329.846824:0:5735:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_07: rc = 0 00100000:10000000:0.0:1788869329.846980:0:5735:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_08: rc = 0 00100000:10000000:0.0:1788869329.847195:0:5735:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_09: rc = 0 00100000:10000000:0.0:1788869329.847376:0:5735:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_10: rc = 0 00100000:10000000:0.0:1788869329.847642:0:5735:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_11: rc = 0 00100000:10000000:0.0:1788869329.847779:0:5735:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_12: rc = 0 00100000:10000000:0.0:1788869329.848416:0:5735:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_13: rc = 0 00100000:10000000:0.0:1788869329.848801:0:5735:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_14: rc = 0 00100000:10000000:0.0:1788869329.849533:0:5735:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_15: rc = 0 00000001:00000004:0.0:1788869329.849795:0:5735:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000040:00080000:3.0:1788869329.861536:0:5792:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000001:00080000:3.0:1788869329.894363:0:5735:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:3.0:1788869329.894401:0:5735:0:(mdd_device.c:2302:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffacc1429c3988 00100000:10000000:3.0:1788869329.894410:0:5735:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:3.0:1788869329.894811:0:5735:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1788869329.894828:0:5735:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.201.139@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1788869329.894844:0:5735:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=45 00000080:00000004:3.0:1788869329.894878:0:5735:0:(super25.c:181:lustre_fill_super()) lustre-mdt1/mdt1: Mount complete 00000040:00080000:0.0:1788869329.918956:0:5792:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:0.0:1788869329.919023:0:5792:0:(lod_dev.c:522:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000004:00080000:0.0:1788869329.919027:0:5792:0:(lod_dev.c:546:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00010000:00010000:3.0:1788869330.332017:0:5743:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788869331.358620:0:5742:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788869332.381764:0:5743:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1788869332.679735:0:6034:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg139-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:1.0:1788869333.405514:0:5742:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788869334.430627:0:5743:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1788869335.131436:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1788869335.131451:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1788869335.131455:0:36:0:(import.c:65:import_set_state_nolock()) 00000000aaca51b3 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788869335.131471:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 00000000aaca51b3 using connection 192.168.201.139@tcp/0@lo 00000100:00100000:3.0:1788869335.131513:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@000000005294dd90 x1875765421411584/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788869335.131528:0:3285:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000c334477c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:121cd5bc-7f07-4cf7-8e2e-4356c89c0696:3285:1875765421411456:0@lo:400: 00000100:00100000:1.0:1788869335.131790:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869335.131886:0:5750:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765421411456 00000100:00100000:3.0:1788869335.131896:0:5750:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765421411456 00000100:00100000:1.0:1788869335.131910:0:3282:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000005294dd90 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3282:1875765421411584:0@lo:38: 00000100:00100000:1.0:1788869335.131961:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869335.132022:0:5757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765421411584 00000100:00100000:2.0:1788869335.132026:0:5750:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1788869335.132029:0:5757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765421411584 00000100:00100000:2.0:1788869335.132040:0:5750:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000008d6c2a3b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:121cd5bc-7f07-4cf7-8e2e-4356c89c0696+11:3285:x1875765421411456:12345-0@lo:400: 00000100:00100000:2.0:1788869335.132139:0:5750:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000008d6c2a3b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:121cd5bc-7f07-4cf7-8e2e-4356c89c0696+11:3285:x1875765421411456:12345-0@lo:400: Request processed in 104us (361us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869335.132148:0:5750:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1788869335.132326:0:5755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788869335.132341:0:5755:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000003851d209 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3282:x1875765421411584:12345-0@lo:38: 00010000:00080000:2.0:1788869335.132369:0:5755:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 83 last 0 00000020:00000080:2.0:1788869335.132416:0:5755:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0x3d2d1916761d61cd 00000100:00100000:1.0:1788869335.132463:0:3285:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000c334477c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:121cd5bc-7f07-4cf7-8e2e-4356c89c0696:3285:1875765421411456:0@lo:400: 00000004:00100000:2.0:1788869335.132551:0:5755:0:(mdt_handler.c:7366:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1788869335.132691:0:5755:0:(import.c:65:import_set_state_nolock()) 0000000077ba8786 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788869335.132770:0:5755:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000003851d209 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3282:x1875765421411584:12345-0@lo:38: Request processed in 426us (808us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869335.132780:0:5755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1788869335.132964:0:3282:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@000000005294dd90 x1875765421411584/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788869345 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1788869335.132976:0:3282:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 1 00000100:00080000:1.0:1788869335.132982:0:3282:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:1.0:1788869335.132985:0:3282:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1788869335.132987:0:3282:0:(import.c:65:import_set_state_nolock()) 00000000aaca51b3 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1788869335.132990:0:3282:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000005294dd90 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3282:1875765421411584:0@lo:38: 00010000:00010000:1.0:1788869335.451436:0:5742:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1788869336.038953:0:6236:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffe3aa6e220 20000000:00000080:2.0:1788869336.038970:0:6236:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff94c836515c00 uarg=0000000000000000 20000000:01000000:2.0:1788869336.039014:0:6236:0:(mgs_llog.c:6188:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:2.0:1788869336.039022:0:6236:0:(mgs_llog.c:4643:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:2.0:1788869336.039027:0:6236:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:2.0:1788869336.039397:0:6236:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:02000000:2.0:1788869336.039408:0:6236:0:(mgs_llog.c:4116:mgs_wlp_lcfg()) Modifying parameter general.debug_raw_pointers=Y in log params 00000040:00080000:2.0:1788869336.042660:0:6236:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788869336.042903:0:6236:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:2.0:1788869336.042950:0:6236:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 112 off8528 00000040:00080000:2.0:1788869336.043003:0:6236:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 224 off8752 10000000:01000000:2.0:1788869336.043018:0:6236:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:2.0:1788869336.043033:0:6236:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 00000000da6200eb/0x3d2d1916761d61d4 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869336.043049:0:6236:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000da038adf/0x3d2d1916761d61a3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3d2d1916761d619c expref: 10 pid: 5749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869336.043057:0:6236:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 00000000da6200eb/0x3d2d1916761d61d4 lrc: 4/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869336.043145:0:6236:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000da038adf/0x3d2d1916761d61a3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x3d2d1916761d619c expref: 10 pid: 5749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869336.043167:0:6236:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000da038adf/0x3d2d1916761d61a3 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x3d2d1916761d619c expref: 10 pid: 5749 timeout: 234 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788869336.043180:0:6236:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000002d7d9f2 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:6236:1875765421411712:0@lo:104: 00000100:00100000:2.0:1788869336.043234:0:6236:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869336.043376:0:6236:0:(client.c:2702:ptlrpc_set_wait()) set 0000000050b2f5d6 going to sleep for 11 seconds 00000100:00100000:0.0:1788869336.043421:0:5738:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765421411712 00000100:00100000:0.0:1788869336.043429:0:5738:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765421411712 00000100:00100000:0.0:1788869336.043508:0:5738:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788869336.043517:0:5738:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000627181ac pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:121cd5bc-7f07-4cf7-8e2e-4356c89c0696+3:6236:x1875765421411712:12345-0@lo:104: 00010000:00010000:0.0:1788869336.043528:0:5738:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.139@tcp lock: 0000000081575a94/0x3d2d1916761d619c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x3d2d1916761d61a3 expref: -99 pid: 5735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869336.043630:0:5738:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788869336.043635:0:5738:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000627181ac pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:121cd5bc-7f07-4cf7-8e2e-4356c89c0696+3:6236:x1875765421411712:12345-0@lo:104: Request processed in 121us (402us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869336.043643:0:5738:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00010000:1.0:1788869336.043658:0:5743:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788869336.043664:0:5743:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.139@tcp lock: 0000000081575a94/0x3d2d1916761d619c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x3d2d1916761d61a3 expref: -99 pid: 5735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869336.043746:0:5743:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 0000000081575a94 already unused, calling callback (000000003cccefb1) 10000000:00010000:1.0:1788869336.043750:0:5743:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.139@tcp lock: 0000000081575a94/0x3d2d1916761d619c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x3d2d1916761d61a3 expref: -99 pid: 5735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788869336.043756:0:6236:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000002d7d9f2 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:6236:1875765421411712:0@lo:104: 00010000:00010000:1.0:1788869336.043760:0:5743:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.139@tcp lock: 0000000081575a94/0x3d2d1916761d619c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x3d2d1916761d61a3 expref: -99 pid: 5735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788869336.043768:0:5743:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.139@tcp lock: 0000000081575a94/0x3d2d1916761d619c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x3d2d1916761d61a3 expref: -99 pid: 5735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869336.043772:0:6236:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 00000000da6200eb/0x3d2d1916761d61d4 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788869336.043775:0:5743:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1788869336.043813:0:5743:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.139@tcp lock: 0000000081575a94/0x3d2d1916761d619c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3d2d1916761d61a3 expref: -99 pid: 5735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869336.043820:0:5743:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788869336.043848:0:5743:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.139@tcp lock: 0000000081575a94/0x3d2d1916761d619c lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3d2d1916761d61a3 expref: -99 pid: 5735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869336.043855:0:5743:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.139@tcp lock: 0000000081575a94/0x3d2d1916761d619c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3d2d1916761d61a3 expref: -99 pid: 5735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788869336.043857:0:3286:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000df757de2 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:121cd5bc-7f07-4cf7-8e2e-4356c89c0696:3286:1875765421411840:0@lo:103: 00010000:00010000:1.0:1788869336.043877:0:5743:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788869336.043879:0:5743:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788869336.043881:0:5743:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788869336.043893:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869336.043919:0:5741:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765421411840 00000100:00100000:1.0:1788869336.043924:0:5741:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765421411840 00010000:00010000:1.0:1788869336.043940:0:5741:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000da038adf/0x3d2d1916761d61a3 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3d2d1916761d619c expref: 11 pid: 5749 timeout: 234 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788869336.043971:0:5741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788869336.043977:0:5741:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ee8696bb pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:121cd5bc-7f07-4cf7-8e2e-4356c89c0696+11:3286:x1875765421411840:12345-0@lo:103: 00010000:00010000:1.0:1788869336.043987:0:5741:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788869336.043991:0:5741:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000da038adf/0x3d2d1916761d61a3 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3d2d1916761d619c expref: 11 pid: 5749 timeout: 234 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869336.044000:0:5741:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000da038adf/0x3d2d1916761d61a3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x3d2d1916761d619c expref: 11 pid: 5749 timeout: 234 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869336.044012:0:5741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000da038adf/0x3d2d1916761d61a3 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x3d2d1916761d619c expref: 11 pid: 5749 timeout: 234 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869336.044022:0:5741:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 00000000da6200eb/0x3d2d1916761d61d4 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869336.044035:0:5741:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000da6200eb/0x3d2d1916761d61d4 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869336.044047:0:5741:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000da6200eb/0x3d2d1916761d61d4 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869336.044053:0:5741:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000da6200eb/0x3d2d1916761d61d4 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869336.044059:0:5741:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 00000000da6200eb/0x3d2d1916761d61d4 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869336.044064:0:5741:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 00000000da6200eb/0x3d2d1916761d61d4 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869336.044069:0:5741:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000da6200eb already unused, calling callback (000000004926af38) 00010000:00010000:1.0:1788869336.044072:0:5741:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 00000000da6200eb/0x3d2d1916761d61d4 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869336.044078:0:5741:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 00000000da6200eb/0x3d2d1916761d61d4 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869336.044093:0:5741:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 00000000da6200eb/0x3d2d1916761d61d4 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869336.044102:0:5741:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788869336.044142:0:5741:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ee8696bb pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:121cd5bc-7f07-4cf7-8e2e-4356c89c0696+10:3286:x1875765421411840:12345-0@lo:103: Request processed in 166us (249us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869336.044149:0:5741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788869336.044169:0:3286:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000df757de2 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:121cd5bc-7f07-4cf7-8e2e-4356c89c0696:3286:1875765421411840:0@lo:103: 00010000:00010000:2.0:1788869336.044211:0:6236:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 00000000da6200eb/0x3d2d1916761d61d4 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869336.044217:0:6236:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 00000000da6200eb/0x3d2d1916761d61d4 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869336.044222:0:6236:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000da6200eb/0x3d2d1916761d61d4 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788869336.283705:0:5752:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1788869336.283743:0:5752:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff94c805125000 from 3 10000000:01000000:2.0:1788869336.283749:0:5752:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1788869336.283798:0:5752:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.139@tcp lock: 00000000da6200eb/0x3d2d1916761d61db lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869336.283810:0:5752:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.139@tcp lock: 00000000da6200eb/0x3d2d1916761d61db lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869336.283821:0:5752:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.139@tcp lock: 00000000da6200eb/0x3d2d1916761d61db lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788869336.283859:0:5752:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000002d7d9f2 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:121cd5bc-7f07-4cf7-8e2e-4356c89c0696:5752:1875765421411968:0@lo:101: 00000100:00100000:2.0:1788869336.283928:0:5752:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869336.283998:0:5752:0:(client.c:2702:ptlrpc_set_wait()) set 00000000752980fb going to sleep for 11 seconds 00000100:00100000:0.0:1788869336.284119:0:5748:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765421411968 00000100:00100000:0.0:1788869336.284126:0:5748:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765421411968 00000100:00100000:0.0:1788869336.284177:0:5748:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1788869336.284185:0:5748:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a3ea2df9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:121cd5bc-7f07-4cf7-8e2e-4356c89c0696+10:5752:x1875765421411968:12345-0@lo:101: 00010000:00010000:0.0:1788869336.284207:0:5748:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788869336.284219:0:5748:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000002f2afe60/0x3d2d1916761d61e2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x3d2d1916761d61db expref: -99 pid: 5748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869336.284239:0:5748:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000002f2afe60/0x3d2d1916761d61e2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3d2d1916761d61db expref: 11 pid: 5748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869336.284268:0:5748:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000002f2afe60/0x3d2d1916761d61e2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3d2d1916761d61db expref: 11 pid: 5748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869336.284276:0:5748:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000002f2afe60, rc 0) 00000100:00100000:0.0:1788869336.284322:0:5748:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a3ea2df9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:121cd5bc-7f07-4cf7-8e2e-4356c89c0696+11:5752:x1875765421411968:12345-0@lo:101: Request processed in 139us (396us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869336.284329:0:5748:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1788869336.284460:0:5752:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000002d7d9f2 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:121cd5bc-7f07-4cf7-8e2e-4356c89c0696:5752:1875765421411968:0@lo:101: 00010000:00010000:3.0:1788869336.284474:0:5752:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.139@tcp lock: 00000000da6200eb/0x3d2d1916761d61db lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3d2d1916761d61e2 expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869336.284482:0:5752:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.139@tcp lock: 00000000da6200eb/0x3d2d1916761d61db lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x3d2d1916761d61e2 expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788869336.284528:0:5752:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000006a1655e5 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:121cd5bc-7f07-4cf7-8e2e-4356c89c0696:5752:1875765421412096:0@lo:256: 00000100:00100000:3.0:1788869336.284571:0:5752:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869336.284598:0:5752:0:(client.c:2702:ptlrpc_set_wait()) set 000000004ef396df going to sleep for 11 seconds 00000100:00100000:2.0:1788869336.284693:0:5750:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765421412096 00000100:00100000:2.0:1788869336.284698:0:5750:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765421412096 00000100:00100000:2.0:1788869336.284775:0:5750:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1788869336.284782:0:5750:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a393f6eb pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:121cd5bc-7f07-4cf7-8e2e-4356c89c0696+11:5752:x1875765421412096:12345-0@lo:256: 20000000:01000000:2.0:1788869336.284796:0:5750:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1788869336.284811:0:5750:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1788869336.284814:0:5750:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 3 00000100:00100000:2.0:1788869336.284893:0:5750:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a393f6eb pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:121cd5bc-7f07-4cf7-8e2e-4356c89c0696+11:5752:x1875765421412096:12345-0@lo:256: Request processed in 112us (322us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869336.284901:0:5750:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1788869336.285755:0:5752:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000006a1655e5 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:121cd5bc-7f07-4cf7-8e2e-4356c89c0696:5752:1875765421412096:0@lo:256: 10000000:01000000:1.0:1788869336.285804:0:5752:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.139@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1788869336.285811:0:5752:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.139@tcp lock: 00000000da6200eb/0x3d2d1916761d61db lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3d2d1916761d61e2 expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869336.285821:0:5752:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.139@tcp lock: 00000000da6200eb/0x3d2d1916761d61db lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3d2d1916761d61e2 expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788869336.285831:0:5752:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1788869336.285833:0:5752:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff94c805125000 from 1 10000000:01000000:1.0:1788869336.285835:0:5752:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788869336.285855:0:5752:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.139@tcp lock: 00000000002a3c51/0x3d2d1916761d61e9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869336.285861:0:5752:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.139@tcp lock: 00000000002a3c51/0x3d2d1916761d61e9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869336.285868:0:5752:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.139@tcp lock: 00000000002a3c51/0x3d2d1916761d61e9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788869336.285881:0:5752:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000009d2408e1 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:121cd5bc-7f07-4cf7-8e2e-4356c89c0696:5752:1875765421412224:0@lo:101: 00000100:00100000:1.0:1788869336.285913:0:5752:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869336.285995:0:5752:0:(client.c:2702:ptlrpc_set_wait()) set 000000004d5ede52 going to sleep for 11 seconds 00000100:00100000:3.0:1788869336.286034:0:5748:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765421412224 00000100:00100000:3.0:1788869336.286039:0:5748:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765421412224 00000100:00100000:3.0:1788869336.286118:0:5748:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1788869336.286125:0:5748:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a4b75462 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:121cd5bc-7f07-4cf7-8e2e-4356c89c0696+11:5752:x1875765421412224:12345-0@lo:101: 00010000:00010000:3.0:1788869336.286135:0:5748:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788869336.286144:0:5748:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000003199bc3e/0x3d2d1916761d61f0 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x3d2d1916761d61e9 expref: -99 pid: 5748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869336.286159:0:5748:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000003199bc3e/0x3d2d1916761d61f0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3d2d1916761d61e9 expref: 12 pid: 5748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869336.286174:0:5748:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000003199bc3e/0x3d2d1916761d61f0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3d2d1916761d61e9 expref: 12 pid: 5748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869336.286182:0:5748:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000003199bc3e, rc 0) 00000100:00100000:3.0:1788869336.286342:0:5748:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a4b75462 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:121cd5bc-7f07-4cf7-8e2e-4356c89c0696+12:5752:x1875765421412224:12345-0@lo:101: Request processed in 218us (428us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869336.286350:0:5748:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1788869336.286425:0:5752:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000009d2408e1 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:121cd5bc-7f07-4cf7-8e2e-4356c89c0696:5752:1875765421412224:0@lo:101: 00010000:00010000:1.0:1788869336.286435:0:5752:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.139@tcp lock: 00000000002a3c51/0x3d2d1916761d61e9 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3d2d1916761d61f0 expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869336.286442:0:5752:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.139@tcp lock: 00000000002a3c51/0x3d2d1916761d61e9 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x3d2d1916761d61f0 expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788869336.286483:0:5752:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000009d2408e1 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:121cd5bc-7f07-4cf7-8e2e-4356c89c0696:5752:1875765421412352:0@lo:501: 00000100:00100000:1.0:1788869336.286512:0:5752:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869336.286543:0:5752:0:(client.c:2702:ptlrpc_set_wait()) set 000000004d5ede52 going to sleep for 11 seconds 00000100:00100000:3.0:1788869336.286591:0:5749:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765421412352 00000100:00100000:3.0:1788869336.286595:0:5749:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765421412352 00000100:00100000:3.0:1788869336.286627:0:5749:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1788869336.286633:0:5749:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a4778f26 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:121cd5bc-7f07-4cf7-8e2e-4356c89c0696+12:5752:x1875765421412352:12345-0@lo:501: 00000100:00100000:3.0:1788869336.286890:0:5749:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a4778f26 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:121cd5bc-7f07-4cf7-8e2e-4356c89c0696+12:5752:x1875765421412352:12345-0@lo:501: Request processed in 258us (378us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869336.286897:0:5749:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1788869336.286967:0:5752:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000009d2408e1 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:121cd5bc-7f07-4cf7-8e2e-4356c89c0696:5752:1875765421412352:0@lo:501: 00000100:00100000:1.0:1788869336.286996:0:5752:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000009d2408e1 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:121cd5bc-7f07-4cf7-8e2e-4356c89c0696:5752:1875765421412480:0@lo:503: 00000100:00100000:1.0:1788869336.287031:0:5752:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869336.287050:0:5752:0:(client.c:2702:ptlrpc_set_wait()) set 000000004d5ede52 going to sleep for 11 seconds 00000100:00100000:3.0:1788869336.287108:0:5749:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765421412480 00000100:00100000:3.0:1788869336.287112:0:5749:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765421412480 00000100:00100000:3.0:1788869336.287174:0:5749:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1788869336.287179:0:5749:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c114a42f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:121cd5bc-7f07-4cf7-8e2e-4356c89c0696+12:5752:x1875765421412480:12345-0@lo:503: 00000100:00100000:3.0:1788869336.287320:0:5749:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c114a42f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:121cd5bc-7f07-4cf7-8e2e-4356c89c0696+12:5752:x1875765421412480:12345-0@lo:503: Request processed in 141us (289us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869336.287327:0:5749:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1788869336.287406:0:5752:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000009d2408e1 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:121cd5bc-7f07-4cf7-8e2e-4356c89c0696:5752:1875765421412480:0@lo:503: 00000100:00100000:1.0:1788869336.287572:0:6248:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000009d2408e1 pname:cluuid:pid:xid:nid:opc:job llog_process_th:121cd5bc-7f07-4cf7-8e2e-4356c89c0696:6248:1875765421412608:0@lo:502: 00000100:00100000:1.0:1788869336.287603:0:6248:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869336.287623:0:5748:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765421412608 00000100:00100000:1.0:1788869336.287627:0:5748:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765421412608 00000100:00100000:1.0:1788869336.287642:0:5748:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1788869336.287646:0:5748:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000075930b3a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:121cd5bc-7f07-4cf7-8e2e-4356c89c0696+12:6248:x1875765421412608:12345-0@lo:502: 00000100:00100000:1.0:1788869336.287777:0:5748:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000075930b3a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:121cd5bc-7f07-4cf7-8e2e-4356c89c0696+12:6248:x1875765421412608:12345-0@lo:502: Request processed in 130us (173us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869336.287784:0:5748:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1788869336.287816:0:6248:0:(client.c:2702:ptlrpc_set_wait()) set 00000000c0054c6e going to sleep for 11 seconds 00000100:00100000:1.0:1788869336.287828:0:6248:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000009d2408e1 pname:cluuid:pid:xid:nid:opc:job llog_process_th:121cd5bc-7f07-4cf7-8e2e-4356c89c0696:6248:1875765421412608:0@lo:502: 00000020:01000000:1.0:1788869336.287848:0:6248:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788869336.287856:0:6248:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788869336.287859:0:6248:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1788869336.287866:0:6248:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff94c805125000 00000020:00000080:1.0:1788869336.287869:0:6248:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1788869336.287907:0:6248:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94c81f1f2a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:121cd5bc-7f07-4cf7-8e2e-4356c89c0696:6248:1875765421412736:0@lo:502: 00000100:00100000:1.0:1788869336.287939:0:6248:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869336.287957:0:5748:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765421412736 00000100:00100000:1.0:1788869336.287967:0:5748:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765421412736 00000100:00100000:1.0:1788869336.287984:0:5748:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1788869336.287989:0:5748:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c81f0fc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:121cd5bc-7f07-4cf7-8e2e-4356c89c0696+12:6248:x1875765421412736:12345-0@lo:502: 00000100:00100000:1.0:1788869336.288065:0:5748:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c81f0fc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:121cd5bc-7f07-4cf7-8e2e-4356c89c0696+12:6248:x1875765421412736:12345-0@lo:502: Request processed in 74us (124us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869336.288071:0:5748:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1788869336.288097:0:6248:0:(client.c:2702:ptlrpc_set_wait()) set ffff94c804e5e600 going to sleep for 11 seconds 00000100:00100000:1.0:1788869336.288107:0:6248:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94c81f1f2a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:121cd5bc-7f07-4cf7-8e2e-4356c89c0696:6248:1875765421412736:0@lo:502: 00000020:01000000:1.0:1788869336.288121:0:6248:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788869336.288124:0:6248:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788869336.288126:0:6248:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:1.0:1788869336.288129:0:6248:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 00000020:01000000:1.0:1788869336.288171:0:5752:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:1.0:1788869336.288183:0:5752:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.139@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788869336.288191:0:5752:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.139@tcp lock: ffff94c8421f3c00/0x3d2d1916761d61e9 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3d2d1916761d61f0 expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869336.288200:0:5752:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.139@tcp lock: ffff94c8421f3c00/0x3d2d1916761d61e9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3d2d1916761d61f0 expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869336.479468:0:5742:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788869337.501129:0:5743:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788869338.524350:0:5742:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1788869339.237758:0:6543:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:1.0:1788869339.237765:0:6543:0:(obd_mount.c:926:lmd_print()) device: lustre-ost1/ost1 00000080:01200004:1.0:1788869339.237916:0:6543:0:(super25.c:130:lustre_fill_super()) VFS Op: sb ffff94c839dd4000 00000020:01000004:1.0:1788869339.237936:0:6543:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-OST0000, type=osd-zfs, lsifl=200062, mountfl=0 00000020:01000004:1.0:1788869339.237952:0:6543:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-zfs) 00000020:00000080:1.0:1788869339.237969:0:6543:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff94c81f1acd40) 00000020:00000080:1.0:1788869339.237994:0:6543:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osd-zfs with refcount 2 00100000:10000000:1.0:1788869339.259114:0:6543:0:(scrub.c:229:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00100000:10000000:1.0:1788869339.259471:0:6543:0:(scrub.c:229:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00100000:10000000:0.0:1788869339.274101:0:6543:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:0.0:1788869339.277456:0:6543:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:0.0:1788869339.277558:0:6543:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:0.0:1788869339.277621:0:6543:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:0.0:1788869339.277663:0:6543:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:0.0:1788869339.278142:0:6543:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:0.0:1788869339.278156:0:6543:0:(osd_handler.c:1569:osd_obd_connect()) connect #0 00000020:00000080:0.0:1788869339.278170:0:6543:0:(genops.c:1406:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x3d2d1916761d61fe 00000020:01000004:0.0:1788869339.278180:0:6543:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-OST0000 on device lustre-ost1/ost1 00000020:01000004:0.0:1788869339.278206:0:6543:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.201.139@tcp:Set MGC reconnect 1 10000000:01000000:0.0:1788869339.278210:0:6543:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.201.139@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:0.0:1788869339.278216:0:6543:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0000 00000020:01000004:0.0:1788869339.278221:0:6543:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:0.0:1788869339.278234:0:6543:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff94c808e019c0) 00000020:00000080:0.0:1788869339.278273:0:6543:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type ost with refcount 2 00000100:00100000:0.0:1788869339.280951:0:6543:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788869339.281128:0:6543:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:0.0:1788869339.281134:0:6543:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:1.0:1788869339.282150:0:6543:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:1.0:1788869339.282158:0:6543:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:1.0:1788869339.282561:0:6543:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:1.0:1788869339.282567:0:6543:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:1.0:1788869339.285621:0:6543:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788869339.285819:0:6543:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:1.0:1788869339.285825:0:6543:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:1.0:1788869339.288865:0:6543:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:1.0:1788869339.288879:0:6543:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:1.0:1788869339.304550:0:6543:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788869339.304854:0:6543:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:1.0:1788869339.304862:0:6543:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:1.0:1788869339.306844:0:6543:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:1.0:1788869339.306857:0:6543:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:1.0:1788869339.307413:0:6543:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:1.0:1788869339.307421:0:6543:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:1.0:1788869339.310013:0:6543:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788869339.310229:0:6543:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:1.0:1788869339.310243:0:6543:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:1.0:1788869339.310959:0:6543:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:1.0:1788869339.310967:0:6543:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:0.0:1788869339.342408:0:6543:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788869339.342661:0:6543:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:0.0:1788869339.342670:0:6543:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:0.0:1788869339.343772:0:6543:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:0.0:1788869339.343780:0:6543:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:1.0:1788869339.344230:0:6543:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:1.0:1788869339.344295:0:6543:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost1/ost1 10000000:01000000:1.0:1788869339.344303:0:6543:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.201.139@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:1.0:1788869339.363497:0:6543:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.201.139@tcp ctxt 0 is initialized 00000020:01000004:1.0:1788869339.363547:0:6543:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.201.139@tcp, index=0000, flags=0x20062 00000020:01000004:1.0:1788869339.363552:0:6543:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:1.0:1788869339.363554:0:6543:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1788869339.363555:0:6543:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788869339.363557:0:6543:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788869339.363558:0:6543:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788869339.363559:0:6543:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788869339.363561:0:6543:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788869339.363563:0:6543:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1788869339.363564:0:6543:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1788869339.363568:0:6543:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788869339.363569:0:6543:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1788869339.363574:0:6543:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020062 00000020:01000004:1.0:1788869339.363576:0:6543:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1788869339.363577:0:6543:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1788869339.363579:0:6543:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788869339.363580:0:6543:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788869339.363581:0:6543:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788869339.363582:0:6543:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788869339.363583:0:6543:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788869339.363584:0:6543:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1788869339.363585:0:6543:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1788869339.363586:0:6543:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788869339.363587:0:6543:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1788869339.363619:0:6543:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:1.0:1788869339.363641:0:6543:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94c81f1f2a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:121cd5bc-7f07-4cf7-8e2e-4356c89c0696:6543:1875765421412864:0@lo:253: 00000100:00100000:1.0:1788869339.363744:0:6543:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869339.363879:0:6543:0:(client.c:2702:ptlrpc_set_wait()) set ffff94c802f41c00 going to sleep for 11 seconds 00000100:00100000:2.0:1788869339.363963:0:5748:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765421412864 00000100:00100000:2.0:1788869339.363972:0:5748:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765421412864 00000100:00100000:2.0:1788869339.364077:0:5748:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1788869339.364086:0:5748:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c81f0fd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:121cd5bc-7f07-4cf7-8e2e-4356c89c0696+12:6543:x1875765421412864:12345-0@lo:253: 20000000:01000000:2.0:1788869339.364121:0:5748:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:2.0:1788869339.364126:0:5748:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0000, index=0 20000000:01000000:2.0:1788869339.364132:0:5748:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-OST0000 to 0 20000000:01000000:2.0:1788869339.364136:0:5748:0:(mgs_llog.c:3858:mgs_write_log_ost()) writing new ost lustre-OST0000 00000040:00080000:2.0:1788869339.364984:0:5748:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788869339.365186:0:5748:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 20000000:01000000:2.0:1788869339.365198:0:5748:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000 0xcf001 obdfilter lustre-OST0000_UUID (null) (null) 00000040:00080000:2.0:1788869339.365232:0:5748:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 128 off8544 20000000:01000000:2.0:1788869339.365239:0:5748:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000 0xcf003 dev type f (null) 00000040:00080000:2.0:1788869339.365288:0:5748:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 112 off8656 00000040:00080000:2.0:1788869339.365340:0:5748:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8880 00000040:00080000:2.0:1788869339.365836:0:5748:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 224 off11152 20000000:01000000:2.0:1788869339.365864:0:5748:0:(mgs_llog.c:3811:mgs_write_log_osc_to_lov()) add nid 192.168.201.139@tcp 20000000:01000000:2.0:1788869339.365866:0:5748:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.201.139@tcp (null) (null) (null) 00000040:00080000:2.0:1788869339.365900:0:5748:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 88 off11240 20000000:01000000:2.0:1788869339.365909:0:5748:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:2.0:1788869339.365974:0:5748:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 144 off11384 20000000:01000000:2.0:1788869339.365983:0:5748:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf003 lustre-OST0000_UUID 192.168.201.139@tcp (null) (null) 00000040:00080000:2.0:1788869339.366013:0:5748:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 152 off11536 20000000:01000000:2.0:1788869339.366021:0:5748:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:2.0:1788869339.366046:0:5748:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 136 off11672 00000040:00080000:2.0:1788869339.366086:0:5748:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11896 00000040:00080000:2.0:1788869339.367045:0:5748:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].21, 224 off11952 20000000:01000000:2.0:1788869339.367063:0:5748:0:(mgs_llog.c:3811:mgs_write_log_osc_to_lov()) add nid 192.168.201.139@tcp 20000000:01000000:2.0:1788869339.367065:0:5748:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.201.139@tcp (null) (null) (null) 00000040:00080000:2.0:1788869339.367094:0:5748:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].22, 88 off12040 20000000:01000000:2.0:1788869339.367100:0:5748:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:2.0:1788869339.367128:0:5748:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].23, 128 off12168 20000000:01000000:2.0:1788869339.367135:0:5748:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc 0xcf003 lustre-OST0000_UUID 192.168.201.139@tcp (null) (null) 00000040:00080000:2.0:1788869339.367177:0:5748:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].24, 144 off12312 20000000:01000000:2.0:1788869339.367185:0:5748:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:2.0:1788869339.367212:0:5748:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].25, 128 off12440 00000040:00080000:2.0:1788869339.367240:0:5748:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].26, 224 off12664 20000000:01000000:2.0:1788869339.367522:0:5748:0:(mgs_llog.c:5248:mgs_write_log_target()) remaining string: ' autodegrade=on ', param: 'sys.timeout=20' 20000000:01000000:2.0:1788869339.367525:0:5748:0:(mgs_llog.c:4744:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:2.0:1788869339.367530:0:5748:0:(mgs_llog.c:4177:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:2.0:1788869339.367544:0:5748:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:2.0:1788869339.367547:0:5748:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:2.0:1788869339.367586:0:5748:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:2.0:1788869339.367588:0:5748:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:1.0:1788869339.368086:0:6557:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 18 marker 8 1->4: lustre sys.timeout 20000000:01000000:1.0:1788869339.368140:0:6557:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 20 marker 8 2->4: lustre sys.timeout 00000040:00080000:1.0:1788869339.368176:0:6557:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 27 count 27 00000040:00080000:2.0:1788869339.368473:0:5748:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].27, 224 off12888 00000040:00080000:2.0:1788869339.368504:0:5748:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].28, 80 off12968 00000040:00080000:2.0:1788869339.368561:0:5748:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].29, 224 off13192 20000000:01000000:2.0:1788869339.368572:0:5748:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:2.0:1788869339.368574:0:5748:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:1.0:1788869339.368984:0:6558:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 10 marker 9 1->4: lustre sys.timeout 20000000:01000000:1.0:1788869339.369022:0:6558:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 12 marker 9 2->4: lustre sys.timeout 00000040:00080000:1.0:1788869339.369064:0:6558:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 22 count 22 00000040:00080000:2.0:1788869339.369396:0:5748:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 224 off12120 00000040:00080000:2.0:1788869339.369432:0:5748:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 80 off12200 00000040:00080000:2.0:1788869339.369477:0:5748:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 224 off12424 20000000:01000000:2.0:1788869339.369488:0:5748:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:2.0:1788869339.369490:0:5748:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 00000040:00080000:1.0:1788869339.369814:0:6559:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 5 count 5 00000040:00080000:2.0:1788869339.369977:0:5748:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 224 off9104 00000040:00080000:2.0:1788869339.370003:0:5748:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 80 off9184 00000040:00080000:2.0:1788869339.370044:0:5748:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9408 20000000:01000000:2.0:1788869339.370057:0:5748:0:(mgs_llog.c:5248:mgs_write_log_target()) remaining string: ' ', param: 'autodegrade=on' 20000000:01000000:2.0:1788869339.370059:0:5748:0:(mgs_llog.c:4744:mgs_write_log_param()) next param 'autodegrade=on' 10000000:01000000:2.0:1788869339.370070:0:5748:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:2.0:1788869339.370093:0:5748:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff94c80153ac00/0x3d2d1916761d620c lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869339.370114:0:5748:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff94c80153ba00/0x3d2d1916761d6125 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3d2d1916761d611e expref: 12 pid: 5749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869339.370121:0:5748:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff94c81a583800/0x3d2d1916761d6141 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3d2d1916761d613a expref: 12 pid: 5750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869339.370127:0:5748:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff94c81a583400/0x3d2d1916761d61b1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3d2d1916761d61aa expref: 12 pid: 5750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869339.370134:0:5748:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff94c80153ac00/0x3d2d1916761d620c lrc: 6/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869339.370178:0:5748:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff94c81a583400/0x3d2d1916761d61b1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x3d2d1916761d61aa expref: 12 pid: 5750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869339.370193:0:5748:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff94c81a583400/0x3d2d1916761d61b1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x3d2d1916761d61aa expref: 12 pid: 5750 timeout: 237 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788869339.370218:0:5748:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94c803fb9880 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5748:1875765421412992:0@lo:104: 00000100:00100000:2.0:1788869339.370395:0:5748:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788869339.370494:0:5748:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff94c81a583800/0x3d2d1916761d6141 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x3d2d1916761d613a expref: 12 pid: 5750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869339.370502:0:5748:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff94c81a583800/0x3d2d1916761d6141 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x3d2d1916761d613a expref: 12 pid: 5750 timeout: 237 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788869339.370509:0:5748:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94c803fb8380 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5748:1875765421413120:0@lo:104: 00000100:00100000:2.0:1788869339.370526:0:5748:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788869339.370618:0:5748:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff94c80153ba00/0x3d2d1916761d6125 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x3d2d1916761d611e expref: 12 pid: 5749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869339.370625:0:5748:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff94c80153ba00/0x3d2d1916761d6125 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x3d2d1916761d611e expref: 12 pid: 5749 timeout: 237 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788869339.370632:0:5748:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94c803fbb480 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5748:1875765421413248:0@lo:104: 00000100:00100000:2.0:1788869339.370661:0:5748:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869339.370711:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765421412992 00000100:00100000:0.0:1788869339.370719:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765421412992 00000100:00100000:0.0:1788869339.370772:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765421413120 00000100:00100000:0.0:1788869339.370774:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765421413120 00000100:00100000:0.0:1788869339.370787:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788869339.370795:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c803fbbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:121cd5bc-7f07-4cf7-8e2e-4356c89c0696+4:5748:x1875765421412992:12345-0@lo:104: 00010000:00010000:0.0:1788869339.370809:0:5787:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.139@tcp lock: ffff94c8421f2200/0x3d2d1916761d61aa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x3d2d1916761d61b1 expref: -99 pid: 5735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869339.370864:0:5787:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788869339.370869:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c803fbbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:121cd5bc-7f07-4cf7-8e2e-4356c89c0696+4:5748:x1875765421412992:12345-0@lo:104: Request processed in 75us (475us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869339.370875:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788869339.370889:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788869339.370894:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c803fb8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:121cd5bc-7f07-4cf7-8e2e-4356c89c0696+3:5748:x1875765421413120:12345-0@lo:104: 00010000:00010000:0.0:1788869339.370900:0:5787:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.139@tcp lock: ffff94c818d1e400/0x3d2d1916761d613a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x3d2d1916761d6141 expref: -99 pid: 5735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869339.370922:0:5787:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1788869339.370926:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c803fb8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:121cd5bc-7f07-4cf7-8e2e-4356c89c0696+3:5748:x1875765421413120:12345-0@lo:104: Request processed in 33us (400us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869339.370941:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00010000:0.0:1788869339.370957:0:5743:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788869339.370962:0:5743:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.139@tcp lock: ffff94c8421f2200/0x3d2d1916761d61aa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x3d2d1916761d61b1 expref: -99 pid: 5735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869339.370969:0:5743:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94c8421f2200 already unused, calling callback (ffffffffc1ce9c20) 10000000:00010000:0.0:1788869339.370973:0:5743:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.139@tcp lock: ffff94c8421f2200/0x3d2d1916761d61aa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x3d2d1916761d61b1 expref: -99 pid: 5735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869339.370980:0:5743:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.139@tcp lock: ffff94c8421f2200/0x3d2d1916761d61aa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x3d2d1916761d61b1 expref: -99 pid: 5735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788869339.370986:0:5743:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.139@tcp lock: ffff94c8421f2200/0x3d2d1916761d61aa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x3d2d1916761d61b1 expref: -99 pid: 5735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788869339.370991:0:5743:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788869339.371019:0:5743:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.139@tcp lock: ffff94c8421f2200/0x3d2d1916761d61aa lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3d2d1916761d61b1 expref: -99 pid: 5735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869339.371025:0:5743:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788869339.371041:0:5743:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.139@tcp lock: ffff94c8421f2200/0x3d2d1916761d61aa lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3d2d1916761d61b1 expref: -99 pid: 5735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869339.371047:0:5743:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.139@tcp lock: ffff94c8421f2200/0x3d2d1916761d61aa lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3d2d1916761d61b1 expref: -99 pid: 5735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869339.371059:0:5743:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788869339.371061:0:5743:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.139@tcp lock: ffff94c818d1e400/0x3d2d1916761d613a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x3d2d1916761d6141 expref: -99 pid: 5735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869339.371075:0:5743:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94c818d1e400 already unused, calling callback (ffffffffc1ce9c20) 10000000:00010000:0.0:1788869339.371078:0:5743:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.139@tcp lock: ffff94c818d1e400/0x3d2d1916761d613a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x3d2d1916761d6141 expref: -99 pid: 5735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869339.371083:0:5743:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.139@tcp lock: ffff94c818d1e400/0x3d2d1916761d613a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x3d2d1916761d6141 expref: -99 pid: 5735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788869339.371088:0:5743:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.139@tcp lock: ffff94c818d1e400/0x3d2d1916761d613a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x3d2d1916761d6141 expref: -99 pid: 5735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788869339.371092:0:5743:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788869339.371102:0:5743:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.139@tcp lock: ffff94c818d1e400/0x3d2d1916761d613a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3d2d1916761d6141 expref: -99 pid: 5735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869339.371107:0:5743:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788869339.371111:0:5743:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.139@tcp lock: ffff94c818d1e400/0x3d2d1916761d613a lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3d2d1916761d6141 expref: -99 pid: 5735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869339.371116:0:5743:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.139@tcp lock: ffff94c818d1e400/0x3d2d1916761d613a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3d2d1916761d6141 expref: -99 pid: 5735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869339.371124:0:5743:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788869339.371126:0:5743:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788869339.371127:0:5743:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788869339.371133:0:5742:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788869339.371152:0:3283:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94c8349ed180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:121cd5bc-7f07-4cf7-8e2e-4356c89c0696:3283:1875765421413376:0@lo:103: 00000100:00100000:0.0:1788869339.371178:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869339.371199:0:3283:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788869339.371203:0:3283:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94c8349ece00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:121cd5bc-7f07-4cf7-8e2e-4356c89c0696:3283:1875765421413504:0@lo:103: 00000100:00100000:0.0:1788869339.371227:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869339.371279:0:5740:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765421413376 00000100:00100000:0.0:1788869339.371282:0:5740:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765421413376 00010000:00010000:0.0:1788869339.371299:0:5740:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff94c81a583400/0x3d2d1916761d61b1 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3d2d1916761d61aa expref: 13 pid: 5750 timeout: 237 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788869339.371318:0:5740:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765421413504 00000100:00100000:0.0:1788869339.371320:0:5740:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765421413504 00010000:00010000:0.0:1788869339.371327:0:5740:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff94c81a583800/0x3d2d1916761d6141 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3d2d1916761d613a expref: 14 pid: 5750 timeout: 237 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788869339.371340:0:5740:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788869339.371344:0:5740:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c8349edf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:121cd5bc-7f07-4cf7-8e2e-4356c89c0696+14:3283:x1875765421413376:12345-0@lo:103: 00010000:00010000:0.0:1788869339.371353:0:5740:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788869339.371357:0:5740:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff94c81a583400/0x3d2d1916761d61b1 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3d2d1916761d61aa expref: 14 pid: 5750 timeout: 237 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869339.371366:0:5740:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff94c81a583400/0x3d2d1916761d61b1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x3d2d1916761d61aa expref: 14 pid: 5750 timeout: 237 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869339.371381:0:5740:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788869339.371401:0:5740:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c8349edf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:121cd5bc-7f07-4cf7-8e2e-4356c89c0696+14:3283:x1875765421413376:12345-0@lo:103: Request processed in 57us (222us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869339.371406:0:5740:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788869339.371414:0:5740:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788869339.371419:0:5740:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c8349ee680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:121cd5bc-7f07-4cf7-8e2e-4356c89c0696+13:3283:x1875765421413504:12345-0@lo:103: 00010000:00010000:0.0:1788869339.371424:0:5740:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788869339.371428:0:5740:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff94c81a583800/0x3d2d1916761d6141 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3d2d1916761d613a expref: 13 pid: 5750 timeout: 237 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869339.371445:0:5740:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff94c81a583800/0x3d2d1916761d6141 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x3d2d1916761d613a expref: 13 pid: 5750 timeout: 237 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869339.371453:0:5740:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788869339.371469:0:5740:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c8349ee680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:121cd5bc-7f07-4cf7-8e2e-4356c89c0696+13:3283:x1875765421413504:12345-0@lo:103: Request processed in 51us (242us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869339.371474:0:5740:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788869339.371509:0:3283:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94c8349ece00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:121cd5bc-7f07-4cf7-8e2e-4356c89c0696:3283:1875765421413504:0@lo:103: 00000100:00100000:0.0:1788869339.371518:0:3283:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94c8349ed180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:121cd5bc-7f07-4cf7-8e2e-4356c89c0696:3283:1875765421413376:0@lo:103: 00000100:00100000:2.0:1788869339.371727:0:5748:0:(client.c:2702:ptlrpc_set_wait()) set ffff94c822e22cc0 going to sleep for 11 seconds 00010000:00010000:2.0:1788869339.371740:0:5748:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff94c81a583400/0x3d2d1916761d61b1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x3d2d1916761d61aa expref: 12 pid: 5750 timeout: 237 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788869339.371750:0:5748:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94c803fb9880 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5748:1875765421412992:0@lo:104: 00010000:00010000:2.0:1788869339.371756:0:5748:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff94c81a583800/0x3d2d1916761d6141 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x3d2d1916761d613a expref: 11 pid: 5750 timeout: 237 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788869339.371764:0:5748:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94c803fb8380 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5748:1875765421413120:0@lo:104: 00000100:00100000:0.0:1788869339.371801:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765421413248 00000100:00100000:0.0:1788869339.371806:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765421413248 00000100:00100000:0.0:1788869339.371853:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788869339.371859:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c803fb9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:121cd5bc-7f07-4cf7-8e2e-4356c89c0696+3:5748:x1875765421413248:12345-0@lo:104: 00010000:00010000:0.0:1788869339.371867:0:5787:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.139@tcp lock: ffff94c818d1ec00/0x3d2d1916761d611e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x3d2d1916761d6125 expref: -99 pid: 5735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869339.371909:0:5787:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788869339.371913:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c803fb9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:121cd5bc-7f07-4cf7-8e2e-4356c89c0696+3:5748:x1875765421413248:12345-0@lo:104: Request processed in 55us (1252us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869339.371918:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788869339.371967:0:5748:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94c803fbb480 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5748:1875765421413248:0@lo:104: 00010000:00010000:2.0:1788869339.371993:0:5748:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff94c80153ac00/0x3d2d1916761d620c lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869339.372040:0:5743:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788869339.372045:0:5743:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.139@tcp lock: ffff94c818d1ec00/0x3d2d1916761d611e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x3d2d1916761d6125 expref: -99 pid: 5735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869339.372051:0:5743:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94c818d1ec00 already unused, calling callback (ffffffffc1ce9c20) 10000000:00010000:0.0:1788869339.372055:0:5743:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.139@tcp lock: ffff94c818d1ec00/0x3d2d1916761d611e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x3d2d1916761d6125 expref: -99 pid: 5735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869339.372066:0:5743:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.139@tcp lock: ffff94c818d1ec00/0x3d2d1916761d611e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x3d2d1916761d6125 expref: -99 pid: 5735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788869339.372072:0:5743:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.139@tcp lock: ffff94c818d1ec00/0x3d2d1916761d611e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x3d2d1916761d6125 expref: -99 pid: 5735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788869339.372076:0:5743:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788869339.372126:0:5743:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.139@tcp lock: ffff94c818d1ec00/0x3d2d1916761d611e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3d2d1916761d6125 expref: -99 pid: 5735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869339.372132:0:5743:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788869339.372154:0:5743:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.139@tcp lock: ffff94c818d1ec00/0x3d2d1916761d611e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3d2d1916761d6125 expref: -99 pid: 5735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869339.372161:0:5743:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.139@tcp lock: ffff94c818d1ec00/0x3d2d1916761d611e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3d2d1916761d6125 expref: -99 pid: 5735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869339.372173:0:5743:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788869339.372175:0:5743:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788869339.372176:0:5743:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788869339.372217:0:3285:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94c8349ed180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:121cd5bc-7f07-4cf7-8e2e-4356c89c0696:3285:1875765421413632:0@lo:103: 00000100:00100000:2.0:1788869339.372244:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869339.372325:0:5740:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765421413632 00000100:00100000:0.0:1788869339.372329:0:5740:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765421413632 00010000:00010000:0.0:1788869339.372343:0:5740:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff94c80153ba00/0x3d2d1916761d6125 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3d2d1916761d611e expref: 11 pid: 5749 timeout: 237 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788869339.372366:0:5740:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788869339.372371:0:5740:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c803fbb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:121cd5bc-7f07-4cf7-8e2e-4356c89c0696+11:3285:x1875765421413632:12345-0@lo:103: 00010000:00010000:0.0:1788869339.372377:0:5740:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788869339.372381:0:5740:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff94c80153ba00/0x3d2d1916761d6125 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3d2d1916761d611e expref: 11 pid: 5749 timeout: 237 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869339.372395:0:5740:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff94c80153ba00/0x3d2d1916761d6125 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x3d2d1916761d611e expref: 11 pid: 5749 timeout: 237 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869339.372406:0:5740:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff94c80153ba00/0x3d2d1916761d6125 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x3d2d1916761d611e expref: 11 pid: 5749 timeout: 237 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869339.372417:0:5740:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff94c80153ac00/0x3d2d1916761d620c lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869339.372425:0:5740:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff94c80153ac00/0x3d2d1916761d620c lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869339.372438:0:5740:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff94c80153ac00/0x3d2d1916761d620c lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869339.372444:0:5740:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff94c80153ac00/0x3d2d1916761d620c lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869339.372450:0:5740:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff94c80153ac00/0x3d2d1916761d620c lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869339.372455:0:5740:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff94c80153ac00/0x3d2d1916761d620c lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869339.372459:0:5740:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94c80153ac00 already unused, calling callback (ffffffffc1703220) 00010000:00010000:0.0:1788869339.372463:0:5740:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff94c80153ac00/0x3d2d1916761d620c lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869339.372468:0:5740:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff94c80153ac00/0x3d2d1916761d620c lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869339.372488:0:5740:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff94c80153ac00/0x3d2d1916761d620c lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869339.372495:0:5740:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788869339.372517:0:5740:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c803fbb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:121cd5bc-7f07-4cf7-8e2e-4356c89c0696+10:3285:x1875765421413632:12345-0@lo:103: Request processed in 147us (273us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869339.372524:0:5740:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788869339.372542:0:3285:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94c8349ed180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:121cd5bc-7f07-4cf7-8e2e-4356c89c0696:3285:1875765421413632:0@lo:103: 00010000:00010000:0.0:1788869339.372553:0:5748:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff94c80153ac00/0x3d2d1916761d620c lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869339.372559:0:5748:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff94c80153ac00/0x3d2d1916761d620c lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869339.372564:0:5748:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff94c80153ac00/0x3d2d1916761d620c lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1788869339.372576:0:5748:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:1.0:1788869339.405627:0:5748:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c81f0fd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:121cd5bc-7f07-4cf7-8e2e-4356c89c0696+9:6543:x1875765421412864:12345-0@lo:253: Request processed in 41524us (41866us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869339.405657:0:5748:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1788869339.405761:0:6543:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94c81f1f2a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:121cd5bc-7f07-4cf7-8e2e-4356c89c0696:6543:1875765421412864:0@lo:253: 10000000:01000000:0.0:1788869339.405780:0:6543:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:0.0:1788869339.405783:0:6543:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1788869339.405785:0:6543:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1788869339.405787:0:6543:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788869339.405788:0:6543:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0000_UUID 00000020:01000004:0.0:1788869339.405790:0:6543:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788869339.405791:0:6543:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788869339.405793:0:6543:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788869339.405794:0:6543:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:0.0:1788869339.405796:0:6543:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788869339.405797:0:6543:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1788869339.405836:0:6543:0:(tgt_mount.c:101:server_register_mount()) register mount ffff94c839dd4000 from lustre-OST0000 10000000:01000000:0.0:1788869339.405870:0:6543:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:0.0:1788869339.405873:0:6543:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:0.0:1788869339.405882:0:6543:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff94c81f1a99c0 local copy 10000000:01000000:0.0:1788869339.405887:0:6543:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1788869339.405936:0:6543:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.139@tcp lock: ffff94c818d1ec00/0x3d2d1916761d6213 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6543 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869339.405949:0:6543:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.201.139@tcp lock: ffff94c818d1ec00/0x3d2d1916761d6213 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6543 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869339.405960:0:6543:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.139@tcp lock: ffff94c818d1ec00/0x3d2d1916761d6213 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6543 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788869339.405981:0:6543:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94c8349ed180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:121cd5bc-7f07-4cf7-8e2e-4356c89c0696:6543:1875765421413760:0@lo:101: 00000100:00100000:0.0:1788869339.406023:0:6543:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869339.406127:0:6543:0:(client.c:2702:ptlrpc_set_wait()) set ffff94c8191dc9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788869339.406224:0:5750:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765421413760 00000100:00100000:2.0:1788869339.406232:0:5750:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765421413760 00000100:00100000:2.0:1788869339.406369:0:5750:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1788869339.406379:0:5750:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c81f0fe050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:121cd5bc-7f07-4cf7-8e2e-4356c89c0696+9:6543:x1875765421413760:12345-0@lo:101: 00010000:00010000:2.0:1788869339.406394:0:5750:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788869339.406410:0:5750:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff94c80153ac00/0x3d2d1916761d621a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x3d2d1916761d6213 expref: -99 pid: 5750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869339.406435:0:5750:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff94c80153ac00/0x3d2d1916761d621a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3d2d1916761d6213 expref: 10 pid: 5750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869339.406446:0:5750:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff94c80153ac00/0x3d2d1916761d621a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3d2d1916761d6213 expref: 10 pid: 5750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869339.406457:0:5750:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94c80153ac00, rc 0) 00000100:00100000:2.0:1788869339.406582:0:5750:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c81f0fe050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:121cd5bc-7f07-4cf7-8e2e-4356c89c0696+10:6543:x1875765421413760:12345-0@lo:101: Request processed in 204us (558us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869339.406589:0:5750:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1788869339.406666:0:6543:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94c8349ed180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:121cd5bc-7f07-4cf7-8e2e-4356c89c0696:6543:1875765421413760:0@lo:101: 00010000:00010000:0.0:1788869339.406679:0:6543:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.139@tcp lock: ffff94c818d1ec00/0x3d2d1916761d6213 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x3d2d1916761d621a expref: -99 pid: 6543 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869339.406689:0:6543:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.139@tcp lock: ffff94c818d1ec00/0x3d2d1916761d6213 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x3d2d1916761d621a expref: -99 pid: 6543 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788869339.406811:0:6543:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94c8349ed180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:121cd5bc-7f07-4cf7-8e2e-4356c89c0696:6543:1875765421413888:0@lo:501: 00000100:00100000:0.0:1788869339.406835:0:6543:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869339.406896:0:6543:0:(client.c:2702:ptlrpc_set_wait()) set ffff94c8191dc9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788869339.406930:0:5750:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765421413888 00000100:00100000:2.0:1788869339.406934:0:5750:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765421413888 00000100:00100000:2.0:1788869339.406988:0:5750:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1788869339.406995:0:5750:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c81f0ffc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:121cd5bc-7f07-4cf7-8e2e-4356c89c0696+10:6543:x1875765421413888:12345-0@lo:501: 00000100:00100000:2.0:1788869339.407222:0:5750:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c81f0ffc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:121cd5bc-7f07-4cf7-8e2e-4356c89c0696+10:6543:x1875765421413888:12345-0@lo:501: Request processed in 226us (385us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788869339.407239:0:5750:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1788869339.407330:0:6543:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94c8349ed180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:121cd5bc-7f07-4cf7-8e2e-4356c89c0696:6543:1875765421413888:0@lo:501: 10000000:01000000:0.0:1788869339.407344:0:6543:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.201.139@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:0.0:1788869339.407381:0:6543:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.201.139@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:0.0:1788869339.407388:0:6543:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.139@tcp lock: ffff94c818d1ec00/0x3d2d1916761d6213 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x3d2d1916761d621a expref: -99 pid: 6543 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869339.407397:0:6543:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.139@tcp lock: ffff94c818d1ec00/0x3d2d1916761d6213 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x3d2d1916761d621a expref: -99 pid: 6543 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869339.407405:0:6543:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.139@tcp lock: ffff94c818d1ec00/0x3d2d1916761d6213 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x3d2d1916761d621a expref: -99 pid: 6543 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869339.407429:0:6543:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1788869339.407453:0:6543:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff94c839dd4000 10000000:01000000:0.0:1788869339.407459:0:6543:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:0.0:1788869339.407464:0:6543:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff94c81f1a99c0 10000000:01000000:0.0:1788869339.407467:0:6543:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:0.0:1788869339.407471:0:6543:0:(mgc_request.c:1801:mgc_process_log()) Process log nodemap-ffff94c81f1a99c0 from 1 10000000:01000000:0.0:1788869339.407474:0:6543:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:0.0:1788869339.407507:0:6543:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.139@tcp lock: ffff94c818d1e400/0x3d2d1916761d6221 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6543 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869339.407515:0:6543:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.139@tcp lock: ffff94c818d1e400/0x3d2d1916761d6221 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6543 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869339.407525:0:6543:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.139@tcp lock: ffff94c818d1e400/0x3d2d1916761d6221 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6543 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788869339.407539:0:6543:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94c8349ed180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:121cd5bc-7f07-4cf7-8e2e-4356c89c0696:6543:1875765421414016:0@lo:101: 00000100:00100000:0.0:1788869339.407570:0:6543:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869339.407777:0:6543:0:(client.c:2702:ptlrpc_set_wait()) set ffff94c8191dcc00 going to sleep for 11 seconds 00010000:00010000:0.0:1788869339.407791:0:5742:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788869339.407803:0:5742:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.139@tcp lock: ffff94c818d1ec00/0x3d2d1916761d6213 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x400000000 nid: local remote: 0x3d2d1916761d621a expref: -99 pid: 6543 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869339.407812:0:5742:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94c818d1ec00 already unused, calling callback (ffffffffc1ce9c20) 10000000:00010000:0.0:1788869339.407817:0:5742:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.139@tcp lock: ffff94c818d1ec00/0x3d2d1916761d6213 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x400000000 nid: local remote: 0x3d2d1916761d621a expref: -99 pid: 6543 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869339.407827:0:5742:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.139@tcp lock: ffff94c818d1ec00/0x3d2d1916761d6213 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x8400000000 nid: local remote: 0x3d2d1916761d621a expref: -99 pid: 6543 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788869339.407835:0:5742:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.139@tcp lock: ffff94c818d1ec00/0x3d2d1916761d6213 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x9400000000 nid: local remote: 0x3d2d1916761d621a expref: -99 pid: 6543 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788869339.407841:0:5742:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788869339.407859:0:5742:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.139@tcp lock: ffff94c818d1ec00/0x3d2d1916761d6213 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0x3d2d1916761d621a expref: -99 pid: 6543 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869339.407866:0:5742:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788869339.407887:0:5742:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.139@tcp lock: ffff94c818d1ec00/0x3d2d1916761d6213 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0x3d2d1916761d621a expref: -99 pid: 6543 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869339.407895:0:5742:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.139@tcp lock: ffff94c818d1ec00/0x3d2d1916761d6213 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0x3d2d1916761d621a expref: -99 pid: 6543 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869339.407910:0:5742:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788869339.407911:0:5742:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788869339.407913:0:5742:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788869339.407923:0:3286:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94c8349ece00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:121cd5bc-7f07-4cf7-8e2e-4356c89c0696:3286:1875765421414144:0@lo:103: 00000100:00100000:0.0:1788869339.407951:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869339.407983:0:5741:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765421414144 00000100:00100000:0.0:1788869339.407987:0:5741:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765421414144 00000100:00100000:0.0:1788869339.408026:0:5741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788869339.408033:0:5741:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c8349eea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:121cd5bc-7f07-4cf7-8e2e-4356c89c0696+10:3286:x1875765421414144:12345-0@lo:103: 00010000:00010000:0.0:1788869339.408042:0:5741:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788869339.408057:0:5741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff94c80153ac00/0x3d2d1916761d621a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x3d2d1916761d6213 expref: 10 pid: 5750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869339.408071:0:5741:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788869339.408096:0:5741:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c8349eea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:121cd5bc-7f07-4cf7-8e2e-4356c89c0696+9:3286:x1875765421414144:12345-0@lo:103: Request processed in 63us (144us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869339.408103:0:5741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788869339.408129:0:3286:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94c8349ece00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:121cd5bc-7f07-4cf7-8e2e-4356c89c0696:3286:1875765421414144:0@lo:103: 00000100:00100000:3.0:1788869339.408177:0:5749:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765421414016 00000100:00100000:3.0:1788869339.408181:0:5749:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765421414016 00000100:00100000:3.0:1788869339.408202:0:5749:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1788869339.408208:0:5749:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c81f0fe450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:121cd5bc-7f07-4cf7-8e2e-4356c89c0696+9:6543:x1875765421414016:12345-0@lo:101: 00010000:00010000:3.0:1788869339.408224:0:5749:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788869339.408235:0:5749:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff94c81a583600/0x3d2d1916761d6228 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x3d2d1916761d6221 expref: -99 pid: 5749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869339.408276:0:5749:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff94c81a583600/0x3d2d1916761d6228 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3d2d1916761d6221 expref: 10 pid: 5749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869339.408287:0:5749:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff94c81a583600/0x3d2d1916761d6228 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3d2d1916761d6221 expref: 10 pid: 5749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869339.408294:0:5749:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94c81a583600, rc 0) 00000100:00100000:3.0:1788869339.408327:0:5749:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c81f0fe450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:121cd5bc-7f07-4cf7-8e2e-4356c89c0696+10:6543:x1875765421414016:12345-0@lo:101: Request processed in 119us (757us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869339.408333:0:5749:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1788869339.408428:0:6543:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94c8349ed180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:121cd5bc-7f07-4cf7-8e2e-4356c89c0696:6543:1875765421414016:0@lo:101: 00010000:00010000:0.0:1788869339.408438:0:6543:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.139@tcp lock: ffff94c818d1e400/0x3d2d1916761d6221 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3d2d1916761d6228 expref: -99 pid: 6543 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869339.408447:0:6543:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.139@tcp lock: ffff94c818d1e400/0x3d2d1916761d6221 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x3d2d1916761d6228 expref: -99 pid: 6543 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788869339.408461:0:6543:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.139@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:0.0:1788869339.408476:0:6543:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.139@tcp lock: ffff94c818d1e400/0x3d2d1916761d6221 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3d2d1916761d6228 expref: -99 pid: 6543 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869339.408484:0:6543:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.139@tcp lock: ffff94c818d1e400/0x3d2d1916761d6221 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3d2d1916761d6228 expref: -99 pid: 6543 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788869339.408595:0:6543:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:0.0:1788869339.408599:0:6543:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1788869339.408604:0:6543:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:0.0:1788869339.408612:0:6543:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:0.0:1788869339.408626:0:6543:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.139@tcp lock: ffff94c818d1fc00/0x3d2d1916761d622f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6543 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869339.408634:0:6543:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.139@tcp lock: ffff94c818d1fc00/0x3d2d1916761d622f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6543 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869339.408642:0:6543:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.139@tcp lock: ffff94c818d1fc00/0x3d2d1916761d622f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6543 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788869339.408664:0:6543:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94c8349ed180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:121cd5bc-7f07-4cf7-8e2e-4356c89c0696:6543:1875765421414272:0@lo:101: 00000100:00100000:0.0:1788869339.408688:0:6543:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869339.408713:0:6543:0:(client.c:2702:ptlrpc_set_wait()) set ffff94c8191dcc00 going to sleep for 11 seconds 00000100:00100000:3.0:1788869339.408754:0:5749:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765421414272 00000100:00100000:3.0:1788869339.408758:0:5749:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765421414272 00000100:00100000:3.0:1788869339.408774:0:5749:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1788869339.408779:0:5749:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c81f0fec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:121cd5bc-7f07-4cf7-8e2e-4356c89c0696+10:6543:x1875765421414272:12345-0@lo:101: 00010000:00010000:3.0:1788869339.408785:0:5749:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788869339.408793:0:5749:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff94c81a583000/0x3d2d1916761d6236 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x3d2d1916761d622f expref: -99 pid: 5749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869339.408805:0:5749:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff94c81a583000/0x3d2d1916761d6236 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3d2d1916761d622f expref: 11 pid: 5749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869339.408813:0:5749:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff94c81a583000/0x3d2d1916761d6236 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3d2d1916761d622f expref: 11 pid: 5749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869339.408820:0:5749:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94c81a583000, rc 0) 00000100:00100000:3.0:1788869339.408857:0:5749:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c81f0fec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:121cd5bc-7f07-4cf7-8e2e-4356c89c0696+11:6543:x1875765421414272:12345-0@lo:101: Request processed in 77us (168us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869339.408863:0:5749:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1788869339.408935:0:6543:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94c8349ed180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:121cd5bc-7f07-4cf7-8e2e-4356c89c0696:6543:1875765421414272:0@lo:101: 00010000:00010000:0.0:1788869339.408947:0:6543:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.139@tcp lock: ffff94c818d1fc00/0x3d2d1916761d622f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3d2d1916761d6236 expref: -99 pid: 6543 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869339.408956:0:6543:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.139@tcp lock: ffff94c818d1fc00/0x3d2d1916761d622f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x3d2d1916761d6236 expref: -99 pid: 6543 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788869339.409035:0:6543:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94c8349ed180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:121cd5bc-7f07-4cf7-8e2e-4356c89c0696:6543:1875765421414400:0@lo:501: 00000100:00100000:0.0:1788869339.409063:0:6543:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869339.409087:0:6543:0:(client.c:2702:ptlrpc_set_wait()) set ffff94c8191dcc00 going to sleep for 11 seconds 00000100:00100000:3.0:1788869339.409137:0:5749:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765421414400 00000100:00100000:3.0:1788869339.409142:0:5749:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765421414400 00000100:00100000:3.0:1788869339.409160:0:5749:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1788869339.409167:0:5749:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c81f0ff450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:121cd5bc-7f07-4cf7-8e2e-4356c89c0696+11:6543:x1875765421414400:12345-0@lo:501: 00000100:00100000:3.0:1788869339.409451:0:5749:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c81f0ff450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:121cd5bc-7f07-4cf7-8e2e-4356c89c0696+11:6543:x1875765421414400:12345-0@lo:501: Request processed in 283us (385us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869339.409458:0:5749:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1788869339.409676:0:6543:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94c8349ed180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:121cd5bc-7f07-4cf7-8e2e-4356c89c0696:6543:1875765421414400:0@lo:501: 00000100:00100000:0.0:1788869339.409703:0:6543:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94c8349ed180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:121cd5bc-7f07-4cf7-8e2e-4356c89c0696:6543:1875765421414528:0@lo:503: 00000100:00100000:0.0:1788869339.409741:0:6543:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869339.409770:0:6543:0:(client.c:2702:ptlrpc_set_wait()) set ffff94c8191dcc00 going to sleep for 11 seconds 00000100:00100000:3.0:1788869339.409811:0:5749:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765421414528 00000100:00100000:3.0:1788869339.409816:0:5749:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765421414528 00000100:00100000:3.0:1788869339.409834:0:5749:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1788869339.409839:0:5749:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c81f0ff850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:121cd5bc-7f07-4cf7-8e2e-4356c89c0696+11:6543:x1875765421414528:12345-0@lo:503: 00000100:00100000:3.0:1788869339.409990:0:5749:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c81f0ff850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:121cd5bc-7f07-4cf7-8e2e-4356c89c0696+11:6543:x1875765421414528:12345-0@lo:503: Request processed in 150us (247us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869339.409996:0:5749:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1788869339.410061:0:6543:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94c8349ed180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:121cd5bc-7f07-4cf7-8e2e-4356c89c0696:6543:1875765421414528:0@lo:503: 00000040:00080000:0.0:1788869339.410365:0:6543:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1788869339.410454:0:6543:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94c8349ed180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:121cd5bc-7f07-4cf7-8e2e-4356c89c0696:6543:1875765421414656:0@lo:502: 00000100:00100000:0.0:1788869339.410484:0:6543:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869339.410565:0:6543:0:(client.c:2702:ptlrpc_set_wait()) set ffff94c8191dcc00 going to sleep for 11 seconds 00000100:00100000:3.0:1788869339.410661:0:5749:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765421414656 00000100:00100000:3.0:1788869339.410666:0:5749:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765421414656 00000100:00100000:3.0:1788869339.410690:0:5749:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1788869339.410697:0:5749:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c81f0fdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:121cd5bc-7f07-4cf7-8e2e-4356c89c0696+11:6543:x1875765421414656:12345-0@lo:502: 00000100:00100000:3.0:1788869339.410855:0:5749:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c81f0fdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:121cd5bc-7f07-4cf7-8e2e-4356c89c0696+11:6543:x1875765421414656:12345-0@lo:502: Request processed in 156us (368us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869339.410862:0:5749:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1788869339.411024:0:6543:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94c8349ed180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:121cd5bc-7f07-4cf7-8e2e-4356c89c0696:6543:1875765421414656:0@lo:502: 00000040:00080000:0.0:1788869339.411300:0:6543:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:0.0:1788869339.411344:0:6543:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:0.0:1788869339.411374:0:6543:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:0.0:1788869339.411414:0:6543:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:0.0:1788869339.411447:0:6543:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:0.0:1788869339.411475:0:6543:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:0.0:1788869339.411554:0:6543:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94c8349ed180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:121cd5bc-7f07-4cf7-8e2e-4356c89c0696:6543:1875765421414784:0@lo:502: 00000100:00100000:0.0:1788869339.411584:0:6543:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869339.411613:0:6543:0:(client.c:2702:ptlrpc_set_wait()) set ffff94c8191dcc00 going to sleep for 11 seconds 00000100:00100000:3.0:1788869339.411669:0:5749:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765421414784 00000100:00100000:3.0:1788869339.411673:0:5749:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765421414784 00000100:00100000:3.0:1788869339.411701:0:5749:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1788869339.411707:0:5749:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c81f0fe850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:121cd5bc-7f07-4cf7-8e2e-4356c89c0696+11:6543:x1875765421414784:12345-0@lo:502: 00000100:00100000:3.0:1788869339.411826:0:5749:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c81f0fe850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:121cd5bc-7f07-4cf7-8e2e-4356c89c0696+11:6543:x1875765421414784:12345-0@lo:502: Request processed in 119us (241us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869339.411833:0:5749:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1788869339.411928:0:6543:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94c8349ed180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:121cd5bc-7f07-4cf7-8e2e-4356c89c0696:6543:1875765421414784:0@lo:502: 00000040:00080000:0.0:1788869339.411993:0:6543:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:0.0:1788869339.412002:0:6543:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 7 count 8 00000020:01000000:0.0:1788869339.412593:0:6562:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1788869339.412604:0:6562:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-ost1/ost1 00000020:00000080:0.0:1788869339.412612:0:6562:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788869339.412615:0:6562:0:(obd_config.c:1561:class_process_config()) marker 11 (0x1) lustre-OST0000 add ost 00000020:00000080:0.0:1788869339.412620:0:6562:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1788869339.412639:0:6562:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff94c808e03380) 00000020:00000080:0.0:1788869339.412674:0:6562:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type obdfilter with refcount 2 00000020:00000080:0.0:1788869339.412681:0:6562:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:0.0:1788869339.412757:0:6562:0:(tgt_mount.c:153:server_get_mount()) get mount ffff94c839dd4000 from lustre-OST0000, refs=2 00080000:01000000:0.0:1788869339.412766:0:6562:0:(osd_handler.c:1569:osd_obd_connect()) connect #1 00000020:00000080:0.0:1788869339.412775:0:6562:0:(genops.c:1406:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x3d2d1916761d6244 00010000:00010000:0.0:1788869339.417115:0:6562:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-2 is initialized 00000001:02000400:0.0:1788869339.417641:0:6562:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-OST0000: new disk, initializing 00000001:00000004:0.0:1788869339.419593:0:6562:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 0 40000000:02000000:0.0:1788869339.420084:0:6562:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0000: No data found on store. Initialize space. 00080000:10000000:0.0:1788869339.430018:0:6562:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000001:0x3:0x0] (8/8/3) registered 00080000:10000000:0.0:1788869339.430521:0:6562:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x3:0x0] (8/8/4) registered 00000020:00000080:0.0:1788869339.435415:0:6562:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:0.0:1788869339.435427:0:6562:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788869339.435434:0:6562:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788869339.435436:0:6562:0:(obd_config.c:1561:class_process_config()) marker 11 (0x2) lustre-OST0000 add ost 00000020:01000000:0.0:1788869339.435441:0:6562:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788869339.435446:0:6562:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788869339.435449:0:6562:0:(obd_config.c:1561:class_process_config()) marker 16 (0x1) lustre sys.timeout 00000020:00000080:0.0:1788869339.435452:0:6562:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1788869339.435454:0:6562:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1788869339.435509:0:6562:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788869339.435512:0:6562:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788869339.435513:0:6562:0:(obd_config.c:1561:class_process_config()) marker 16 (0x2) lustre sys.timeout 00000040:00080000:0.0:1788869339.435517:0:6562:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:3.0:1788869339.435712:0:6543:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-7 (rc=0) 10000000:01000000:3.0:1788869339.435739:0:6543:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.139@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:3.0:1788869339.435763:0:6543:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.139@tcp lock: ffff94c818d1fc00/0x3d2d1916761d622f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3d2d1916761d6236 expref: -99 pid: 6543 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869339.435776:0:6543:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.139@tcp lock: ffff94c818d1fc00/0x3d2d1916761d622f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3d2d1916761d6236 expref: -99 pid: 6543 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788869339.435785:0:6543:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff94c839dd4000 from 1 10000000:01000000:3.0:1788869339.435788:0:6543:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788869339.435824:0:6543:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.139@tcp lock: ffff94c81a582600/0x3d2d1916761d624b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6543 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869339.435833:0:6543:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.139@tcp lock: ffff94c81a582600/0x3d2d1916761d624b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6543 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869339.435845:0:6543:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.139@tcp lock: ffff94c81a582600/0x3d2d1916761d624b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6543 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788869339.435869:0:6543:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94c82d042a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:121cd5bc-7f07-4cf7-8e2e-4356c89c0696:6543:1875765421414912:0@lo:101: 00000100:00100000:3.0:1788869339.435934:0:6543:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869339.435976:0:5749:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765421414912 00000100:00100000:3.0:1788869339.435983:0:5749:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765421414912 00000100:00100000:3.0:1788869339.436033:0:5749:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1788869339.436045:0:5749:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c81f0fcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:121cd5bc-7f07-4cf7-8e2e-4356c89c0696+11:6543:x1875765421414912:12345-0@lo:101: 00010000:00010000:3.0:1788869339.436059:0:5749:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788869339.436080:0:5749:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff94c81a583a00/0x3d2d1916761d6252 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x3d2d1916761d624b expref: -99 pid: 5749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869339.436140:0:5749:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff94c81a583a00/0x3d2d1916761d6252 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3d2d1916761d624b expref: 12 pid: 5749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869339.436167:0:5749:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff94c81a583a00/0x3d2d1916761d6252 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3d2d1916761d624b expref: 12 pid: 5749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869339.436193:0:5749:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94c81a583a00, rc 0) 00000100:00100000:3.0:1788869339.436275:0:5749:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c81f0fcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:121cd5bc-7f07-4cf7-8e2e-4356c89c0696+12:6543:x1875765421414912:12345-0@lo:101: Request processed in 206us (313us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869339.436284:0:5749:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1788869339.436359:0:6543:0:(client.c:2702:ptlrpc_set_wait()) set ffff94c8180196c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788869339.436382:0:6543:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94c82d042a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:121cd5bc-7f07-4cf7-8e2e-4356c89c0696:6543:1875765421414912:0@lo:101: 00010000:00010000:3.0:1788869339.436397:0:6543:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.139@tcp lock: ffff94c81a582600/0x3d2d1916761d624b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x3d2d1916761d6252 expref: -99 pid: 6543 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869339.436407:0:6543:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.139@tcp lock: ffff94c81a582600/0x3d2d1916761d624b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x3d2d1916761d6252 expref: -99 pid: 6543 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788869339.436492:0:6543:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94c82d042a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:121cd5bc-7f07-4cf7-8e2e-4356c89c0696:6543:1875765421415040:0@lo:501: 00000100:00100000:3.0:1788869339.436528:0:6543:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869339.436556:0:6543:0:(client.c:2702:ptlrpc_set_wait()) set ffff94c8180196c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788869339.436701:0:5750:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765421415040 00000100:00100000:0.0:1788869339.436707:0:5750:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765421415040 00000100:00100000:0.0:1788869339.436739:0:5750:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1788869339.436748:0:5750:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c81f0ff050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:121cd5bc-7f07-4cf7-8e2e-4356c89c0696+12:6543:x1875765421415040:12345-0@lo:501: 00000100:00100000:0.0:1788869339.437016:0:5750:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c81f0ff050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:121cd5bc-7f07-4cf7-8e2e-4356c89c0696+12:6543:x1875765421415040:12345-0@lo:501: Request processed in 270us (488us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869339.437024:0:5750:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1788869339.437061:0:6543:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94c82d042a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:121cd5bc-7f07-4cf7-8e2e-4356c89c0696:6543:1875765421415040:0@lo:501: 00000100:00100000:3.0:1788869339.437082:0:6543:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94c82d042a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:121cd5bc-7f07-4cf7-8e2e-4356c89c0696:6543:1875765421415168:0@lo:503: 00000100:00100000:3.0:1788869339.437128:0:6543:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869339.437142:0:6543:0:(client.c:2702:ptlrpc_set_wait()) set ffff94c8180196c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788869339.437604:0:5748:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765421415168 00000100:00100000:0.0:1788869339.438700:0:5748:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765421415168 00000100:00100000:1.0:1788869339.439126:0:5748:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1788869339.439139:0:5748:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c81f0fc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:121cd5bc-7f07-4cf7-8e2e-4356c89c0696+12:6543:x1875765421415168:12345-0@lo:503: 00000100:00100000:1.0:1788869339.439348:0:5748:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c81f0fc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:121cd5bc-7f07-4cf7-8e2e-4356c89c0696+12:6543:x1875765421415168:12345-0@lo:503: Request processed in 212us (2218us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869339.439357:0:5748:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1788869339.439523:0:6543:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94c82d042a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:121cd5bc-7f07-4cf7-8e2e-4356c89c0696:6543:1875765421415168:0@lo:503: 00000040:00080000:3.0:1788869339.439825:0:6543:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788869339.439888:0:6543:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94c82d042a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:121cd5bc-7f07-4cf7-8e2e-4356c89c0696:6543:1875765421415296:0@lo:502: 00000100:00100000:3.0:1788869339.439925:0:6543:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869339.439960:0:6543:0:(client.c:2702:ptlrpc_set_wait()) set ffff94c8180196c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788869339.440316:0:5750:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765421415296 00000100:00100000:0.0:1788869339.440323:0:5750:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765421415296 00000100:00100000:0.0:1788869339.440352:0:5750:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1788869339.440359:0:5750:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c81f0fd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:121cd5bc-7f07-4cf7-8e2e-4356c89c0696+12:6543:x1875765421415296:12345-0@lo:502: 00000100:00100000:0.0:1788869339.440486:0:5750:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c81f0fd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:121cd5bc-7f07-4cf7-8e2e-4356c89c0696+12:6543:x1875765421415296:12345-0@lo:502: Request processed in 127us (560us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869339.440493:0:5750:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1788869339.440509:0:6543:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94c82d042a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:121cd5bc-7f07-4cf7-8e2e-4356c89c0696:6543:1875765421415296:0@lo:502: 00000040:00080000:3.0:1788869339.441292:0:6543:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:3.0:1788869339.441409:0:6543:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:3.0:1788869339.441435:0:6543:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94c82d042a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:121cd5bc-7f07-4cf7-8e2e-4356c89c0696:6543:1875765421415424:0@lo:502: 00000100:00100000:3.0:1788869339.441471:0:6543:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869339.441497:0:6543:0:(client.c:2702:ptlrpc_set_wait()) set ffff94c8180196c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788869339.441516:0:5748:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765421415424 00000100:00100000:0.0:1788869339.441522:0:5748:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765421415424 00000100:00100000:0.0:1788869339.441549:0:5748:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1788869339.441556:0:5748:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c81f0fc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:121cd5bc-7f07-4cf7-8e2e-4356c89c0696+12:6543:x1875765421415424:12345-0@lo:502: 00000100:00100000:0.0:1788869339.441743:0:5748:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c81f0fc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:121cd5bc-7f07-4cf7-8e2e-4356c89c0696+12:6543:x1875765421415424:12345-0@lo:502: Request processed in 187us (271us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869339.441752:0:5748:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1788869339.441767:0:6543:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94c82d042a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:121cd5bc-7f07-4cf7-8e2e-4356c89c0696:6543:1875765421415424:0@lo:502: 00000040:00080000:3.0:1788869339.441838:0:6543:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:3.0:1788869339.441847:0:6543:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:0.0:1788869339.443404:0:6566:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788869339.443415:0:6566:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788869339.443417:0:6566:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1788869339.443424:0:6566:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff94c839dd4000 00000020:00000080:0.0:1788869339.443427:0:6566:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1788869339.443461:0:6566:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788869339.443465:0:6566:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788869339.443467:0:6566:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:0.0:1788869339.443470:0:6566:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:3.0:1788869339.443547:0:6543:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:3.0:1788869339.443563:0:6543:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.139@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788869339.443578:0:6543:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.139@tcp lock: ffff94c81a582600/0x3d2d1916761d624b lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x3d2d1916761d6252 expref: -99 pid: 6543 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869339.443586:0:6543:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.139@tcp lock: ffff94c81a582600/0x3d2d1916761d624b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x3d2d1916761d6252 expref: -99 pid: 6543 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788869339.443619:0:6543:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1788869339.443621:0:6543:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff94c839dd4000 10000000:01000000:3.0:1788869339.443623:0:6543:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff94c839dd4000 10000000:01000000:3.0:1788869339.443626:0:6543:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1788869339.443630:0:6543:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff94c839dd4000 from 1 10000000:01000000:3.0:1788869339.443632:0:6543:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1788869339.443666:0:6543:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.139@tcp lock: ffff94c81a582e00/0x3d2d1916761d6259 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6543 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869339.443672:0:6543:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.139@tcp lock: ffff94c81a582e00/0x3d2d1916761d6259 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6543 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869339.443680:0:6543:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.139@tcp lock: ffff94c81a582e00/0x3d2d1916761d6259 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6543 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788869339.443690:0:6543:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94c82d042a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:121cd5bc-7f07-4cf7-8e2e-4356c89c0696:6543:1875765421415552:0@lo:101: 00000100:00100000:3.0:1788869339.443717:0:6543:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869339.443742:0:6543:0:(client.c:2702:ptlrpc_set_wait()) set ffff94c818019300 going to sleep for 11 seconds 00000100:00100000:0.0:1788869339.444088:0:5750:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765421415552 00000100:00100000:0.0:1788869339.444094:0:5750:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765421415552 00000100:00100000:0.0:1788869339.444127:0:5750:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1788869339.444135:0:5750:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c81f0f9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:121cd5bc-7f07-4cf7-8e2e-4356c89c0696+12:6543:x1875765421415552:12345-0@lo:101: 00010000:00010000:0.0:1788869339.444146:0:5750:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788869339.444158:0:5750:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff94c818d1ec00/0x3d2d1916761d6260 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x3d2d1916761d6259 expref: -99 pid: 5750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869339.444179:0:5750:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff94c818d1ec00/0x3d2d1916761d6260 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3d2d1916761d6259 expref: 13 pid: 5750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869339.444201:0:5750:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff94c818d1ec00/0x3d2d1916761d6260 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3d2d1916761d6259 expref: 13 pid: 5750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869339.444210:0:5750:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94c818d1ec00, rc 0) 00000100:00100000:3.0:1788869339.444285:0:6543:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94c82d042a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:121cd5bc-7f07-4cf7-8e2e-4356c89c0696:6543:1875765421415552:0@lo:101: 00010000:00010000:3.0:1788869339.444296:0:6543:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.139@tcp lock: ffff94c81a582e00/0x3d2d1916761d6259 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x3d2d1916761d6260 expref: -99 pid: 6543 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869339.444303:0:6543:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.139@tcp lock: ffff94c81a582e00/0x3d2d1916761d6259 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x3d2d1916761d6260 expref: -99 pid: 6543 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788869339.444360:0:5750:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c81f0f9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:121cd5bc-7f07-4cf7-8e2e-4356c89c0696+13:6543:x1875765421415552:12345-0@lo:101: Request processed in 114us (529us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869339.444367:0:6543:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94c82d042a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:121cd5bc-7f07-4cf7-8e2e-4356c89c0696:6543:1875765421415680:0@lo:501: 00000100:00100000:0.0:1788869339.444371:0:5750:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1788869339.444401:0:6543:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869339.444438:0:6543:0:(client.c:2702:ptlrpc_set_wait()) set ffff94c818019300 going to sleep for 11 seconds 00000100:00100000:1.0:1788869339.444447:0:5748:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765421415680 00000100:00100000:1.0:1788869339.444453:0:5748:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765421415680 00000100:00100000:1.0:1788869339.444488:0:5748:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1788869339.444496:0:5748:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c81f0fa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:121cd5bc-7f07-4cf7-8e2e-4356c89c0696+13:6543:x1875765421415680:12345-0@lo:501: 00000100:00100000:1.0:1788869339.444709:0:5748:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c81f0fa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:121cd5bc-7f07-4cf7-8e2e-4356c89c0696+13:6543:x1875765421415680:12345-0@lo:501: Request processed in 214us (308us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869339.444718:0:5748:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1788869339.444730:0:6543:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94c82d042a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:121cd5bc-7f07-4cf7-8e2e-4356c89c0696:6543:1875765421415680:0@lo:501: 00000100:00100000:3.0:1788869339.444751:0:6543:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94c82d042a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:121cd5bc-7f07-4cf7-8e2e-4356c89c0696:6543:1875765421415808:0@lo:503: 00000100:00100000:3.0:1788869339.444775:0:6543:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869339.444794:0:6543:0:(client.c:2702:ptlrpc_set_wait()) set ffff94c818019300 going to sleep for 11 seconds 00000100:00100000:0.0:1788869339.444822:0:5750:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765421415808 00000100:00100000:0.0:1788869339.444827:0:5750:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765421415808 00000100:00100000:0.0:1788869339.444856:0:5750:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1788869339.444864:0:5750:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c81f0fbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:121cd5bc-7f07-4cf7-8e2e-4356c89c0696+13:6543:x1875765421415808:12345-0@lo:503: 00000100:00100000:0.0:1788869339.445034:0:5750:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c81f0fbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:121cd5bc-7f07-4cf7-8e2e-4356c89c0696+13:6543:x1875765421415808:12345-0@lo:503: Request processed in 170us (256us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869339.445042:0:5750:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1788869339.445049:0:6543:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94c82d042a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:121cd5bc-7f07-4cf7-8e2e-4356c89c0696:6543:1875765421415808:0@lo:503: 00000040:00080000:3.0:1788869339.445246:0:6543:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788869339.445301:0:6543:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94c82d042a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:121cd5bc-7f07-4cf7-8e2e-4356c89c0696:6543:1875765421415936:0@lo:502: 00000100:00100000:3.0:1788869339.445396:0:6543:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869339.445422:0:6543:0:(client.c:2702:ptlrpc_set_wait()) set ffff94c8201d19c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788869339.445442:0:5748:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765421415936 00000100:00100000:1.0:1788869339.445447:0:5748:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765421415936 00000100:00100000:1.0:1788869339.445475:0:5748:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1788869339.445482:0:5748:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c81f0fa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:121cd5bc-7f07-4cf7-8e2e-4356c89c0696+13:6543:x1875765421415936:12345-0@lo:502: 00000100:00100000:1.0:1788869339.445623:0:5748:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c81f0fa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:121cd5bc-7f07-4cf7-8e2e-4356c89c0696+13:6543:x1875765421415936:12345-0@lo:502: Request processed in 142us (226us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869339.445631:0:5748:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1788869339.445756:0:6543:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94c82d042a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:121cd5bc-7f07-4cf7-8e2e-4356c89c0696:6543:1875765421415936:0@lo:502: 00000040:00080000:3.0:1788869339.446057:0:6543:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:3.0:1788869339.446103:0:6543:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:3.0:1788869339.446129:0:6543:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:3.0:1788869339.446166:0:6543:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:3.0:1788869339.446202:0:6543:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:3.0:1788869339.446231:0:6543:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:3.0:1788869339.446268:0:6543:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:3.0:1788869339.446292:0:6543:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:3.0:1788869339.446321:0:6543:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:3.0:1788869339.446355:0:6543:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:3.0:1788869339.446399:0:6543:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:3.0:1788869339.446456:0:6543:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:3.0:1788869339.446492:0:6543:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:3.0:1788869339.446514:0:6543:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:3.0:1788869339.446544:0:6543:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:3.0:1788869339.446570:0:6543:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:3.0:1788869339.446692:0:6543:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:3.0:1788869339.446726:0:6543:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:3.0:1788869339.446746:0:6543:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:3.0:1788869339.446762:0:6543:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:3.0:1788869339.446796:0:6543:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:3.0:1788869339.446817:0:6543:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:3.0:1788869339.446846:0:6543:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:3.0:1788869339.446883:0:6543:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:3.0:1788869339.446904:0:6543:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 128 off12440 00000040:00080000:3.0:1788869339.446920:0:6543:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12664 00000040:00080000:3.0:1788869339.447037:0:6543:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12888 00000040:00080000:3.0:1788869339.447067:0:6543:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off12968 00000100:00100000:3.0:1788869339.447086:0:6543:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94c82d042a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:121cd5bc-7f07-4cf7-8e2e-4356c89c0696:6543:1875765421416064:0@lo:502: 00000100:00100000:3.0:1788869339.447115:0:6543:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869339.447140:0:6543:0:(client.c:2702:ptlrpc_set_wait()) set ffff94c8201d19c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788869339.447324:0:5750:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765421416064 00000100:00100000:0.0:1788869339.447331:0:5750:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765421416064 00000100:00100000:0.0:1788869339.447361:0:5750:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1788869339.447369:0:5750:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c81f0fac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:121cd5bc-7f07-4cf7-8e2e-4356c89c0696+13:6543:x1875765421416064:12345-0@lo:502: 00000100:00100000:0.0:1788869339.447519:0:5750:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c81f0fac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:121cd5bc-7f07-4cf7-8e2e-4356c89c0696+13:6543:x1875765421416064:12345-0@lo:502: Request processed in 151us (401us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869339.447527:0:5750:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1788869339.447543:0:6543:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94c82d042a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:121cd5bc-7f07-4cf7-8e2e-4356c89c0696:6543:1875765421416064:0@lo:502: 00000040:00080000:3.0:1788869339.447591:0:6543:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13192 00000040:00080000:3.0:1788869339.447604:0:6543:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 29 count 30 00000020:01000004:3.0:1788869339.448005:0:6567:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:3.0:1788869339.448016:0:6567:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff94c8356c99c0) 00000020:00000080:3.0:1788869339.448031:0:6567:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type lwp with refcount 2 00000020:01000004:3.0:1788869339.448151:0:6567:0:(tgt_mount.c:153:server_get_mount()) get mount ffff94c839dd4000 from lustre-OST0000, refs=3 00000020:01000004:3.0:1788869339.448154:0:6567:0:(tgt_mount.c:187:server_put_mount()) put mount ffff94c839dd4000 from lustre-OST0000, refs=3 00000020:01000004:3.0:1788869339.448156:0:6567:0:(obd_mount.c:710:lustre_put_lsi()) put ffff94c839dd4000 3 00010000:00080000:3.0:1788869339.448174:0:6567:0:(ldlm_lib.c:102:import_set_conn()) imp ffff94c839dd3800@lustre-MDT0000-lwp-OST0000: add connection 192.168.201.139@tcp at head 00010000:00010000:3.0:1788869339.450317:0:6567:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-2 is initialized 00000020:00000080:3.0:1788869339.450424:0:6567:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:3.0:1788869339.450449:0:6567:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1788869339.450465:0:6567:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0x3d2d1916761d626e 00000100:00080000:3.0:1788869339.450471:0:6567:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788869339.450475:0:6567:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff94c839dd3800 using connection 192.168.201.139@tcp/0@lo 00000100:00100000:3.0:1788869339.450498:0:6567:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff94c82d042a00 x1875765421416192/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788869339.450520:0:6567:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00100000:2.0:1788869339.450556:0:3282:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94c82d042a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3282:1875765421416192:0@lo:38: 00000100:00100000:2.0:1788869339.450629:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869339.450673:0:5756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765421416192 00000100:00100000:3.0:1788869339.450679:0:5756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765421416192 00000100:00100000:3.0:1788869339.450711:0:5756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788869339.450718:0:5756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c803fb8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3282:x1875765421416192:12345-0@lo:38: 00010000:00080000:3.0:1788869339.450738:0:5756:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 87 last 0 00000020:00000080:3.0:1788869339.450773:0:5756:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0x3d2d1916761d6275 00000004:00100000:3.0:1788869339.450846:0:5756:0:(mdt_handler.c:7366:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1788869339.450876:0:5756:0:(import.c:65:import_set_state_nolock()) ffff94c7012d4000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788869339.450921:0:5756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c803fb8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3282:x1875765421416192:12345-0@lo:38: Request processed in 203us (293us total) trans 0 rc 0/0 00010000:00080000:2.0:1788869339.450960:0:3282:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff94c82d042a00 x1875765421416192/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788869349 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788869339.450972:0:3282:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00100000:3.0:1788869339.450977:0:5756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:2.0:1788869339.450980:0:3282:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 1 00000100:00080000:2.0:1788869339.450988:0:3282:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:2.0:1788869339.450993:0:3282:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1788869339.450996:0:3282:0:(import.c:65:import_set_state_nolock()) ffff94c839dd3800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1788869339.451002:0:3282:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94c82d042a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3282:1875765421416192:0@lo:38: 00000040:00080000:2.0:1788869339.451595:0:6567:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 00000020:01000000:3.0:1788869339.451715:0:6543:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-29 (rc=0) 10000000:01000000:3.0:1788869339.451739:0:6543:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.139@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1788869339.451752:0:6543:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.139@tcp lock: ffff94c81a582e00/0x3d2d1916761d6259 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x3d2d1916761d6260 expref: -99 pid: 6543 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788869339.451752:0:3283:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94c8349ed180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3283:1875765421416320:0@lo:400: 00010000:00010000:3.0:1788869339.451764:0:6543:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.139@tcp lock: ffff94c81a582e00/0x3d2d1916761d6259 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x3d2d1916761d6260 expref: -99 pid: 6543 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788869339.451791:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:01000004:3.0:1788869339.451816:0:6543:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:3.0:1788869339.451818:0:6543:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1788869339.451820:0:6543:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788869339.451821:0:6543:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788869339.451823:0:6543:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788869339.451825:0:6543:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788869339.451826:0:6543:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788869339.451828:0:6543:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1788869339.451830:0:6543:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1788869339.451833:0:6543:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788869339.451834:0:6543:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1788869339.451838:0:6543:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020062 00000020:01000004:3.0:1788869339.451841:0:6543:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1788869339.451843:0:6543:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1788869339.451844:0:6543:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788869339.451845:0:6543:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788869339.451846:0:6543:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788869339.451847:0:6543:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788869339.451848:0:6543:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788869339.451849:0:6543:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000100:00100000:0.0:1788869339.451850:0:5757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765421416320 00000020:01000004:3.0:1788869339.451856:0:6543:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000100:00100000:0.0:1788869339.451856:0:5757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765421416320 00000020:01000004:3.0:1788869339.451857:0:6543:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788869339.451860:0:6543:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1788869339.451875:0:6543:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:3.0:1788869339.451885:0:6543:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94c82d040a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:121cd5bc-7f07-4cf7-8e2e-4356c89c0696:6543:1875765421416448:0@lo:253: 00000100:00100000:0.0:1788869339.451895:0:5757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788869339.451903:0:5757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c803fb9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3283:x1875765421416320:12345-0@lo:400: 00000100:00100000:3.0:1788869339.451922:0:6543:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869339.451953:0:5757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c803fb9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3283:x1875765421416320:12345-0@lo:400: Request processed in 50us (161us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869339.451966:0:5757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:0.0:1788869339.451995:0:3283:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff94c8349ed180 x1875765421416320/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788869355 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788869339.452006:0:3283:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94c8349ed180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3283:1875765421416320:0@lo:400: 00000100:00100000:3.0:1788869339.452084:0:6543:0:(client.c:2702:ptlrpc_set_wait()) set ffff94c8201d1180 going to sleep for 11 seconds 00000100:00100000:0.0:1788869339.452987:0:5748:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765421416448 00000100:00100000:0.0:1788869339.452993:0:5748:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765421416448 00000100:00100000:0.0:1788869339.453067:0:5748:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1788869339.453075:0:5748:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c81f0fb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:121cd5bc-7f07-4cf7-8e2e-4356c89c0696+13:6543:x1875765421416448:12345-0@lo:253: 20000000:01000000:0.0:1788869339.453096:0:5748:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:0.0:1788869339.453110:0:5748:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:0.0:1788869339.474985:0:5748:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1788869339.475007:0:5748:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:1.0:1788869339.475039:0:5771:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1788869339.475050:0:5771:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1788869339.475086:0:5771:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff94c8421f2a00/0x3d2d1916761d627c lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869339.475108:0:5771:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff94c818d1fe00/0x3d2d1916761d61e2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3d2d1916761d61db expref: 13 pid: 5748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869339.475116:0:5771:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff94c8421f2a00/0x3d2d1916761d627c lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869339.475162:0:5771:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff94c818d1fe00/0x3d2d1916761d61e2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x3d2d1916761d61db expref: 13 pid: 5748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869339.475178:0:5771:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff94c818d1fe00/0x3d2d1916761d61e2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x3d2d1916761d61db expref: 13 pid: 5748 timeout: 237 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788869339.475209:0:5771:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94c81f1f0a80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5771:1875765421416576:0@lo:104: 00000100:00100000:1.0:1788869339.475527:0:5771:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869339.475595:0:5771:0:(client.c:2702:ptlrpc_set_wait()) set ffff94c701214cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788869339.475604:0:5738:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765421416576 00000100:00100000:3.0:1788869339.475617:0:5738:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765421416576 00000100:00100000:3.0:1788869339.475839:0:5738:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788869339.475853:0:5738:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c81f1f3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:121cd5bc-7f07-4cf7-8e2e-4356c89c0696+3:5771:x1875765421416576:12345-0@lo:104: 00010000:00010000:3.0:1788869339.475876:0:5738:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.139@tcp lock: ffff94c80153b000/0x3d2d1916761d61db lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x3d2d1916761d61e2 expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869339.476371:0:5738:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788869339.476382:0:5738:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c81f1f3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:121cd5bc-7f07-4cf7-8e2e-4356c89c0696+3:5771:x1875765421416576:12345-0@lo:104: Request processed in 532us (853us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869339.476394:0:5738:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788869339.476615:0:5771:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94c81f1f0a80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5771:1875765421416576:0@lo:104: 00010000:00010000:0.0:1788869339.476682:0:5743:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788869339.476691:0:5743:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.139@tcp lock: ffff94c80153b000/0x3d2d1916761d61db lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x3d2d1916761d61e2 expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869339.476700:0:5743:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94c80153b000 already unused, calling callback (ffffffffc1ce9c20) 10000000:00010000:0.0:1788869339.476705:0:5743:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.139@tcp lock: ffff94c80153b000/0x3d2d1916761d61db lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x3d2d1916761d61e2 expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869339.476715:0:5743:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.139@tcp lock: ffff94c80153b000/0x3d2d1916761d61db lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x3d2d1916761d61e2 expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788869339.476735:0:5743:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.139@tcp lock: ffff94c80153b000/0x3d2d1916761d61db lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x3d2d1916761d61e2 expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788869339.476742:0:5743:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1788869339.476787:0:5743:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.139@tcp lock: ffff94c80153b000/0x3d2d1916761d61db lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3d2d1916761d61e2 expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869339.476805:0:5743:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788869339.476828:0:5743:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.139@tcp lock: ffff94c80153b000/0x3d2d1916761d61db lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3d2d1916761d61e2 expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869339.476836:0:5743:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.139@tcp lock: ffff94c80153b000/0x3d2d1916761d61db lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3d2d1916761d61e2 expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869339.476856:0:5743:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788869339.476859:0:5743:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788869339.476860:0:5743:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788869339.476886:0:3284:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94c8349ed180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:121cd5bc-7f07-4cf7-8e2e-4356c89c0696:3284:1875765421416704:0@lo:103: 00010000:00010000:1.0:1788869339.476947:0:5771:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff94c8421f2a00/0x3d2d1916761d627c lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788869339.477506:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869339.477814:0:5740:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765421416704 00000100:00100000:1.0:1788869339.477823:0:5740:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765421416704 00010000:00010000:1.0:1788869339.477853:0:5740:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff94c818d1fe00/0x3d2d1916761d61e2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3d2d1916761d61db expref: 14 pid: 5748 timeout: 237 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788869339.477897:0:5740:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788869339.477908:0:5740:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c810ef2450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:121cd5bc-7f07-4cf7-8e2e-4356c89c0696+14:3284:x1875765421416704:12345-0@lo:103: 00010000:00010000:1.0:1788869339.477925:0:5740:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788869339.478001:0:5740:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff94c818d1fe00/0x3d2d1916761d61e2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3d2d1916761d61db expref: 14 pid: 5748 timeout: 237 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869339.478089:0:5740:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff94c818d1fe00/0x3d2d1916761d61e2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x3d2d1916761d61db expref: 14 pid: 5748 timeout: 237 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869339.478113:0:5740:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff94c818d1fe00/0x3d2d1916761d61e2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x3d2d1916761d61db expref: 14 pid: 5748 timeout: 237 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869339.478135:0:5740:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff94c8421f2a00/0x3d2d1916761d627c lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869339.478145:0:5740:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff94c8421f2a00/0x3d2d1916761d627c lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1788869339.479670:0:5740:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.004618324s 00010000:00010000:1.0:1788869339.479679:0:5740:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff94c8421f2a00/0x3d2d1916761d627c lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869339.479689:0:5740:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff94c8421f2a00/0x3d2d1916761d627c lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869339.479696:0:5740:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff94c8421f2a00/0x3d2d1916761d627c lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869339.479704:0:5740:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff94c8421f2a00/0x3d2d1916761d627c lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869339.479710:0:5740:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94c8421f2a00 already unused, calling callback (ffffffffc1703220) 00010000:00010000:1.0:1788869339.479715:0:5740:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff94c8421f2a00/0x3d2d1916761d627c lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869339.480423:0:5740:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff94c8421f2a00/0x3d2d1916761d627c lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869339.480459:0:5740:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff94c8421f2a00/0x3d2d1916761d627c lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869339.480476:0:5740:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788869339.480876:0:5740:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c810ef2450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:121cd5bc-7f07-4cf7-8e2e-4356c89c0696+13:3284:x1875765421416704:12345-0@lo:103: Request processed in 2961us (3364us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869339.480892:0:5740:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788869339.480918:0:3284:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94c8349ed180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:121cd5bc-7f07-4cf7-8e2e-4356c89c0696:3284:1875765421416704:0@lo:103: 00010000:00010000:1.0:1788869339.481466:0:5771:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff94c8421f2a00/0x3d2d1916761d627c lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869339.481499:0:5771:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff94c8421f2a00/0x3d2d1916761d627c lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869339.481506:0:5771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff94c8421f2a00/0x3d2d1916761d627c lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788869339.483163:0:5748:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c81f0fb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:121cd5bc-7f07-4cf7-8e2e-4356c89c0696+12:6543:x1875765421416448:12345-0@lo:253: Request processed in 30080us (31233us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869339.483230:0:6543:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94c82d040a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:121cd5bc-7f07-4cf7-8e2e-4356c89c0696:6543:1875765421416448:0@lo:253: 00000100:00100000:0.0:1788869339.483242:0:5748:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 10000000:01000000:3.0:1788869339.483278:0:6543:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:3.0:1788869339.483284:0:6543:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1788869339.483286:0:6543:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1788869339.483287:0:6543:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788869339.483288:0:6543:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788869339.483290:0:6543:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788869339.483291:0:6543:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788869339.483292:0:6543:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788869339.483295:0:6543:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1788869339.483297:0:6543:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1788869339.483299:0:6543:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788869339.483302:0:6543:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:3.0:1788869339.483329:0:6543:0:(tgt_mount.c:2689:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:3.0:1788869339.487556:0:6543:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:3.0:1788869339.487817:0:6543:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:3.0:1788869339.488045:0:6543:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:3.0:1788869339.488216:0:6543:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:3.0:1788869339.488543:0:6543:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:3.0:1788869339.488797:0:6543:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:3.0:1788869339.490871:0:6543:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00010000:00010000:2.0:1788869339.557138:0:5742:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00080000:3.0:1788869339.649441:0:6543:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:3.0:1788869339.649453:0:6543:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:3.0:1788869339.649499:0:6543:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1788869339.649593:0:6543:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.201.139@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1788869339.649614:0:6543:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=48 00000080:00000004:3.0:1788869339.649663:0:6543:0:(super25.c:181:lustre_fill_super()) lustre-ost1/ost1: Mount complete 00010000:00010000:0.0:1788869340.571417:0:5743:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788869341.595394:0:5742:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788869342.619846:0:5743:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1788869343.426367:0:6910:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg139-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:2.0:1788869343.643364:0:5742:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788869344.667573:0:5743:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788869344.859479:0:3285:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94c8349ece00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:121cd5bc-7f07-4cf7-8e2e-4356c89c0696:3285:1875765421416832:0@lo:400: 00000100:00100000:1.0:1788869344.859587:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869344.860054:0:5750:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765421416832 00000100:00100000:2.0:1788869344.860063:0:5750:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765421416832 00000100:00100000:2.0:1788869344.860116:0:5750:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1788869344.860138:0:5750:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c81f0fb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:121cd5bc-7f07-4cf7-8e2e-4356c89c0696+12:3285:x1875765421416832:12345-0@lo:400: 00000100:00100000:3.0:1788869344.860638:0:3286:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94c8349eca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3286:1875765421416960:0@lo:400: 00000100:00100000:3.0:1788869344.860677:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869344.860712:0:5756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765421416960 00000100:00100000:3.0:1788869344.860715:0:5756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765421416960 00000100:00100000:3.0:1788869344.860743:0:5756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788869344.860750:0:5756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c82d040a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3286:x1875765421416960:12345-0@lo:400: 00000100:00100000:3.0:1788869344.860786:0:5756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c82d040a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3286:x1875765421416960:12345-0@lo:400: Request processed in 36us (108us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869344.860792:0:5756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1788869344.860827:0:3286:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff94c8349eca80 x1875765421416960/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788869360 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788869344.860841:0:3286:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94c8349eca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3286:1875765421416960:0@lo:400: 00000100:00100000:2.0:1788869344.863521:0:5750:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c81f0fb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:121cd5bc-7f07-4cf7-8e2e-4356c89c0696+12:3285:x1875765421416832:12345-0@lo:400: Request processed in 3390us (3927us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869344.863590:0:5750:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1788869344.864308:0:3284:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788869344.864324:0:3284:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94c8349ef800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3284:1875765421417088:0@lo:400: 00000100:00100000:0.0:1788869344.864394:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869344.864452:0:5757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765421417088 00000100:00100000:0.0:1788869344.864460:0:5757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765421417088 00000100:00100000:0.0:1788869344.864509:0:5757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788869344.864517:0:5757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c8349ee300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3284:x1875765421417088:12345-0@lo:400: 00000100:00100000:0.0:1788869344.864578:0:5757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c8349ee300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3284:x1875765421417088:12345-0@lo:400: Request processed in 62us (182us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869344.864598:0:5757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:0.0:1788869344.864640:0:3284:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff94c8349ef800 x1875765421417088/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788869360 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788869344.864654:0:3284:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94c8349ef800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3284:1875765421417088:0@lo:400: 00000100:00080000:2.0:1788869344.864833:0:5751:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788869344.865182:0:3285:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94c8349ece00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:121cd5bc-7f07-4cf7-8e2e-4356c89c0696:3285:1875765421416832:0@lo:400: 00010000:00010000:2.0:1788869345.691732:0:5742:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1788869346.395345:0:5752:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1788869346.395356:0:5752:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff94c805125000 from 21 10000000:01000000:0.0:1788869346.395362:0:5752:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1788869346.395416:0:5752:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.139@tcp lock: ffff94c818d1fe00/0x3d2d1916761d6283 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869346.395431:0:5752:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.139@tcp lock: ffff94c818d1fe00/0x3d2d1916761d6283 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869346.395444:0:5752:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.139@tcp lock: ffff94c818d1fe00/0x3d2d1916761d6283 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788869346.395473:0:5752:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94c8349ef800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:121cd5bc-7f07-4cf7-8e2e-4356c89c0696:5752:1875765421417216:0@lo:101: 00000100:00100000:0.0:1788869346.395574:0:5752:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869346.398477:0:5748:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765421417216 00000100:00100000:3.0:1788869346.398490:0:5748:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765421417216 00000100:00100000:3.0:1788869346.398562:0:5748:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1788869346.398581:0:5748:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c81f0f9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:121cd5bc-7f07-4cf7-8e2e-4356c89c0696+12:5752:x1875765421417216:12345-0@lo:101: 00010000:00010000:3.0:1788869346.398604:0:5748:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788869346.398625:0:5748:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff94c81a582a00/0x3d2d1916761d628a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x3d2d1916761d6283 expref: -99 pid: 5748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869346.398658:0:5748:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff94c81a582a00/0x3d2d1916761d628a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3d2d1916761d6283 expref: 13 pid: 5748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869346.398671:0:5748:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff94c81a582a00/0x3d2d1916761d628a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3d2d1916761d6283 expref: 13 pid: 5748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869346.398681:0:5748:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94c81a582a00, rc 0) 00000100:00100000:3.0:1788869346.398750:0:5748:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c81f0f9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:121cd5bc-7f07-4cf7-8e2e-4356c89c0696+13:5752:x1875765421417216:12345-0@lo:101: Request processed in 172us (3176us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869346.398757:0:5748:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1788869346.399289:0:5752:0:(client.c:2702:ptlrpc_set_wait()) set ffff94c808e13e40 going to sleep for 11 seconds 00000100:00100000:0.0:1788869346.399321:0:5752:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94c8349ef800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:121cd5bc-7f07-4cf7-8e2e-4356c89c0696:5752:1875765421417216:0@lo:101: 00010000:00010000:0.0:1788869346.399342:0:5752:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.139@tcp lock: ffff94c818d1fe00/0x3d2d1916761d6283 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x3d2d1916761d628a expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869346.399353:0:5752:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.139@tcp lock: ffff94c818d1fe00/0x3d2d1916761d6283 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x3d2d1916761d628a expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788869346.399425:0:5752:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94c8349ef800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:121cd5bc-7f07-4cf7-8e2e-4356c89c0696:5752:1875765421417344:0@lo:501: 00000100:00100000:0.0:1788869346.399470:0:5752:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869346.399497:0:5752:0:(client.c:2702:ptlrpc_set_wait()) set ffff94c808e13e40 going to sleep for 11 seconds 00000100:00100000:2.0:1788869346.399606:0:5750:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765421417344 00000100:00100000:2.0:1788869346.399611:0:5750:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765421417344 00000100:00100000:2.0:1788869346.399647:0:5750:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1788869346.399655:0:5750:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c81f0fa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:121cd5bc-7f07-4cf7-8e2e-4356c89c0696+13:5752:x1875765421417344:12345-0@lo:501: 00000100:00100000:2.0:1788869346.400069:0:5750:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c81f0fa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:121cd5bc-7f07-4cf7-8e2e-4356c89c0696+13:5752:x1875765421417344:12345-0@lo:501: Request processed in 414us (597us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869346.400076:0:5750:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1788869346.400145:0:5752:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94c8349ef800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:121cd5bc-7f07-4cf7-8e2e-4356c89c0696:5752:1875765421417344:0@lo:501: 00000100:00100000:1.0:1788869346.400176:0:5752:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94c81f1f0a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:121cd5bc-7f07-4cf7-8e2e-4356c89c0696:5752:1875765421417472:0@lo:503: 00000100:00100000:1.0:1788869346.400218:0:5752:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869346.400245:0:5752:0:(client.c:2702:ptlrpc_set_wait()) set ffff94c8050fee40 going to sleep for 11 seconds 00000100:00100000:0.0:1788869346.400318:0:5748:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765421417472 00000100:00100000:0.0:1788869346.400322:0:5748:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765421417472 00000100:00100000:0.0:1788869346.400358:0:5748:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1788869346.400365:0:5748:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c81f0f8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:121cd5bc-7f07-4cf7-8e2e-4356c89c0696+13:5752:x1875765421417472:12345-0@lo:503: 00000100:00100000:0.0:1788869346.400675:0:5748:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c81f0f8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:121cd5bc-7f07-4cf7-8e2e-4356c89c0696+13:5752:x1875765421417472:12345-0@lo:503: Request processed in 310us (455us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869346.400682:0:5748:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1788869346.400719:0:5752:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94c81f1f0a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:121cd5bc-7f07-4cf7-8e2e-4356c89c0696:5752:1875765421417472:0@lo:503: 00000100:00100000:0.0:1788869346.400913:0:7085:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94c8349ed880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:121cd5bc-7f07-4cf7-8e2e-4356c89c0696:7085:1875765421417600:0@lo:502: 00000100:00100000:0.0:1788869346.400949:0:7085:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869346.400970:0:5748:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765421417600 00000100:00100000:0.0:1788869346.400974:0:5748:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765421417600 00000100:00100000:0.0:1788869346.400991:0:5748:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1788869346.400997:0:5748:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c81f0fb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:121cd5bc-7f07-4cf7-8e2e-4356c89c0696+13:7085:x1875765421417600:12345-0@lo:502: 00000100:00100000:0.0:1788869346.401186:0:5748:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c81f0fb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:121cd5bc-7f07-4cf7-8e2e-4356c89c0696+13:7085:x1875765421417600:12345-0@lo:502: Request processed in 187us (236us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869346.401193:0:5748:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1788869346.401227:0:7085:0:(client.c:2702:ptlrpc_set_wait()) set ffff94c808e13600 going to sleep for 11 seconds 00000100:00100000:0.0:1788869346.401238:0:7085:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94c8349ed880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:121cd5bc-7f07-4cf7-8e2e-4356c89c0696:7085:1875765421417600:0@lo:502: 00000100:00100000:0.0:1788869346.401311:0:7085:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94c8349ed880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:121cd5bc-7f07-4cf7-8e2e-4356c89c0696:7085:1875765421417728:0@lo:502: 00000100:00100000:0.0:1788869346.401343:0:7085:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869346.401363:0:5748:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765421417728 00000100:00100000:0.0:1788869346.401366:0:5748:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765421417728 00000100:00100000:0.0:1788869346.401383:0:5748:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1788869346.401395:0:5748:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c81f0f8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:121cd5bc-7f07-4cf7-8e2e-4356c89c0696+13:7085:x1875765421417728:12345-0@lo:502: 00000100:00100000:0.0:1788869346.401616:0:5748:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c81f0f8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:121cd5bc-7f07-4cf7-8e2e-4356c89c0696+13:7085:x1875765421417728:12345-0@lo:502: Request processed in 110us (161us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869346.401624:0:5748:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1788869346.401650:0:7085:0:(client.c:2702:ptlrpc_set_wait()) set ffff94c8063c8e40 going to sleep for 11 seconds 00000100:00100000:0.0:1788869346.401662:0:7085:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94c8349ed880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:121cd5bc-7f07-4cf7-8e2e-4356c89c0696:7085:1875765421417728:0@lo:502: 00000040:00080000:0.0:1788869346.401680:0:7085:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 30 count 30 00000020:01000000:1.0:1788869346.401931:0:5752:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 21-29 (rc=0) 10000000:01000000:1.0:1788869346.401949:0:5752:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.139@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1788869346.401958:0:5752:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.139@tcp lock: ffff94c818d1fe00/0x3d2d1916761d6283 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x3d2d1916761d628a expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869346.401968:0:5752:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.139@tcp lock: ffff94c818d1fe00/0x3d2d1916761d6283 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x3d2d1916761d628a expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788869346.402041:0:5752:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1788869346.402045:0:5752:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff94c805125000 from 4 10000000:01000000:0.0:1788869346.402048:0:5752:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1788869346.402076:0:5752:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.139@tcp lock: ffff94c818d1e800/0x3d2d1916761d6291 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869346.402084:0:5752:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.139@tcp lock: ffff94c818d1e800/0x3d2d1916761d6291 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869346.402094:0:5752:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.139@tcp lock: ffff94c818d1e800/0x3d2d1916761d6291 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788869346.402106:0:5752:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94c8349ed880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:121cd5bc-7f07-4cf7-8e2e-4356c89c0696:5752:1875765421417856:0@lo:101: 00000100:00100000:0.0:1788869346.402133:0:5752:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869346.402187:0:5752:0:(client.c:2702:ptlrpc_set_wait()) set ffff94c802d2f000 going to sleep for 11 seconds 00000100:00100000:1.0:1788869346.402224:0:5750:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765421417856 00000100:00100000:1.0:1788869346.402228:0:5750:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765421417856 00000100:00100000:0.0:1788869346.405834:0:5750:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1788869346.405848:0:5750:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c81f0f9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:121cd5bc-7f07-4cf7-8e2e-4356c89c0696+13:5752:x1875765421417856:12345-0@lo:101: 00010000:00010000:0.0:1788869346.405872:0:5750:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788869346.405894:0:5750:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff94c818d1e000/0x3d2d1916761d6298 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x3d2d1916761d6291 expref: -99 pid: 5750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869346.405927:0:5750:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff94c818d1e000/0x3d2d1916761d6298 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3d2d1916761d6291 expref: 14 pid: 5750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869346.405956:0:5750:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff94c818d1e000/0x3d2d1916761d6298 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3d2d1916761d6291 expref: 14 pid: 5750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869346.405966:0:5750:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94c818d1e000, rc 0) 00000100:00100000:0.0:1788869346.406064:0:5750:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c81f0f9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:121cd5bc-7f07-4cf7-8e2e-4356c89c0696+14:5752:x1875765421417856:12345-0@lo:101: Request processed in 218us (3929us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869346.406071:0:5750:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1788869346.406168:0:5752:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94c8349ed880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:121cd5bc-7f07-4cf7-8e2e-4356c89c0696:5752:1875765421417856:0@lo:101: 00010000:00010000:1.0:1788869346.406195:0:5752:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.139@tcp lock: ffff94c818d1e800/0x3d2d1916761d6291 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3d2d1916761d6298 expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869346.406219:0:5752:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.139@tcp lock: ffff94c818d1e800/0x3d2d1916761d6291 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x3d2d1916761d6298 expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788869346.406324:0:5752:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94c81f1f2300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:121cd5bc-7f07-4cf7-8e2e-4356c89c0696:5752:1875765421417984:0@lo:256: 00000100:00100000:1.0:1788869346.406374:0:5752:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869346.412642:0:5752:0:(client.c:2702:ptlrpc_set_wait()) set ffff94c8050fec00 going to sleep for 11 seconds 00000100:00100000:2.0:1788869346.413653:0:5749:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765421417984 00000100:00100000:2.0:1788869346.413668:0:5749:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765421417984 00000100:00100000:2.0:1788869346.413733:0:5749:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1788869346.413744:0:5749:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c81f0f8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:121cd5bc-7f07-4cf7-8e2e-4356c89c0696+14:5752:x1875765421417984:12345-0@lo:256: 20000000:01000000:2.0:1788869346.413777:0:5749:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1788869346.413795:0:5749:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1788869346.413798:0:5749:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 4 00000100:00100000:2.0:1788869346.414029:0:5749:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c81f0f8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:121cd5bc-7f07-4cf7-8e2e-4356c89c0696+14:5752:x1875765421417984:12345-0@lo:256: Request processed in 285us (7653us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869346.414038:0:5749:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1788869346.417549:0:5752:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94c81f1f2300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:121cd5bc-7f07-4cf7-8e2e-4356c89c0696:5752:1875765421417984:0@lo:256: 10000000:01000000:1.0:1788869346.417626:0:5752:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.139@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1788869346.417639:0:5752:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.139@tcp lock: ffff94c818d1e800/0x3d2d1916761d6291 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3d2d1916761d6298 expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869346.417653:0:5752:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.139@tcp lock: ffff94c818d1e800/0x3d2d1916761d6291 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3d2d1916761d6298 expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788869346.417664:0:5752:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:1.0:1788869346.417667:0:5752:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 16 10000000:01000000:1.0:1788869346.417671:0:5752:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:1.0:1788869346.417711:0:5752:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.139@tcp lock: ffff94c8421f2a00/0x3d2d1916761d629f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869346.417721:0:5752:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.139@tcp lock: ffff94c8421f2a00/0x3d2d1916761d629f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869346.417731:0:5752:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.139@tcp lock: ffff94c8421f2a00/0x3d2d1916761d629f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788869346.417756:0:5752:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94c81f1f2300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:121cd5bc-7f07-4cf7-8e2e-4356c89c0696:5752:1875765421418112:0@lo:101: 00000100:00100000:1.0:1788869346.417837:0:5752:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869346.417891:0:5752:0:(client.c:2702:ptlrpc_set_wait()) set ffff94c8050fec00 going to sleep for 11 seconds 00000100:00100000:2.0:1788869346.417951:0:5749:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765421418112 00000100:00100000:2.0:1788869346.417959:0:5749:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765421418112 00000100:00100000:2.0:1788869346.418055:0:5749:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1788869346.418067:0:5749:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c81f0f9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:121cd5bc-7f07-4cf7-8e2e-4356c89c0696+14:5752:x1875765421418112:12345-0@lo:101: 00010000:00010000:2.0:1788869346.418084:0:5749:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788869346.418102:0:5749:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff94c80153ba00/0x3d2d1916761d62a6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x3d2d1916761d629f expref: -99 pid: 5749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869346.418132:0:5749:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff94c80153ba00/0x3d2d1916761d62a6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3d2d1916761d629f expref: 15 pid: 5749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869346.418159:0:5749:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff94c80153ba00/0x3d2d1916761d62a6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3d2d1916761d629f expref: 15 pid: 5749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869346.418169:0:5749:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94c80153ba00, rc 0) 00000100:00100000:2.0:1788869346.418228:0:5749:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c81f0f9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:121cd5bc-7f07-4cf7-8e2e-4356c89c0696+15:5752:x1875765421418112:12345-0@lo:101: Request processed in 164us (391us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869346.418236:0:5749:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1788869346.418436:0:5752:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94c81f1f2300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:121cd5bc-7f07-4cf7-8e2e-4356c89c0696:5752:1875765421418112:0@lo:101: 00010000:00010000:1.0:1788869346.418452:0:5752:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.139@tcp lock: ffff94c8421f2a00/0x3d2d1916761d629f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x3d2d1916761d62a6 expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869346.418463:0:5752:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.139@tcp lock: ffff94c8421f2a00/0x3d2d1916761d629f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x3d2d1916761d62a6 expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788869346.418537:0:5752:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94c81f1f2300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:121cd5bc-7f07-4cf7-8e2e-4356c89c0696:5752:1875765421418240:0@lo:501: 00000100:00100000:1.0:1788869346.418567:0:5752:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869346.418746:0:5752:0:(client.c:2702:ptlrpc_set_wait()) set ffff94c8050fec00 going to sleep for 11 seconds 00000100:00100000:0.0:1788869346.418781:0:5750:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765421418240 00000100:00100000:0.0:1788869346.418786:0:5750:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765421418240 00000100:00100000:0.0:1788869346.418814:0:5750:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1788869346.418823:0:5750:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c81f0f8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:121cd5bc-7f07-4cf7-8e2e-4356c89c0696+15:5752:x1875765421418240:12345-0@lo:501: 00000100:00100000:0.0:1788869346.419157:0:5750:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c81f0f8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:121cd5bc-7f07-4cf7-8e2e-4356c89c0696+15:5752:x1875765421418240:12345-0@lo:501: Request processed in 335us (588us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869346.419166:0:5750:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1788869346.419288:0:5752:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94c81f1f2300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:121cd5bc-7f07-4cf7-8e2e-4356c89c0696:5752:1875765421418240:0@lo:501: 00000100:00100000:1.0:1788869346.419323:0:5752:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94c81f1f2300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:121cd5bc-7f07-4cf7-8e2e-4356c89c0696:5752:1875765421418368:0@lo:503: 00000100:00100000:1.0:1788869346.419364:0:5752:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869346.419381:0:5752:0:(client.c:2702:ptlrpc_set_wait()) set ffff94c8050fec00 going to sleep for 11 seconds 00000100:00100000:0.0:1788869346.419436:0:5750:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765421418368 00000100:00100000:0.0:1788869346.419441:0:5750:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765421418368 00000100:00100000:0.0:1788869346.419474:0:5750:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1788869346.419482:0:5750:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c8061d9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:121cd5bc-7f07-4cf7-8e2e-4356c89c0696+15:5752:x1875765421418368:12345-0@lo:503: 00000100:00100000:0.0:1788869346.419862:0:5750:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c8061d9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:121cd5bc-7f07-4cf7-8e2e-4356c89c0696+15:5752:x1875765421418368:12345-0@lo:503: Request processed in 379us (496us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869346.419871:0:5750:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1788869346.419944:0:5752:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94c81f1f2300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:121cd5bc-7f07-4cf7-8e2e-4356c89c0696:5752:1875765421418368:0@lo:503: 00000100:00100000:1.0:1788869346.420302:0:7088:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94c81f1f2300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:121cd5bc-7f07-4cf7-8e2e-4356c89c0696:7088:1875765421418496:0@lo:502: 00000100:00100000:1.0:1788869346.420341:0:7088:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869346.420377:0:7088:0:(client.c:2702:ptlrpc_set_wait()) set ffff94c8050fe780 going to sleep for 11 seconds 00000100:00100000:3.0:1788869346.420607:0:5750:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765421418496 00000100:00100000:3.0:1788869346.420614:0:5750:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765421418496 00000100:00100000:3.0:1788869346.420649:0:5750:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1788869346.420656:0:5750:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c8061da050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:121cd5bc-7f07-4cf7-8e2e-4356c89c0696+15:7088:x1875765421418496:12345-0@lo:502: 00000100:00100000:3.0:1788869346.420892:0:5750:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c8061da050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:121cd5bc-7f07-4cf7-8e2e-4356c89c0696+15:7088:x1875765421418496:12345-0@lo:502: Request processed in 236us (550us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869346.420900:0:5750:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1788869346.421149:0:7088:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94c81f1f2300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:121cd5bc-7f07-4cf7-8e2e-4356c89c0696:7088:1875765421418496:0@lo:502: 00000020:01000000:1.0:1788869346.421178:0:7088:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1788869346.421188:0:7088:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-mdt1/mdt1 00000020:00000080:1.0:1788869346.421196:0:7088:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788869346.421199:0:7088:0:(obd_config.c:1561:class_process_config()) marker 12 (0x1) lustre-OST0000 add osc 00000020:00000080:1.0:1788869346.421206:0:7088:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1788869346.421217:0:7088:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.201.139@tcp to nid 0x20000c0a8c98b (192.168.201.139@tcp) 00000020:01000000:1.0:1788869346.421787:0:7088:0:(obd_config.c:1975:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:1.0:1788869346.421793:0:7088:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788869346.421813:0:7088:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff94c81f1a8000) 00000020:00000080:1.0:1788869346.421842:0:7088:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type osp with refcount 2 00000020:00000080:1.0:1788869346.421851:0:7088:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1788869346.421963:0:7088:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:1.0:1788869346.421971:0:7088:0:(osd_handler.c:1569:osd_obd_connect()) connect #5 00000020:00000080:1.0:1788869346.421981:0:7088:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x3d2d1916761d62b4 00010000:00080000:1.0:1788869346.422024:0:7088:0:(ldlm_lib.c:102:import_set_conn()) imp ffff94c810fde000@lustre-OST0000-osc-MDT0000: add connection 192.168.201.139@tcp at head 00010000:00010000:1.0:1788869346.423582:0:7088:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-3 is initialized 00000040:01000000:2.0:1788869346.460826:0:7088:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:2.0:1788869346.460856:0:7088:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:2.0:1788869346.461828:0:7088:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788869346.461996:0:7088:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788869346.462045:0:7088:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].1, 64 off8256 00000040:00080000:2.0:1788869346.462149:0:7088:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1, 64 off8256 00000040:00080000:3.0:1788869346.462788:0:7093:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788869346.462795:0:7093:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x3:0x0] at index 1 of catalog [0x1:0x2:0x0] 00000020:00000080:2.0:1788869346.465184:0:7088:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1788869346.465205:0:7088:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1788869346.465549:0:7088:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:2.0:1788869346.465578:0:7088:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x3d2d1916761d62bb 00000100:00080000:2.0:1788869346.465592:0:7088:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788869346.465599:0:7088:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff94c810fde000 using connection 192.168.201.139@tcp/0@lo 00000100:00100000:2.0:1788869346.465645:0:7088:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff94c803fbad80 x1875765421418624/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788869346.465667:0:7088:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:2.0:1788869346.465730:0:7088:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788869346.465734:0:7088:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788869346.465735:0:7088:0:(obd_config.c:1561:class_process_config()) marker 12 (0x2) lustre-OST0000 add osc 00000020:01000000:2.0:1788869346.465738:0:7088:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788869346.465742:0:7088:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788869346.465743:0:7088:0:(obd_config.c:1561:class_process_config()) marker 15 (0x1) lustre sys.timeout 00000020:00000080:2.0:1788869346.465746:0:7088:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1788869346.465754:0:7088:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:2.0:1788869346.465788:0:7088:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94c803fb9500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:121cd5bc-7f07-4cf7-8e2e-4356c89c0696:7088:1875765421418752:0@lo:502: 00000100:00100000:2.0:1788869346.465885:0:7088:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869346.465936:0:7088:0:(client.c:2702:ptlrpc_set_wait()) set ffff94c8205ef540 going to sleep for 11 seconds 00000100:00100000:2.0:1788869346.465956:0:3282:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94c803fbad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3282:1875765421418624:0@lo:8: 00000100:00100000:2.0:1788869346.465987:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869346.466035:0:6544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765421418624 00000100:00100000:2.0:1788869346.466042:0:6544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765421418624 00000100:00100000:2.0:1788869346.466075:0:6544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788869346.466082:0:6544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c803fbb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3282:x1875765421418624:12345-0@lo:8: 00010000:00080000:2.0:1788869346.466106:0:6544:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 94 last 0 00000020:00000080:2.0:1788869346.466131:0:6544:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x3d2d1916761d62c2 00002000:00100000:2.0:1788869346.466165:0:6544:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff94c83e0b3800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113718 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:2.0:1788869346.466170:0:6544:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00000001:00000004:2.0:1788869346.466174:0:6544:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00002000:00100000:2.0:1788869346.466347:0:6544:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00000100:00100000:0.0:1788869346.466569:0:3284:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94c82d043800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3284:1875765421418880:0@lo:400: 00000100:00100000:3.0:1788869346.466602:0:5750:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765421418752 00000100:00100000:3.0:1788869346.466608:0:5750:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765421418752 00000100:00100000:0.0:1788869346.466612:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869346.466649:0:5750:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1788869346.466659:0:5750:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c810e10050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:121cd5bc-7f07-4cf7-8e2e-4356c89c0696+15:7088:x1875765421418752:12345-0@lo:502: 00000100:00100000:0.0:1788869346.466662:0:5756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765421418880 00000100:00100000:0.0:1788869346.466667:0:5756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765421418880 00000100:00100000:0.0:1788869346.466702:0:5756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788869346.466717:0:5756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c8349efb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3284:x1875765421418880:12345-0@lo:400: 00000100:00100000:0.0:1788869346.466770:0:5756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c8349efb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3284:x1875765421418880:12345-0@lo:400: Request processed in 54us (159us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869346.466778:0:5756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:0.0:1788869346.466830:0:3284:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff94c82d043800 x1875765421418880/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788869362 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788869346.466846:0:3284:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94c82d043800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3284:1875765421418880:0@lo:400: 00002000:00080000:2.0:1788869346.466941:0:6544:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1788869346.466970:0:6544:0:(import.c:65:import_set_state_nolock()) ffff94c83e0b4000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788869346.466971:0:5750:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c810e10050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:121cd5bc-7f07-4cf7-8e2e-4356c89c0696+15:7088:x1875765421418752:12345-0@lo:502: Request processed in 312us (1084us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869346.466982:0:5750:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1788869346.467024:0:6544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c803fbb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3282:x1875765421418624:12345-0@lo:8: Request processed in 939us (1034us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869346.467031:0:6544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788869346.467047:0:3285:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94c82d042300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3285:1875765421419008:0@lo:400: 00010000:00080000:2.0:1788869346.467067:0:3282:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff94c803fbad80 x1875765421418624/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788869356 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788869346.467077:0:3282:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00100000:3.0:1788869346.467085:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1788869346.467085:0:3282:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 1 00000100:00080000:2.0:1788869346.467096:0:3282:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:2.0:1788869346.467102:0:3282:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:2.0:1788869346.467111:0:3282:0:(import.c:65:import_set_state_nolock()) ffff94c810fde000 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:2.0:1788869346.467126:0:3282:0:(osp_dev.c:1705:osp_import_event()) got connected 00000100:00100000:2.0:1788869346.467131:0:3282:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94c803fbad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3282:1875765421418624:0@lo:8: 00000100:00100000:0.0:1788869346.467184:0:5757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765421419008 00000100:00100000:0.0:1788869346.467188:0:5757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765421419008 00000100:00100000:0.0:1788869346.467224:0:5757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788869346.467232:0:5757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c82d041880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3285:x1875765421419008:12345-0@lo:400: 00000100:00100000:0.0:1788869346.467292:0:5757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c82d041880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3285:x1875765421419008:12345-0@lo:400: Request processed in 60us (208us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869346.467300:0:5757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:0.0:1788869346.467332:0:3285:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff94c82d042300 x1875765421419008/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788869362 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788869346.467341:0:3285:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94c82d042300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3285:1875765421419008:0@lo:400: 00000100:00100000:0.0:1788869346.467366:0:7088:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94c803fb9500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:121cd5bc-7f07-4cf7-8e2e-4356c89c0696:7088:1875765421418752:0@lo:502: 00000020:01000000:0.0:1788869346.467396:0:7088:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788869346.467404:0:7088:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788869346.467406:0:7088:0:(obd_config.c:1561:class_process_config()) marker 15 (0x2) lustre sys.timeout 00000040:00080000:0.0:1788869346.467411:0:7088:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 25 count 25 00000004:00080000:3.0:1788869346.467454:0:7093:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000020:01000000:0.0:1788869346.467550:0:5752:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 16-24 (rc=0) 10000000:01000000:0.0:1788869346.467582:0:5752:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.139@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:0.0:1788869346.467593:0:5752:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.139@tcp lock: ffff94c8421f2a00/0x3d2d1916761d629f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x3d2d1916761d62a6 expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869346.467616:0:5752:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.139@tcp lock: ffff94c8421f2a00/0x3d2d1916761d629f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x3d2d1916761d62a6 expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788869346.467628:0:5752:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:0.0:1788869346.467631:0:5752:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-sptlrpc-ffff94c81f1a99c0 from 1 10000000:01000000:0.0:1788869346.467635:0:5752:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1788869346.467663:0:5752:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.139@tcp lock: ffff94c818d1e200/0x3d2d1916761d62c9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869346.467671:0:5752:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.139@tcp lock: ffff94c818d1e200/0x3d2d1916761d62c9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869346.467681:0:5752:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.139@tcp lock: ffff94c818d1e200/0x3d2d1916761d62c9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788869346.467696:0:5752:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94c8349ec380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:121cd5bc-7f07-4cf7-8e2e-4356c89c0696:5752:1875765421419136:0@lo:101: 00000100:00100000:0.0:1788869346.467725:0:5752:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869346.467751:0:5752:0:(client.c:2702:ptlrpc_set_wait()) set ffff94c805068cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788869346.467766:0:5749:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765421419136 00000100:00100000:0.0:1788869346.467769:0:5749:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765421419136 00000100:00100000:0.0:1788869346.467790:0:5749:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1788869346.467795:0:5749:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c810e11050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:121cd5bc-7f07-4cf7-8e2e-4356c89c0696+15:5752:x1875765421419136:12345-0@lo:101: 00010000:00010000:0.0:1788869346.467803:0:5749:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788869346.467818:0:5749:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff94c818d1f000/0x3d2d1916761d62d0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x3d2d1916761d62c9 expref: -99 pid: 5749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869346.467840:0:5749:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff94c818d1f000/0x3d2d1916761d62d0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3d2d1916761d62c9 expref: 16 pid: 5749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869346.467861:0:5749:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff94c818d1f000/0x3d2d1916761d62d0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3d2d1916761d62c9 expref: 16 pid: 5749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869346.467871:0:5749:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94c818d1f000, rc 0) 00000100:00100000:0.0:1788869346.467897:0:5749:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c810e11050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:121cd5bc-7f07-4cf7-8e2e-4356c89c0696+16:5752:x1875765421419136:12345-0@lo:101: Request processed in 101us (171us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869346.467903:0:5749:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1788869346.467932:0:5752:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94c8349ec380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:121cd5bc-7f07-4cf7-8e2e-4356c89c0696:5752:1875765421419136:0@lo:101: 00010000:00010000:0.0:1788869346.467944:0:5752:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.139@tcp lock: ffff94c818d1e200/0x3d2d1916761d62c9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x3d2d1916761d62d0 expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869346.467953:0:5752:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.139@tcp lock: ffff94c818d1e200/0x3d2d1916761d62c9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x3d2d1916761d62d0 expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788869346.467991:0:5752:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94c8349ec380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:121cd5bc-7f07-4cf7-8e2e-4356c89c0696:5752:1875765421419264:0@lo:501: 00000100:00100000:0.0:1788869346.468011:0:5752:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869346.468024:0:5752:0:(client.c:2702:ptlrpc_set_wait()) set ffff94c805068cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788869346.468034:0:5748:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765421419264 00000100:00100000:0.0:1788869346.468037:0:5748:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765421419264 00000100:00100000:0.0:1788869346.468056:0:5748:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1788869346.468061:0:5748:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c810e10450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:121cd5bc-7f07-4cf7-8e2e-4356c89c0696+16:5752:x1875765421419264:12345-0@lo:501: 00000100:00100000:0.0:1788869346.468322:0:5748:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c810e10450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:121cd5bc-7f07-4cf7-8e2e-4356c89c0696+16:5752:x1875765421419264:12345-0@lo:501: Request processed in 260us (309us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788869346.468330:0:5748:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1788869346.468358:0:5752:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94c8349ec380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:121cd5bc-7f07-4cf7-8e2e-4356c89c0696:5752:1875765421419264:0@lo:501: 10000000:01000000:0.0:1788869346.468373:0:5752:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.139@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:0.0:1788869346.468382:0:5752:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.139@tcp lock: ffff94c818d1e200/0x3d2d1916761d62c9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x3d2d1916761d62d0 expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869346.468389:0:5752:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.139@tcp lock: ffff94c818d1e200/0x3d2d1916761d62c9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x3d2d1916761d62d0 expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1788869346.468568:0:5751:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00080000:3.0:1788869346.469020:0:7093:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 94760769067ns, next at 0ns, rc = 0 00000004:00080000:0.0:1788869346.506635:0:7094:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x100000000:0x1:0x0] 00000100:00100000:0.0:1788869346.506715:0:3286:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94c8349ec380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3286:1875765421419392:0@lo:13: 00000100:00100000:0.0:1788869346.506803:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869346.506894:0:7094:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94c8349ec000 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:7094:1875765421419520:0@lo:7: 00000100:00100000:3.0:1788869346.506920:0:6548:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765421419392 00000100:00100000:0.0:1788869346.506921:0:7094:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869346.506932:0:6548:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765421419392 00000100:00100000:0.0:1788869346.506940:0:7094:0:(client.c:2702:ptlrpc_set_wait()) set ffff94c805068540 going to sleep for 11 seconds 00000100:00100000:0.0:1788869346.506964:0:6547:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765421419520 00000100:00100000:0.0:1788869346.506968:0:6547:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765421419520 00000100:00100000:3.0:1788869346.507000:0:6548:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788869346.507006:0:6547:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788869346.507013:0:6548:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c8349ef480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3286:x1875765421419392:12345-0@lo:13: 00000100:00100000:0.0:1788869346.507018:0:6547:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c8349edc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:7094:x1875765421419520:12345-0@lo:7: 00002000:00000024:3.0:1788869346.507054:0:6548:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3860856832 avail 3858759680 00000100:00100000:3.0:1788869346.507110:0:6548:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c8349ef480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3286:x1875765421419392:12345-0@lo:13: Request processed in 101us (307us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869346.507118:0:6548:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:2.0:1788869346.508635:0:5751:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1788869346.514005:0:3286:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff94c8349ec380 x1875765421419392/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788869362 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788869346.514041:0:3286:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94c8349ec380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3286:1875765421419392:0@lo:13: 00002000:00080000:0.0:1788869346.515660:0:6547:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x0 00002000:00080000:0.0:1788869346.515670:0:6547:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x100000000:0x0:0x0] 00000100:00100000:0.0:1788869346.515788:0:6547:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c8349edc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:7094:x1875765421419520:12345-0@lo:7: Request processed in 8769us (8862us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869346.515802:0:6547:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1788869346.515862:0:7094:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff94c8349ec000 x1875765421419520/t0(0) o7->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1788869362 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788869346.515877:0:7094:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94c8349ec000 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:7094:1875765421419520:0@lo:7: 00000004:00080000:0.0:1788869346.515899:0:7094:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0000: Got last_fid [0x100000000:0x0:0x0] 00000100:00100000:0.0:1788869346.515953:0:7094:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94c8349ec000 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:7094:1875765421419648:0@lo:5: 00000100:00100000:0.0:1788869346.515993:0:7094:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869346.516047:0:7094:0:(client.c:2702:ptlrpc_set_wait()) set ffff94c805068540 going to sleep for 11 seconds 00000100:00100000:0.0:1788869346.516065:0:6547:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765421419648 00000100:00100000:0.0:1788869346.516072:0:6547:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765421419648 00000100:00100000:0.0:1788869346.516125:0:6546:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788869346.516135:0:6546:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c8349ec380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:7094:x1875765421419648:12345-0@lo:5: 00002000:00080000:0.0:1788869346.516166:0:6546:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:0.0:1788869346.516170:0:6546:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 1 objects in group 0x0 at 1 00000100:00100000:0.0:1788869346.516442:0:6546:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c8349ec380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:7094:x1875765421419648:12345-0@lo:5: Request processed in 308us (449us total) trans 4294967297 rc 0/0 00000100:00100000:0.0:1788869346.516450:0:6546:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:0.0:1788869346.516478:0:7094:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff94c8349ec000 x1875765421419648/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788869362 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788869346.516491:0:7094:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94c8349ec000 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:7094:1875765421419648:0@lo:5: 00000004:00080000:0.0:1788869346.516500:0:7094:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x100000000:0x1:0x0] from OST, last_created [0x100000000:0x1:0x0]last_used is [0x100000000:0x1:0x0] 00000100:00100000:0.0:1788869346.516540:0:7094:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94c8349ed880 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:7094:1875765421419776:0@lo:700: 00000100:00100000:0.0:1788869346.516567:0:7094:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869346.516587:0:7094:0:(client.c:2702:ptlrpc_set_wait()) set ffff94c805068540 going to sleep for 11 seconds 00000100:00100000:0.0:1788869346.516606:0:6553:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765421419776 00000100:00100000:0.0:1788869346.516609:0:6553:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765421419776 00000100:00100000:0.0:1788869346.516633:0:6553:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788869346.516638:0:6553:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c8349ef800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+7:7094:x1875765421419776:12345-0@lo:700: 00000100:00100000:0.0:1788869346.516666:0:6553:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94c8349ece00 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:6553:1875765421419904:0@lo:700: 00000100:00100000:0.0:1788869346.516692:0:6553:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869346.516716:0:6553:0:(client.c:2702:ptlrpc_set_wait()) set ffff94c805068180 going to sleep for 11 seconds 00000100:00100000:0.0:1788869346.516750:0:5762:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765421419904 00000100:00100000:0.0:1788869346.516753:0:5762:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765421419904 00000100:00100000:0.0:1788869346.516777:0:5762:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788869346.516782:0:5762:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c8349eca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:6553:x1875765421419904:12345-0@lo:700: 00000004:00080000:1.0:1788869346.539924:0:5777:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 40000000:02000000:2.0:1788869346.561729:0:5762:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:0:ost 00000100:00100000:3.0:1788869346.565860:0:5762:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c8349eca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:6553:x1875765421419904:12345-0@lo:700: Request processed in 49063us (49152us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869346.565889:0:5762:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:0.0:1788869346.566343:0:6553:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff94c8349ece00 x1875765421419904/t0(0) o700->lustre-MDT0000-lwp-OST0000@0@lo:32/10 lens 264/248 e 0 to 0 dl 1788869362 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788869346.566368:0:6553:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94c8349ece00 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:6553:1875765421419904:0@lo:700: 40000000:02000000:0.0:1788869346.566385:0:6553:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0000-super: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:0:ost] 00000001:00080000:1.0:1788869346.624604:0:6571:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967297 is committed 00000001:00100000:1.0:1788869346.624625:0:6571:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:0.0:1788869346.624738:0:6553:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c8349ef800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:7094:x1875765421419776:12345-0@lo:700: Request processed in 108092us (108163us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869346.624755:0:6553:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:1.0:1788869346.624769:0:7094:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff94c8349ed880 x1875765421419776/t0(0) o700->lustre-OST0000-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1788869362 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788869346.624781:0:7094:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:1.0:1788869346.624801:0:7094:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94c8349ed880 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:7094:1875765421419776:0@lo:700: 00000004:02000040:1.0:1788869346.663301:0:7094:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x240000400 00000100:00100000:1.0:1788869346.667290:0:7094:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94c81f1f2300 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:7094:1875765421420032:0@lo:5: 00000100:00100000:1.0:1788869346.667365:0:7094:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869346.667424:0:7094:0:(client.c:2702:ptlrpc_set_wait()) set ffff94c8050fed80 going to sleep for 11 seconds 00000100:00100000:0.0:1788869346.667606:0:6546:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765421420032 00000100:00100000:0.0:1788869346.667619:0:6546:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765421420032 00000100:00100000:0.0:1788869346.667693:0:6546:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788869346.667704:0:6546:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c81f1f1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:7094:x1875765421420032:12345-0@lo:5: 00002000:00080000:1.0:1788869346.676775:0:6546:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x240000400 00002000:00080000:1.0:1788869346.676799:0:6546:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x240000400 at 2 00000100:00100000:1.0:1788869346.681242:0:6546:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c81f1f1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:7094:x1875765421420032:12345-0@lo:5: Request processed in 13532us (13868us total) trans 4294967298 rc 0/0 00000100:00100000:1.0:1788869346.681302:0:6546:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:0.0:1788869346.681362:0:7094:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff94c81f1f2300 x1875765421420032/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788869362 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788869346.681386:0:7094:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94c81f1f2300 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:7094:1875765421420032:0@lo:5: 00000004:00080000:0.0:1788869346.681407:0:7094:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x240000400:0x1:0x0]-[0x240000400:0x21:0x0] 00010000:00010000:3.0:1788869346.715541:0:5743:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1788869346.729573:0:6571:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967298 is committed 00010000:00010000:2.0:1788869347.740063:0:5742:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788869348.764507:0:5743:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788869349.787393:0:5742:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1788869350.006141:0:7440:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1788869350.006147:0:7440:0:(obd_mount.c:926:lmd_print()) device: lustre-ost2/ost2 00000080:01200004:3.0:1788869350.006549:0:7440:0:(super25.c:130:lustre_fill_super()) VFS Op: sb ffff94c83f970800 00000020:01000004:3.0:1788869350.006571:0:7440:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-OST0001, type=osd-zfs, lsifl=200062, mountfl=0 00000020:01000004:3.0:1788869350.006586:0:7440:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-zfs) 00000020:00000080:3.0:1788869350.006602:0:7440:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff94c8356cb380) 00000020:00000080:3.0:1788869350.006622:0:7440:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type osd-zfs with refcount 2 00100000:10000000:3.0:1788869350.019892:0:7440:0:(scrub.c:229:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00100000:10000000:3.0:1788869350.020181:0:7440:0:(scrub.c:229:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00100000:10000000:3.0:1788869350.037707:0:7440:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:2.0:1788869350.042297:0:7440:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:2.0:1788869350.042338:0:7440:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:2.0:1788869350.042403:0:7440:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:2.0:1788869350.042429:0:7440:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:2.0:1788869350.042959:0:7440:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:2.0:1788869350.042973:0:7440:0:(osd_handler.c:1569:osd_obd_connect()) connect #0 00000020:00000080:2.0:1788869350.042992:0:7440:0:(genops.c:1406:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x3d2d1916761d62de 00000020:01000004:2.0:1788869350.043002:0:7440:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-OST0001 on device lustre-ost2/ost2 00000020:01000004:2.0:1788869350.043029:0:7440:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.201.139@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1788869350.043034:0:7440:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.201.139@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1788869350.043041:0:7440:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0001 00000020:01000004:2.0:1788869350.043066:0:7440:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost2/ost2 10000000:01000000:2.0:1788869350.043071:0:7440:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.201.139@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:2.0:1788869350.061401:0:7440:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.201.139@tcp ctxt 0 is initialized 00000020:01000004:2.0:1788869350.061458:0:7440:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.201.139@tcp, index=0001, flags=0x20062 00000020:01000004:2.0:1788869350.061463:0:7440:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1788869350.061465:0:7440:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1788869350.061466:0:7440:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788869350.061467:0:7440:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788869350.061468:0:7440:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788869350.061469:0:7440:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788869350.061471:0:7440:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788869350.061476:0:7440:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1788869350.061477:0:7440:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1788869350.061479:0:7440:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788869350.061481:0:7440:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1788869350.061486:0:7440:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020062 00000020:01000004:2.0:1788869350.061488:0:7440:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1788869350.061489:0:7440:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1788869350.061490:0:7440:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788869350.061491:0:7440:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788869350.061491:0:7440:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788869350.061492:0:7440:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788869350.061493:0:7440:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788869350.061494:0:7440:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1788869350.061495:0:7440:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1788869350.061495:0:7440:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788869350.061496:0:7440:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1788869350.061530:0:7440:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:2.0:1788869350.061556:0:7440:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94c803fbad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:121cd5bc-7f07-4cf7-8e2e-4356c89c0696:7440:1875765421420160:0@lo:253: 00000100:00100000:2.0:1788869350.061651:0:7440:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869350.061727:0:7440:0:(client.c:2702:ptlrpc_set_wait()) set ffff94c81828a840 going to sleep for 11 seconds 00000100:00100000:0.0:1788869350.062152:0:5750:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765421420160 00000100:00100000:0.0:1788869350.062162:0:5750:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765421420160 00000100:00100000:0.0:1788869350.062224:0:5750:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1788869350.062235:0:5750:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c81f14e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:121cd5bc-7f07-4cf7-8e2e-4356c89c0696+16:7440:x1875765421420160:12345-0@lo:253: 20000000:01000000:0.0:1788869350.062304:0:5750:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:0.0:1788869350.062316:0:5750:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0001, index=1 20000000:01000000:0.0:1788869350.062323:0:5750:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-OST0001 to 1 20000000:01000000:0.0:1788869350.062327:0:5750:0:(mgs_llog.c:3858:mgs_write_log_ost()) writing new ost lustre-OST0001 00000040:00080000:0.0:1788869350.063549:0:5750:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788869350.063779:0:5750:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 20000000:01000000:0.0:1788869350.063797:0:5750:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001 0xcf001 obdfilter lustre-OST0001_UUID (null) (null) 00000040:00080000:0.0:1788869350.063837:0:5750:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 128 off8544 20000000:01000000:0.0:1788869350.063845:0:5750:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001 0xcf003 dev type f (null) 00000040:00080000:0.0:1788869350.063877:0:5750:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 112 off8656 00000040:00080000:0.0:1788869350.063926:0:5750:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8880 00000040:00080000:0.0:1788869350.064485:0:5750:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 224 off12648 20000000:01000000:0.0:1788869350.064506:0:5750:0:(mgs_llog.c:3811:mgs_write_log_osc_to_lov()) add nid 192.168.201.139@tcp 20000000:01000000:0.0:1788869350.064508:0:5750:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.201.139@tcp (null) (null) (null) 00000040:00080000:0.0:1788869350.064541:0:5750:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 88 off12736 20000000:01000000:0.0:1788869350.064549:0:5750:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:0.0:1788869350.064596:0:5750:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 144 off12880 20000000:01000000:0.0:1788869350.064604:0:5750:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf003 lustre-OST0001_UUID 192.168.201.139@tcp (null) (null) 00000040:00080000:0.0:1788869350.064639:0:5750:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 152 off13032 20000000:01000000:0.0:1788869350.064649:0:5750:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:0.0:1788869350.064681:0:5750:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 136 off13168 00000040:00080000:0.0:1788869350.064729:0:5750:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13392 00000040:00080000:0.0:1788869350.065524:0:5750:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].30, 224 off13416 20000000:01000000:0.0:1788869350.065538:0:5750:0:(mgs_llog.c:3811:mgs_write_log_osc_to_lov()) add nid 192.168.201.139@tcp 20000000:01000000:0.0:1788869350.065539:0:5750:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.201.139@tcp (null) (null) (null) 00000040:00080000:0.0:1788869350.065564:0:5750:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].31, 88 off13504 20000000:01000000:0.0:1788869350.065571:0:5750:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:0.0:1788869350.065600:0:5750:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].32, 128 off13632 20000000:01000000:0.0:1788869350.065608:0:5750:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc 0xcf003 lustre-OST0001_UUID 192.168.201.139@tcp (null) (null) 00000040:00080000:0.0:1788869350.065641:0:5750:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].33, 144 off13776 20000000:01000000:0.0:1788869350.065650:0:5750:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:0.0:1788869350.065696:0:5750:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].34, 128 off13904 00000040:00080000:0.0:1788869350.065731:0:5750:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].35, 224 off14128 20000000:01000000:0.0:1788869350.065757:0:5750:0:(mgs_llog.c:5248:mgs_write_log_target()) remaining string: ' autodegrade=on ', param: 'sys.timeout=20' 20000000:01000000:0.0:1788869350.065760:0:5750:0:(mgs_llog.c:4744:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:0.0:1788869350.065765:0:5750:0:(mgs_llog.c:4177:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:0.0:1788869350.065779:0:5750:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:0.0:1788869350.065781:0:5750:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:0.0:1788869350.065820:0:5750:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:0.0:1788869350.065823:0:5750:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:0.0:1788869350.066595:0:7443:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 27 marker 14 1->4: lustre sys.timeout 20000000:01000000:0.0:1788869350.066649:0:7443:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 29 marker 14 2->4: lustre sys.timeout 00000040:00080000:0.0:1788869350.066703:0:7443:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 36 count 36 00000040:00080000:3.0:1788869350.067031:0:5750:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].36, 224 off14352 00000040:00080000:3.0:1788869350.067079:0:5750:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].37, 80 off14432 00000040:00080000:3.0:1788869350.067137:0:5750:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].38, 224 off14656 20000000:01000000:3.0:1788869350.067154:0:5750:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:3.0:1788869350.067156:0:5750:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:0.0:1788869350.067675:0:7444:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 22 marker 15 1->4: lustre sys.timeout 20000000:01000000:0.0:1788869350.067736:0:7444:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 24 marker 15 2->4: lustre sys.timeout 00000040:00080000:0.0:1788869350.067791:0:7444:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 31 count 31 00000040:00080000:3.0:1788869350.068007:0:5750:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 224 off13616 00000040:00080000:3.0:1788869350.068044:0:5750:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 80 off13696 00000040:00080000:3.0:1788869350.068099:0:5750:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 224 off13920 20000000:01000000:3.0:1788869350.068111:0:5750:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:3.0:1788869350.068113:0:5750:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0001/lustre/sys.timeout fl=4 00000040:00080000:0.0:1788869350.068627:0:7445:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 5 count 5 00000040:00080000:3.0:1788869350.068813:0:5750:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9104 00000040:00080000:3.0:1788869350.068851:0:5750:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 80 off9184 00000040:00080000:3.0:1788869350.068910:0:5750:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 224 off9408 20000000:01000000:3.0:1788869350.068924:0:5750:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:3.0:1788869350.068926:0:5750:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 20000000:01000000:0.0:1788869350.069638:0:7446:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 5 marker 16 1->4: lustre sys.timeout 20000000:01000000:0.0:1788869350.069718:0:7446:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 7 marker 16 2->4: lustre sys.timeout 00000040:00080000:0.0:1788869350.069750:0:7446:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 8 count 8 00000040:00080000:3.0:1788869350.069996:0:5750:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 224 off9632 00000040:00080000:3.0:1788869350.070028:0:5750:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 80 off9712 00000040:00080000:3.0:1788869350.070066:0:5750:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off9936 20000000:01000000:3.0:1788869350.070081:0:5750:0:(mgs_llog.c:5248:mgs_write_log_target()) remaining string: ' ', param: 'autodegrade=on' 20000000:01000000:3.0:1788869350.070084:0:5750:0:(mgs_llog.c:4744:mgs_write_log_param()) next param 'autodegrade=on' 10000000:01000000:3.0:1788869350.070094:0:5750:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:3.0:1788869350.070117:0:5750:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff94c81a582c00/0x3d2d1916761d62e5 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869350.070138:0:5750:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff94c81a583000/0x3d2d1916761d6236 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3d2d1916761d622f expref: 16 pid: 5749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869350.070146:0:5750:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff94c818d1ec00/0x3d2d1916761d6260 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3d2d1916761d6259 expref: 16 pid: 5750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869350.070160:0:5750:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff94c81a582a00/0x3d2d1916761d628a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3d2d1916761d6283 expref: 16 pid: 5748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869350.070180:0:5750:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff94c80153ba00/0x3d2d1916761d62a6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3d2d1916761d629f expref: 16 pid: 5749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869350.070187:0:5750:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff94c818d1f000/0x3d2d1916761d62d0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3d2d1916761d62c9 expref: 16 pid: 5749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869350.070195:0:5750:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff94c81a582c00/0x3d2d1916761d62e5 lrc: 8/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869350.070281:0:5750:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff94c818d1f000/0x3d2d1916761d62d0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x3d2d1916761d62c9 expref: 16 pid: 5749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869350.070392:0:5750:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff94c818d1f000/0x3d2d1916761d62d0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x3d2d1916761d62c9 expref: 16 pid: 5749 timeout: 248 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788869350.070410:0:5750:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94c82d043b80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5750:1875765421420288:0@lo:104: 00000100:00100000:3.0:1788869350.070513:0:5750:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788869350.070626:0:5750:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff94c80153ba00/0x3d2d1916761d62a6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x3d2d1916761d629f expref: 16 pid: 5749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869350.070635:0:5750:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff94c80153ba00/0x3d2d1916761d62a6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x3d2d1916761d629f expref: 16 pid: 5749 timeout: 248 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788869350.070644:0:5750:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94c82d040380 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5750:1875765421420416:0@lo:104: 00010000:00010000:3.0:1788869350.070669:0:5750:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff94c81a582a00/0x3d2d1916761d628a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x3d2d1916761d6283 expref: 16 pid: 5748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869350.070676:0:5750:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff94c81a582a00/0x3d2d1916761d628a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x3d2d1916761d6283 expref: 16 pid: 5748 timeout: 248 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788869350.070696:0:5750:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94c82d040000 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5750:1875765421420544:0@lo:104: 00010000:00010000:3.0:1788869350.070723:0:5750:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff94c818d1ec00/0x3d2d1916761d6260 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x3d2d1916761d6259 expref: 16 pid: 5750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869350.070731:0:5750:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff94c818d1ec00/0x3d2d1916761d6260 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x3d2d1916761d6259 expref: 16 pid: 5750 timeout: 248 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788869350.070740:0:5750:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94c82d043480 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5750:1875765421420672:0@lo:104: 00010000:00010000:3.0:1788869350.070762:0:5750:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff94c81a583000/0x3d2d1916761d6236 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x3d2d1916761d622f expref: 16 pid: 5749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869350.070771:0:5750:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff94c81a583000/0x3d2d1916761d6236 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x3d2d1916761d622f expref: 16 pid: 5749 timeout: 248 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788869350.070779:0:5750:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94c82d041c00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5750:1875765421420800:0@lo:104: 00000100:00100000:3.0:1788869350.070796:0:5750:0:(client.c:2702:ptlrpc_set_wait()) set ffff94c8205cd0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788869350.070853:0:5787:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:1.0:1788869350.070874:0:5787:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869350.070899:0:5787:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869350.070922:0:5787:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869350.070931:0:5787:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869350.070947:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765421420288 00000100:00100000:1.0:1788869350.070954:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765421420288 00000100:00100000:1.0:1788869350.070993:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765421420416 00000100:00100000:1.0:1788869350.070996:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765421420416 00000100:00100000:1.0:1788869350.071006:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765421420544 00000100:00100000:1.0:1788869350.071008:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765421420544 00000100:00100000:1.0:1788869350.071016:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765421420672 00000100:00100000:1.0:1788869350.071018:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765421420672 00000100:00100000:1.0:1788869350.071025:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765421420800 00000100:00100000:1.0:1788869350.071028:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765421420800 00000100:00100000:1.0:1788869350.071040:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788869350.071049:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c81f01c850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:121cd5bc-7f07-4cf7-8e2e-4356c89c0696+7:5750:x1875765421420288:12345-0@lo:104: 00010000:00010000:1.0:1788869350.071064:0:5787:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.139@tcp lock: ffff94c818d1e200/0x3d2d1916761d62c9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x3d2d1916761d62d0 expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869350.071136:0:5787:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788869350.071143:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c81f01c850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:121cd5bc-7f07-4cf7-8e2e-4356c89c0696+7:5750:x1875765421420288:12345-0@lo:104: Request processed in 95us (630us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869350.071150:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788869350.071190:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788869350.071196:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c81f1f3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:121cd5bc-7f07-4cf7-8e2e-4356c89c0696+6:5750:x1875765421420416:12345-0@lo:104: 00010000:00010000:1.0:1788869350.071203:0:5787:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.139@tcp lock: ffff94c8421f2a00/0x3d2d1916761d629f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x3d2d1916761d62a6 expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869350.071236:0:5787:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1788869350.071241:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c81f1f3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:121cd5bc-7f07-4cf7-8e2e-4356c89c0696+6:5750:x1875765421420416:12345-0@lo:104: Request processed in 46us (367us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869350.071284:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788869350.071313:0:5750:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94c82d043b80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5750:1875765421420288:0@lo:104: 00000100:00100000:2.0:1788869350.071337:0:5750:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94c82d040380 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5750:1875765421420416:0@lo:104: 00000100:00100000:3.0:1788869350.071482:0:5738:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788869350.071491:0:5738:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c81f1f0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:121cd5bc-7f07-4cf7-8e2e-4356c89c0696+5:5750:x1875765421420544:12345-0@lo:104: 00010000:00010000:3.0:1788869350.071503:0:5738:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.139@tcp lock: ffff94c818d1fe00/0x3d2d1916761d6283 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x3d2d1916761d628a expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869350.071546:0:5738:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:3.0:1788869350.071551:0:5738:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c81f1f0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:121cd5bc-7f07-4cf7-8e2e-4356c89c0696+5:5750:x1875765421420544:12345-0@lo:104: Request processed in 63us (651us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869350.071558:0:5738:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788869350.071561:0:5750:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94c82d040000 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5750:1875765421420544:0@lo:104: 00000100:00100000:3.0:1788869350.071571:0:5738:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788869350.071577:0:5738:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c81f1f0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:121cd5bc-7f07-4cf7-8e2e-4356c89c0696+4:5750:x1875765421420672:12345-0@lo:104: 00010000:00010000:3.0:1788869350.071590:0:5738:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.139@tcp lock: ffff94c81a582e00/0x3d2d1916761d6259 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x3d2d1916761d6260 expref: -99 pid: 6543 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869350.071629:0:5738:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:3.0:1788869350.071635:0:5738:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c81f1f0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:121cd5bc-7f07-4cf7-8e2e-4356c89c0696+4:5750:x1875765421420672:12345-0@lo:104: Request processed in 59us (712us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869350.071641:0:5738:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788869350.071654:0:5738:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788869350.071654:0:5750:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94c82d043480 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5750:1875765421420672:0@lo:104: 00000100:00100000:3.0:1788869350.071659:0:5738:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c81f1f3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:121cd5bc-7f07-4cf7-8e2e-4356c89c0696+3:5750:x1875765421420800:12345-0@lo:104: 00010000:00010000:3.0:1788869350.071667:0:5738:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.139@tcp lock: ffff94c818d1fc00/0x3d2d1916761d622f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x3d2d1916761d6236 expref: -99 pid: 6543 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869350.071706:0:5738:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to priority blp list, 5 blwis in pool 00000100:00100000:3.0:1788869350.071711:0:5738:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c81f1f3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:121cd5bc-7f07-4cf7-8e2e-4356c89c0696+3:5750:x1875765421420800:12345-0@lo:104: Request processed in 52us (779us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869350.071717:0:5738:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788869350.071723:0:5750:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94c82d041c00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5750:1875765421420800:0@lo:104: 00010000:00010000:2.0:1788869350.071756:0:5750:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff94c81a582c00/0x3d2d1916761d62e5 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869350.071770:0:5743:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:1.0:1788869350.071778:0:5743:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.139@tcp lock: ffff94c818d1e200/0x3d2d1916761d62c9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x3d2d1916761d62d0 expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869350.071786:0:5743:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94c818d1e200 already unused, calling callback (ffffffffc1ce9c20) 10000000:00010000:1.0:1788869350.071790:0:5743:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.139@tcp lock: ffff94c818d1e200/0x3d2d1916761d62c9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0x3d2d1916761d62d0 expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869350.071799:0:5743:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.139@tcp lock: ffff94c818d1e200/0x3d2d1916761d62c9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0x3d2d1916761d62d0 expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788869350.071807:0:5743:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.139@tcp lock: ffff94c818d1e200/0x3d2d1916761d62c9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0x3d2d1916761d62d0 expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788869350.071814:0:5743:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1788869350.071853:0:5743:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.139@tcp lock: ffff94c818d1e200/0x3d2d1916761d62c9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3d2d1916761d62d0 expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869350.071861:0:5743:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:3.0:1788869350.071909:0:3283:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94c81f1f3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:121cd5bc-7f07-4cf7-8e2e-4356c89c0696:3283:1875765421420928:0@lo:103: 00000100:00100000:3.0:1788869350.071942:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788869350.072000:0:5743:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.139@tcp lock: ffff94c818d1e200/0x3d2d1916761d62c9 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3d2d1916761d62d0 expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869350.072009:0:5743:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.139@tcp lock: ffff94c818d1e200/0x3d2d1916761d62c9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3d2d1916761d62d0 expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869350.072024:0:5743:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:1.0:1788869350.072028:0:5743:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.139@tcp lock: ffff94c8421f2a00/0x3d2d1916761d629f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x3d2d1916761d62a6 expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869350.072044:0:5743:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94c8421f2a00 already unused, calling callback (ffffffffc1ce9c20) 10000000:00010000:1.0:1788869350.072047:0:5743:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.139@tcp lock: ffff94c8421f2a00/0x3d2d1916761d629f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x3d2d1916761d62a6 expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869350.072054:0:5743:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.139@tcp lock: ffff94c8421f2a00/0x3d2d1916761d629f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x3d2d1916761d62a6 expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788869350.072061:0:5743:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.139@tcp lock: ffff94c8421f2a00/0x3d2d1916761d629f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x3d2d1916761d62a6 expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788869350.072067:0:5743:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1788869350.072086:0:5743:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.139@tcp lock: ffff94c8421f2a00/0x3d2d1916761d629f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3d2d1916761d62a6 expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869350.072092:0:5743:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:0.0:1788869350.072143:0:3284:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94c81f1f1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:121cd5bc-7f07-4cf7-8e2e-4356c89c0696:3284:1875765421421056:0@lo:103: 00000100:00100000:0.0:1788869350.072174:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788869350.072203:0:5742:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00000100:00100000:2.0:1788869350.072293:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765421420928 00000100:00100000:2.0:1788869350.072299:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765421420928 00010000:00010000:2.0:1788869350.072336:0:5788:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff94c818d1f000/0x3d2d1916761d62d0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3d2d1916761d62c9 expref: 17 pid: 5749 timeout: 248 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788869350.072378:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765421421056 00000100:00100000:2.0:1788869350.072382:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765421421056 00010000:00010000:2.0:1788869350.072396:0:5788:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff94c80153ba00/0x3d2d1916761d62a6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3d2d1916761d629f expref: 18 pid: 5749 timeout: 248 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788869350.072398:0:5740:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788869350.072407:0:5740:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c82d042d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:121cd5bc-7f07-4cf7-8e2e-4356c89c0696+18:3283:x1875765421420928:12345-0@lo:103: 00000100:00100000:2.0:1788869350.072410:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788869350.072415:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c8349ece00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:121cd5bc-7f07-4cf7-8e2e-4356c89c0696+18:3284:x1875765421421056:12345-0@lo:103: 00010000:00010000:0.0:1788869350.072419:0:5740:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788869350.072422:0:5788:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788869350.072424:0:5740:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff94c818d1f000/0x3d2d1916761d62d0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3d2d1916761d62c9 expref: 18 pid: 5749 timeout: 248 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869350.072425:0:5788:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff94c80153ba00/0x3d2d1916761d62a6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3d2d1916761d629f expref: 18 pid: 5749 timeout: 248 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869350.072436:0:5740:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff94c818d1f000/0x3d2d1916761d62d0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x3d2d1916761d62c9 expref: 18 pid: 5749 timeout: 248 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869350.072457:0:5788:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff94c80153ba00/0x3d2d1916761d62a6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x3d2d1916761d629f expref: 18 pid: 5749 timeout: 248 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869350.072531:0:5743:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.139@tcp lock: ffff94c8421f2a00/0x3d2d1916761d629f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3d2d1916761d62a6 expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869350.072539:0:5743:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.139@tcp lock: ffff94c8421f2a00/0x3d2d1916761d629f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3d2d1916761d62a6 expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869350.072549:0:5743:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788869350.072552:0:5743:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.139@tcp lock: ffff94c81a582e00/0x3d2d1916761d6259 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x3d2d1916761d6260 expref: -99 pid: 6543 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869350.072557:0:5743:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94c81a582e00 already unused, calling callback (ffffffffc1ce9c20) 10000000:00010000:1.0:1788869350.072560:0:5743:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.139@tcp lock: ffff94c81a582e00/0x3d2d1916761d6259 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x3d2d1916761d6260 expref: -99 pid: 6543 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869350.072575:0:5743:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.139@tcp lock: ffff94c81a582e00/0x3d2d1916761d6259 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x3d2d1916761d6260 expref: -99 pid: 6543 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788869350.072581:0:5743:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.139@tcp lock: ffff94c81a582e00/0x3d2d1916761d6259 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x3d2d1916761d6260 expref: -99 pid: 6543 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788869350.072585:0:5743:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1788869350.072661:0:5743:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.139@tcp lock: ffff94c81a582e00/0x3d2d1916761d6259 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3d2d1916761d6260 expref: -99 pid: 6543 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869350.072667:0:5743:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788869350.072682:0:5743:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.139@tcp lock: ffff94c81a582e00/0x3d2d1916761d6259 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3d2d1916761d6260 expref: -99 pid: 6543 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869350.072688:0:5743:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.139@tcp lock: ffff94c81a582e00/0x3d2d1916761d6259 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3d2d1916761d6260 expref: -99 pid: 6543 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869350.072699:0:5743:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788869350.072702:0:5743:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.139@tcp lock: ffff94c818d1fc00/0x3d2d1916761d622f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x3d2d1916761d6236 expref: -99 pid: 6543 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869350.072706:0:5743:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94c818d1fc00 already unused, calling callback (ffffffffc1ce9c20) 10000000:00010000:1.0:1788869350.072709:0:5743:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.139@tcp lock: ffff94c818d1fc00/0x3d2d1916761d622f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x3d2d1916761d6236 expref: -99 pid: 6543 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869350.072715:0:5743:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.139@tcp lock: ffff94c818d1fc00/0x3d2d1916761d622f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x3d2d1916761d6236 expref: -99 pid: 6543 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788869350.072721:0:5743:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.139@tcp lock: ffff94c818d1fc00/0x3d2d1916761d622f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x3d2d1916761d6236 expref: -99 pid: 6543 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788869350.072730:0:5743:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1788869350.072741:0:5743:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.139@tcp lock: ffff94c818d1fc00/0x3d2d1916761d622f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3d2d1916761d6236 expref: -99 pid: 6543 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869350.072747:0:5743:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788869350.072751:0:5743:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.139@tcp lock: ffff94c818d1fc00/0x3d2d1916761d622f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3d2d1916761d6236 expref: -99 pid: 6543 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869350.072757:0:5743:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.139@tcp lock: ffff94c818d1fc00/0x3d2d1916761d622f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3d2d1916761d6236 expref: -99 pid: 6543 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869350.072765:0:5743:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788869350.072767:0:5743:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788869350.072768:0:5743:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788869350.072777:0:3285:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94c81f1f2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:121cd5bc-7f07-4cf7-8e2e-4356c89c0696:3285:1875765421421184:0@lo:103: 00000100:00100000:1.0:1788869350.072803:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869350.072827:0:3285:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788869350.072831:0:3285:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94c81f1f1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:121cd5bc-7f07-4cf7-8e2e-4356c89c0696:3285:1875765421421312:0@lo:103: 00000100:00100000:1.0:1788869350.072848:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869350.072868:0:5741:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 4 min 3 max 56 00000100:00100000:1.0:1788869350.072875:0:5741:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_004' 00010000:00010000:0.0:1788869350.073082:0:5740:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff94c818d1f000/0x3d2d1916761d62d0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x3d2d1916761d62c9 expref: 18 pid: 5749 timeout: 248 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869350.073088:0:5788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff94c80153ba00/0x3d2d1916761d62a6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x3d2d1916761d629f expref: 18 pid: 5749 timeout: 248 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869350.073103:0:5788:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788869350.073106:0:5740:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788869350.073144:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c8349ece00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:121cd5bc-7f07-4cf7-8e2e-4356c89c0696+16:3284:x1875765421421056:12345-0@lo:103: Request processed in 727us (968us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869350.073152:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788869350.073166:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765421421184 00000100:00100000:3.0:1788869350.073168:0:3284:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94c81f1f1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:121cd5bc-7f07-4cf7-8e2e-4356c89c0696:3284:1875765421421056:0@lo:103: 00000100:00100000:2.0:1788869350.073169:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765421421184 00010000:00010000:2.0:1788869350.073181:0:5788:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff94c818d1ec00/0x3d2d1916761d6260 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3d2d1916761d6259 expref: 16 pid: 5750 timeout: 248 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788869350.073192:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765421421312 00000100:00100000:2.0:1788869350.073195:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765421421312 00010000:00010000:2.0:1788869350.073206:0:5788:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff94c81a583000/0x3d2d1916761d6236 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3d2d1916761d622f expref: 17 pid: 5749 timeout: 248 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788869350.073227:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788869350.073233:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c81f1f0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:121cd5bc-7f07-4cf7-8e2e-4356c89c0696+17:3285:x1875765421421184:12345-0@lo:103: 00010000:00010000:2.0:1788869350.073241:0:5788:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788869350.073245:0:5788:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff94c818d1ec00/0x3d2d1916761d6260 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3d2d1916761d6259 expref: 17 pid: 5750 timeout: 248 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869350.073274:0:5788:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff94c818d1ec00/0x3d2d1916761d6260 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x3d2d1916761d6259 expref: 17 pid: 5750 timeout: 248 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869350.073283:0:5788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff94c818d1ec00/0x3d2d1916761d6260 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x3d2d1916761d6259 expref: 17 pid: 5750 timeout: 248 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869350.073291:0:5788:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788869350.073374:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c81f1f0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:121cd5bc-7f07-4cf7-8e2e-4356c89c0696+16:3285:x1875765421421184:12345-0@lo:103: Request processed in 140us (568us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869350.073380:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788869350.073387:0:5740:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c82d042d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:121cd5bc-7f07-4cf7-8e2e-4356c89c0696+15:3283:x1875765421420928:12345-0@lo:103: Request processed in 982us (1444us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869350.073392:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788869350.073395:0:5740:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788869350.073397:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c81f1f2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:121cd5bc-7f07-4cf7-8e2e-4356c89c0696+15:3285:x1875765421421312:12345-0@lo:103: 00010000:00010000:2.0:1788869350.073404:0:5788:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788869350.073407:0:5788:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff94c81a583000/0x3d2d1916761d6236 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3d2d1916761d622f expref: 14 pid: 5749 timeout: 248 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869350.073416:0:5788:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff94c81a583000/0x3d2d1916761d6236 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x3d2d1916761d622f expref: 14 pid: 5749 timeout: 248 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788869350.073418:0:3283:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94c81f1f3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:121cd5bc-7f07-4cf7-8e2e-4356c89c0696:3283:1875765421420928:0@lo:103: 00010000:00010000:2.0:1788869350.073425:0:5788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff94c81a583000/0x3d2d1916761d6236 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x3d2d1916761d622f expref: 14 pid: 5749 timeout: 248 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869350.073458:0:5788:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788869350.073480:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c81f1f2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:121cd5bc-7f07-4cf7-8e2e-4356c89c0696+13:3285:x1875765421421312:12345-0@lo:103: Request processed in 83us (631us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869350.073486:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788869350.073527:0:3285:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94c81f1f2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:121cd5bc-7f07-4cf7-8e2e-4356c89c0696:3285:1875765421421184:0@lo:103: 00000100:00100000:3.0:1788869350.073539:0:3285:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94c81f1f1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:121cd5bc-7f07-4cf7-8e2e-4356c89c0696:3285:1875765421421312:0@lo:103: 00010000:00010000:3.0:1788869350.073920:0:7447:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788869350.073922:0:7447:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788869350.073924:0:7447:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788869350.073938:0:5742:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.139@tcp lock: ffff94c818d1fe00/0x3d2d1916761d6283 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x3d2d1916761d628a expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869350.073956:0:5742:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94c818d1fe00 already unused, calling callback (ffffffffc1ce9c20) 10000000:00010000:1.0:1788869350.073960:0:5742:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.139@tcp lock: ffff94c818d1fe00/0x3d2d1916761d6283 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x3d2d1916761d628a expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869350.073968:0:5742:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.139@tcp lock: ffff94c818d1fe00/0x3d2d1916761d6283 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x3d2d1916761d628a expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788869350.073974:0:5742:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.139@tcp lock: ffff94c818d1fe00/0x3d2d1916761d6283 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x3d2d1916761d628a expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788869350.073980:0:5742:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1788869350.074012:0:5742:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.139@tcp lock: ffff94c818d1fe00/0x3d2d1916761d6283 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3d2d1916761d628a expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869350.074018:0:5742:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788869350.074038:0:5742:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.139@tcp lock: ffff94c818d1fe00/0x3d2d1916761d6283 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3d2d1916761d628a expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869350.074045:0:5742:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.139@tcp lock: ffff94c818d1fe00/0x3d2d1916761d6283 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3d2d1916761d628a expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869350.074062:0:5742:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788869350.074064:0:5742:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788869350.074066:0:5742:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788869350.074071:0:3284:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788869350.074079:0:3284:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94c81f1f3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:121cd5bc-7f07-4cf7-8e2e-4356c89c0696:3284:1875765421421440:0@lo:103: 00000100:00100000:1.0:1788869350.074109:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869350.074141:0:5740:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765421421440 00000100:00100000:1.0:1788869350.074146:0:5740:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765421421440 00010000:00010000:1.0:1788869350.074168:0:5740:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff94c81a582a00/0x3d2d1916761d628a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3d2d1916761d6283 expref: 13 pid: 5748 timeout: 248 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788869350.074188:0:5740:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788869350.074194:0:5740:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c81f1f2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:121cd5bc-7f07-4cf7-8e2e-4356c89c0696+13:3284:x1875765421421440:12345-0@lo:103: 00010000:00010000:1.0:1788869350.074201:0:5740:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788869350.074205:0:5740:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff94c81a582a00/0x3d2d1916761d628a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3d2d1916761d6283 expref: 13 pid: 5748 timeout: 248 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869350.074215:0:5740:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff94c81a582a00/0x3d2d1916761d628a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x3d2d1916761d6283 expref: 13 pid: 5748 timeout: 248 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869350.074226:0:5740:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff94c81a582a00/0x3d2d1916761d628a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x3d2d1916761d6283 expref: 13 pid: 5748 timeout: 248 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869350.074240:0:5740:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff94c81a582c00/0x3d2d1916761d62e5 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869350.074268:0:5740:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff94c81a582c00/0x3d2d1916761d62e5 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869350.074284:0:5740:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff94c81a582c00/0x3d2d1916761d62e5 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869350.074292:0:5740:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff94c81a582c00/0x3d2d1916761d62e5 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869350.074299:0:5740:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff94c81a582c00/0x3d2d1916761d62e5 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869350.074306:0:5740:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff94c81a582c00/0x3d2d1916761d62e5 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869350.074321:0:5740:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94c81a582c00 already unused, calling callback (ffffffffc1703220) 00010000:00010000:1.0:1788869350.074326:0:5740:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff94c81a582c00/0x3d2d1916761d62e5 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869350.074334:0:5740:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff94c81a582c00/0x3d2d1916761d62e5 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869350.074350:0:5740:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff94c81a582c00/0x3d2d1916761d62e5 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869350.074360:0:5740:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788869350.074392:0:5740:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c81f1f2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:121cd5bc-7f07-4cf7-8e2e-4356c89c0696+12:3284:x1875765421421440:12345-0@lo:103: Request processed in 198us (282us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869350.074399:0:5740:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00010000:1.0:1788869350.074420:0:5750:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff94c81a582c00/0x3d2d1916761d62e5 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788869350.074429:0:3284:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94c81f1f3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:121cd5bc-7f07-4cf7-8e2e-4356c89c0696:3284:1875765421421440:0@lo:103: 00010000:00010000:1.0:1788869350.074429:0:5750:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff94c81a582c00/0x3d2d1916761d62e5 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869350.074435:0:5750:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff94c81a582c00/0x3d2d1916761d62e5 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1788869350.074460:0:5750:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:0.0:1788869350.101901:0:5750:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c81f14e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:121cd5bc-7f07-4cf7-8e2e-4356c89c0696+11:7440:x1875765421420160:12345-0@lo:253: Request processed in 39655us (40237us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869350.101919:0:5750:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1788869350.101923:0:7440:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94c803fbad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:121cd5bc-7f07-4cf7-8e2e-4356c89c0696:7440:1875765421420160:0@lo:253: 10000000:01000000:2.0:1788869350.101941:0:7440:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:2.0:1788869350.101945:0:7440:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1788869350.101947:0:7440:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1788869350.101948:0:7440:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788869350.101949:0:7440:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0001_UUID 00000020:01000004:2.0:1788869350.101951:0:7440:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788869350.101952:0:7440:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788869350.101954:0:7440:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788869350.101955:0:7440:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:2.0:1788869350.101958:0:7440:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788869350.101959:0:7440:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1788869350.101983:0:7440:0:(tgt_mount.c:101:server_register_mount()) register mount ffff94c83f970800 from lustre-OST0001 10000000:01000000:2.0:1788869350.102041:0:7440:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:2.0:1788869350.102045:0:7440:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:2.0:1788869350.102054:0:7440:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff94c81f1a99c0 local copy 10000000:01000000:2.0:1788869350.102060:0:7440:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1788869350.102107:0:7440:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.139@tcp lock: ffff94c80153ba00/0x3d2d1916761d62ec lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869350.102120:0:7440:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.201.139@tcp lock: ffff94c80153ba00/0x3d2d1916761d62ec lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869350.102131:0:7440:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.139@tcp lock: ffff94c80153ba00/0x3d2d1916761d62ec lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788869350.102154:0:7440:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94c803fbad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:121cd5bc-7f07-4cf7-8e2e-4356c89c0696:7440:1875765421421568:0@lo:101: 00000100:00100000:2.0:1788869350.102203:0:7440:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869350.102268:0:7440:0:(client.c:2702:ptlrpc_set_wait()) set ffff94c81828af00 going to sleep for 11 seconds 00000100:00100000:0.0:1788869350.102357:0:5749:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765421421568 00000100:00100000:0.0:1788869350.102372:0:5749:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765421421568 00000100:00100000:0.0:1788869350.102420:0:5749:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1788869350.102430:0:5749:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c81f14ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:121cd5bc-7f07-4cf7-8e2e-4356c89c0696+11:7440:x1875765421421568:12345-0@lo:101: 00010000:00010000:0.0:1788869350.102454:0:5749:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788869350.102472:0:5749:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff94c818d1f000/0x3d2d1916761d62f3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x3d2d1916761d62ec expref: -99 pid: 5749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869350.102500:0:5749:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff94c818d1f000/0x3d2d1916761d62f3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3d2d1916761d62ec expref: 12 pid: 5749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869350.102512:0:5749:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff94c818d1f000/0x3d2d1916761d62f3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3d2d1916761d62ec expref: 12 pid: 5749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869350.102521:0:5749:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94c818d1f000, rc 0) 00000100:00100000:0.0:1788869350.102559:0:5749:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c81f14ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:121cd5bc-7f07-4cf7-8e2e-4356c89c0696+12:7440:x1875765421421568:12345-0@lo:101: Request processed in 131us (357us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869350.102566:0:5749:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1788869350.102589:0:7440:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94c803fbad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:121cd5bc-7f07-4cf7-8e2e-4356c89c0696:7440:1875765421421568:0@lo:101: 00010000:00010000:2.0:1788869350.102602:0:7440:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.139@tcp lock: ffff94c80153ba00/0x3d2d1916761d62ec lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x3d2d1916761d62f3 expref: -99 pid: 7440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869350.102612:0:7440:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.139@tcp lock: ffff94c80153ba00/0x3d2d1916761d62ec lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x3d2d1916761d62f3 expref: -99 pid: 7440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788869350.102715:0:7440:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94c803fbad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:121cd5bc-7f07-4cf7-8e2e-4356c89c0696:7440:1875765421421696:0@lo:501: 00000100:00100000:2.0:1788869350.102743:0:7440:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869350.102771:0:7440:0:(client.c:2702:ptlrpc_set_wait()) set ffff94c81828af00 going to sleep for 11 seconds 00000100:00100000:0.0:1788869350.103366:0:5750:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765421421696 00000100:00100000:0.0:1788869350.103372:0:5750:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765421421696 00000100:00100000:0.0:1788869350.103408:0:5750:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1788869350.103416:0:5750:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c81f14f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:121cd5bc-7f07-4cf7-8e2e-4356c89c0696+12:7440:x1875765421421696:12345-0@lo:501: 00000100:00100000:0.0:1788869350.103666:0:5750:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c81f14f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:121cd5bc-7f07-4cf7-8e2e-4356c89c0696+12:7440:x1875765421421696:12345-0@lo:501: Request processed in 250us (921us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788869350.103688:0:5750:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1788869350.103871:0:7440:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94c803fbad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:121cd5bc-7f07-4cf7-8e2e-4356c89c0696:7440:1875765421421696:0@lo:501: 10000000:01000000:2.0:1788869350.103888:0:7440:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.201.139@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:2.0:1788869350.103919:0:7440:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.201.139@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:2.0:1788869350.103926:0:7440:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.139@tcp lock: ffff94c80153ba00/0x3d2d1916761d62ec lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x3d2d1916761d62f3 expref: -99 pid: 7440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869350.103937:0:7440:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.139@tcp lock: ffff94c80153ba00/0x3d2d1916761d62ec lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x3d2d1916761d62f3 expref: -99 pid: 7440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869350.103945:0:7440:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.139@tcp lock: ffff94c80153ba00/0x3d2d1916761d62ec lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x3d2d1916761d62f3 expref: -99 pid: 7440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869350.104018:0:7440:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1788869350.104042:0:7440:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff94c83f970800 10000000:01000000:2.0:1788869350.104047:0:7440:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1788869350.104053:0:7440:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:2.0:1788869350.104062:0:7440:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1788869350.104066:0:7440:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:2.0:1788869350.104069:0:7440:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:2.0:1788869350.104092:0:7440:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.139@tcp lock: ffff94c80153ae00/0x3d2d1916761d62fa lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869350.104101:0:7440:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.139@tcp lock: ffff94c80153ae00/0x3d2d1916761d62fa lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869350.104110:0:7440:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.139@tcp lock: ffff94c80153ae00/0x3d2d1916761d62fa lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788869350.104125:0:7440:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94c803fbad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:121cd5bc-7f07-4cf7-8e2e-4356c89c0696:7440:1875765421421824:0@lo:101: 00000100:00100000:2.0:1788869350.104155:0:7440:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869350.104187:0:7440:0:(client.c:2702:ptlrpc_set_wait()) set ffff94c81828ae40 going to sleep for 11 seconds 00000100:00100000:0.0:1788869350.104374:0:5749:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765421421824 00000100:00100000:0.0:1788869350.104379:0:5749:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765421421824 00010000:00010000:1.0:1788869350.104398:0:5743:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788869350.104406:0:5743:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.139@tcp lock: ffff94c80153ba00/0x3d2d1916761d62ec lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0x3d2d1916761d62f3 expref: -99 pid: 7440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788869350.104413:0:5749:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00010000:00010000:1.0:1788869350.104415:0:5743:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94c80153ba00 already unused, calling callback (ffffffffc1ce9c20) 10000000:00010000:1.0:1788869350.104419:0:5743:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.139@tcp lock: ffff94c80153ba00/0x3d2d1916761d62ec lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0x3d2d1916761d62f3 expref: -99 pid: 7440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788869350.104420:0:5749:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c81f14f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:121cd5bc-7f07-4cf7-8e2e-4356c89c0696+12:7440:x1875765421421824:12345-0@lo:101: 00010000:00010000:0.0:1788869350.104429:0:5749:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788869350.104433:0:5743:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.139@tcp lock: ffff94c80153ba00/0x3d2d1916761d62ec lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x8400000000 nid: local remote: 0x3d2d1916761d62f3 expref: -99 pid: 7440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869350.104440:0:5749:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff94c818d1e600/0x3d2d1916761d6301 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x3d2d1916761d62fa expref: -99 pid: 5749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869350.104467:0:5749:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff94c818d1e600/0x3d2d1916761d6301 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3d2d1916761d62fa expref: 13 pid: 5749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869350.104478:0:5749:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff94c818d1e600/0x3d2d1916761d6301 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3d2d1916761d62fa expref: 13 pid: 5749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869350.104486:0:5749:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94c818d1e600, rc 0) 10000000:00010000:1.0:1788869350.104499:0:5743:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.139@tcp lock: ffff94c80153ba00/0x3d2d1916761d62ec lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x9400000000 nid: local remote: 0x3d2d1916761d62f3 expref: -99 pid: 7440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788869350.104507:0:5743:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:0.0:1788869350.104523:0:5749:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c81f14f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:121cd5bc-7f07-4cf7-8e2e-4356c89c0696+13:7440:x1875765421421824:12345-0@lo:101: Request processed in 103us (367us total) trans 0 rc 0/0 00010000:00010000:1.0:1788869350.104529:0:5743:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.139@tcp lock: ffff94c80153ba00/0x3d2d1916761d62ec lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x3d2d1916761d62f3 expref: -99 pid: 7440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788869350.104529:0:5749:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00010000:00010000:1.0:1788869350.104535:0:5743:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:2.0:1788869350.104591:0:7440:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94c803fbad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:121cd5bc-7f07-4cf7-8e2e-4356c89c0696:7440:1875765421421824:0@lo:101: 00010000:00010000:2.0:1788869350.104603:0:7440:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.139@tcp lock: ffff94c80153ae00/0x3d2d1916761d62fa lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x3d2d1916761d6301 expref: -99 pid: 7440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869350.104611:0:7440:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.139@tcp lock: ffff94c80153ae00/0x3d2d1916761d62fa lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x3d2d1916761d6301 expref: -99 pid: 7440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788869350.104671:0:7440:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94c803fbad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:121cd5bc-7f07-4cf7-8e2e-4356c89c0696:7440:1875765421422080:0@lo:501: 00000100:00100000:2.0:1788869350.104696:0:7440:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869350.104723:0:7440:0:(client.c:2702:ptlrpc_set_wait()) set ffff94c81828ae40 going to sleep for 11 seconds 00010000:00010000:1.0:1788869350.104773:0:5743:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.139@tcp lock: ffff94c80153ba00/0x3d2d1916761d62ec lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x3d2d1916761d62f3 expref: -99 pid: 7440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869350.104782:0:5743:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.139@tcp lock: ffff94c80153ba00/0x3d2d1916761d62ec lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x3d2d1916761d62f3 expref: -99 pid: 7440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788869350.104790:0:5750:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765421422080 00000100:00100000:0.0:1788869350.104794:0:5750:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765421422080 00010000:00010000:1.0:1788869350.104796:0:5743:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788869350.104798:0:5743:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788869350.104800:0:5743:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788869350.104819:0:5750:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1788869350.104825:0:5750:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c81f14dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:121cd5bc-7f07-4cf7-8e2e-4356c89c0696+13:7440:x1875765421422080:12345-0@lo:501: 00000100:00100000:3.0:1788869350.104898:0:3284:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94c81f1f1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:121cd5bc-7f07-4cf7-8e2e-4356c89c0696:3284:1875765421421952:0@lo:103: 00000100:00100000:3.0:1788869350.104933:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869350.104977:0:5739:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765421421952 00000100:00100000:3.0:1788869350.104981:0:5739:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765421421952 00000100:00100000:0.0:1788869350.104985:0:5750:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c81f14dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:121cd5bc-7f07-4cf7-8e2e-4356c89c0696+14:7440:x1875765421422080:12345-0@lo:501: Request processed in 160us (288us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869350.104992:0:5750:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1788869350.105012:0:5739:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788869350.105019:0:5739:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c82d041500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:121cd5bc-7f07-4cf7-8e2e-4356c89c0696+13:3284:x1875765421421952:12345-0@lo:103: 00010000:00010000:3.0:1788869350.105029:0:5739:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788869350.105044:0:5739:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff94c818d1f000/0x3d2d1916761d62f3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x3d2d1916761d62ec expref: 13 pid: 5749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869350.105053:0:5739:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788869350.105090:0:5739:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c82d041500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:121cd5bc-7f07-4cf7-8e2e-4356c89c0696+12:3284:x1875765421421952:12345-0@lo:103: Request processed in 71us (156us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869350.105097:0:5739:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788869350.105131:0:3284:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94c81f1f1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:121cd5bc-7f07-4cf7-8e2e-4356c89c0696:3284:1875765421421952:0@lo:103: 00000100:00100000:2.0:1788869350.105196:0:7440:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94c803fbad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:121cd5bc-7f07-4cf7-8e2e-4356c89c0696:7440:1875765421422080:0@lo:501: 00000100:00100000:2.0:1788869350.105221:0:7440:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94c803fbad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:121cd5bc-7f07-4cf7-8e2e-4356c89c0696:7440:1875765421422208:0@lo:503: 00000100:00100000:2.0:1788869350.105365:0:7440:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869350.105397:0:7440:0:(client.c:2702:ptlrpc_set_wait()) set ffff94c81828ae40 going to sleep for 11 seconds 00000100:00100000:0.0:1788869350.105416:0:5749:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765421422208 00000100:00100000:0.0:1788869350.105421:0:5749:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765421422208 00000100:00100000:0.0:1788869350.105455:0:5749:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1788869350.105462:0:5749:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c81f14e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:121cd5bc-7f07-4cf7-8e2e-4356c89c0696+12:7440:x1875765421422208:12345-0@lo:503: 00000100:00100000:0.0:1788869350.105630:0:5749:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c81f14e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:121cd5bc-7f07-4cf7-8e2e-4356c89c0696+12:7440:x1875765421422208:12345-0@lo:503: Request processed in 163us (259us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869350.105641:0:5749:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1788869350.105660:0:7440:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94c803fbad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:121cd5bc-7f07-4cf7-8e2e-4356c89c0696:7440:1875765421422208:0@lo:503: 00000040:00080000:2.0:1788869350.106027:0:7440:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1788869350.106096:0:7440:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94c803fbad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:121cd5bc-7f07-4cf7-8e2e-4356c89c0696:7440:1875765421422336:0@lo:502: 00000100:00100000:2.0:1788869350.106128:0:7440:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869350.106182:0:7440:0:(client.c:2702:ptlrpc_set_wait()) set ffff94c81828ae40 going to sleep for 11 seconds 00000100:00100000:1.0:1788869350.106219:0:5748:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765421422336 00000100:00100000:1.0:1788869350.106224:0:5748:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765421422336 00000100:00100000:1.0:1788869350.106368:0:5748:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1788869350.106377:0:5748:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c81f14cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:121cd5bc-7f07-4cf7-8e2e-4356c89c0696+12:7440:x1875765421422336:12345-0@lo:502: 00000100:00100000:1.0:1788869350.106615:0:5748:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c81f14cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:121cd5bc-7f07-4cf7-8e2e-4356c89c0696+12:7440:x1875765421422336:12345-0@lo:502: Request processed in 239us (485us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869350.106622:0:5748:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1788869350.106680:0:7440:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94c803fbad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:121cd5bc-7f07-4cf7-8e2e-4356c89c0696:7440:1875765421422336:0@lo:502: 00000040:00080000:2.0:1788869350.107020:0:7440:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:2.0:1788869350.107071:0:7440:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:2.0:1788869350.107104:0:7440:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:2.0:1788869350.107152:0:7440:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:2.0:1788869350.107191:0:7440:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:2.0:1788869350.107226:0:7440:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:2.0:1788869350.107404:0:7440:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94c803fbad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:121cd5bc-7f07-4cf7-8e2e-4356c89c0696:7440:1875765421422464:0@lo:502: 00000100:00100000:2.0:1788869350.107458:0:7440:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869350.107494:0:7440:0:(client.c:2702:ptlrpc_set_wait()) set ffff94c81828ae40 going to sleep for 11 seconds 00000100:00100000:0.0:1788869350.107509:0:5749:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765421422464 00000100:00100000:0.0:1788869350.107515:0:5749:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765421422464 00000100:00100000:0.0:1788869350.107553:0:5749:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1788869350.107561:0:5749:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c81f14f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:121cd5bc-7f07-4cf7-8e2e-4356c89c0696+12:7440:x1875765421422464:12345-0@lo:502: 00000100:00100000:0.0:1788869350.107717:0:5749:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c81f14f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:121cd5bc-7f07-4cf7-8e2e-4356c89c0696+12:7440:x1875765421422464:12345-0@lo:502: Request processed in 156us (272us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869350.107725:0:5749:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1788869350.107909:0:7440:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94c803fbad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:121cd5bc-7f07-4cf7-8e2e-4356c89c0696:7440:1875765421422464:0@lo:502: 00000040:00080000:2.0:1788869350.107986:0:7440:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:2.0:1788869350.107995:0:7440:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 7 count 8 00000020:01000000:2.0:1788869350.108633:0:7449:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1788869350.108643:0:7449:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-ost2/ost2 00000020:00000080:2.0:1788869350.108651:0:7449:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788869350.108654:0:7449:0:(obd_config.c:1561:class_process_config()) marker 17 (0x1) lustre-OST0001 add ost 00000020:00000080:2.0:1788869350.108660:0:7449:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1788869350.108678:0:7449:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff94c8060acd40) 00000020:00000080:2.0:1788869350.108706:0:7449:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type obdfilter with refcount 2 00000020:00000080:2.0:1788869350.108712:0:7449:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1788869350.108784:0:7449:0:(tgt_mount.c:153:server_get_mount()) get mount ffff94c83f970800 from lustre-OST0001, refs=2 00080000:01000000:2.0:1788869350.108792:0:7449:0:(osd_handler.c:1569:osd_obd_connect()) connect #1 00000020:00000080:2.0:1788869350.108805:0:7449:0:(genops.c:1406:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x3d2d1916761d630f 00010000:00010000:2.0:1788869350.113132:0:7449:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-3 is initialized 00000001:02000400:3.0:1788869350.113705:0:7449:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-OST0001: new disk, initializing 00000001:00000004:3.0:1788869350.116538:0:7449:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 0 40000000:02000000:3.0:1788869350.116886:0:7449:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0001: No data found on store. Initialize space. 00080000:10000000:3.0:1788869350.121235:0:7449:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000001:0x3:0x0] (8/8/3) registered 00080000:10000000:3.0:1788869350.122038:0:7449:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x3:0x0] (8/8/4) registered 00000020:00000080:3.0:1788869350.123436:0:7449:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:3.0:1788869350.123465:0:7449:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788869350.123474:0:7449:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788869350.123477:0:7449:0:(obd_config.c:1561:class_process_config()) marker 17 (0x2) lustre-OST0001 add ost 00000020:01000000:3.0:1788869350.123480:0:7449:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788869350.123485:0:7449:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788869350.123486:0:7449:0:(obd_config.c:1561:class_process_config()) marker 22 (0x1) lustre sys.timeout 00000020:00000080:3.0:1788869350.123490:0:7449:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1788869350.123492:0:7449:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1788869350.123550:0:7449:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788869350.123560:0:7449:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788869350.123562:0:7449:0:(obd_config.c:1561:class_process_config()) marker 22 (0x2) lustre sys.timeout 00000040:00080000:3.0:1788869350.123566:0:7449:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:0.0:1788869350.123661:0:7440:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-7 (rc=0) 10000000:01000000:0.0:1788869350.123691:0:7440:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.139@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:0.0:1788869350.123717:0:7440:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.139@tcp lock: ffff94c80153ae00/0x3d2d1916761d62fa lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3d2d1916761d6301 expref: -99 pid: 7440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869350.123732:0:7440:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.139@tcp lock: ffff94c80153ae00/0x3d2d1916761d62fa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3d2d1916761d6301 expref: -99 pid: 7440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788869350.123742:0:7440:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff94c83f970800 from 1 10000000:01000000:0.0:1788869350.123744:0:7440:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788869350.123791:0:7440:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.139@tcp lock: ffff94c818d1fa00/0x3d2d1916761d6316 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869350.123800:0:7440:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.139@tcp lock: ffff94c818d1fa00/0x3d2d1916761d6316 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869350.123821:0:7440:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.139@tcp lock: ffff94c818d1fa00/0x3d2d1916761d6316 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788869350.123852:0:7440:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94c8349ec700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:121cd5bc-7f07-4cf7-8e2e-4356c89c0696:7440:1875765421422592:0@lo:101: 00000100:00100000:0.0:1788869350.123938:0:7440:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869350.123990:0:7440:0:(client.c:2702:ptlrpc_set_wait()) set ffff94c818106f00 going to sleep for 11 seconds 00000100:00100000:1.0:1788869350.124002:0:5748:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765421422592 00000100:00100000:1.0:1788869350.124012:0:5748:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765421422592 00000100:00100000:1.0:1788869350.124077:0:5748:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1788869350.124087:0:5748:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c81f14c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:121cd5bc-7f07-4cf7-8e2e-4356c89c0696+12:7440:x1875765421422592:12345-0@lo:101: 00010000:00010000:1.0:1788869350.124104:0:5748:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788869350.124118:0:5748:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff94c8421f2a00/0x3d2d1916761d631d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x3d2d1916761d6316 expref: -99 pid: 5748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869350.124146:0:5748:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff94c8421f2a00/0x3d2d1916761d631d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3d2d1916761d6316 expref: 13 pid: 5748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869350.124157:0:5748:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff94c8421f2a00/0x3d2d1916761d631d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3d2d1916761d6316 expref: 13 pid: 5748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869350.124165:0:5748:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94c8421f2a00, rc 0) 00000100:00100000:1.0:1788869350.124216:0:5748:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c81f14c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:121cd5bc-7f07-4cf7-8e2e-4356c89c0696+13:7440:x1875765421422592:12345-0@lo:101: Request processed in 131us (278us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869350.124225:0:5748:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1788869350.124381:0:7440:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94c8349ec700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:121cd5bc-7f07-4cf7-8e2e-4356c89c0696:7440:1875765421422592:0@lo:101: 00010000:00010000:0.0:1788869350.124397:0:7440:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.139@tcp lock: ffff94c818d1fa00/0x3d2d1916761d6316 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x3d2d1916761d631d expref: -99 pid: 7440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869350.124408:0:7440:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.139@tcp lock: ffff94c818d1fa00/0x3d2d1916761d6316 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x3d2d1916761d631d expref: -99 pid: 7440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788869350.124510:0:7440:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94c8349ec700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:121cd5bc-7f07-4cf7-8e2e-4356c89c0696:7440:1875765421422720:0@lo:501: 00000100:00100000:0.0:1788869350.124536:0:7440:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869350.124565:0:7440:0:(client.c:2702:ptlrpc_set_wait()) set ffff94c818106f00 going to sleep for 11 seconds 00000100:00100000:1.0:1788869350.124904:0:5749:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765421422720 00000100:00100000:1.0:1788869350.124909:0:5749:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765421422720 00000100:00100000:1.0:1788869350.124947:0:5749:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1788869350.124954:0:5749:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c81f14d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:121cd5bc-7f07-4cf7-8e2e-4356c89c0696+13:7440:x1875765421422720:12345-0@lo:501: 00000100:00100000:1.0:1788869350.125530:0:5749:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c81f14d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:121cd5bc-7f07-4cf7-8e2e-4356c89c0696+13:7440:x1875765421422720:12345-0@lo:501: Request processed in 575us (991us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869350.125541:0:5749:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1788869350.125558:0:7440:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94c8349ec700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:121cd5bc-7f07-4cf7-8e2e-4356c89c0696:7440:1875765421422720:0@lo:501: 00000100:00100000:0.0:1788869350.125593:0:7440:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94c8349ec700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:121cd5bc-7f07-4cf7-8e2e-4356c89c0696:7440:1875765421422848:0@lo:503: 00000100:00100000:0.0:1788869350.125638:0:7440:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869350.125672:0:7440:0:(client.c:2702:ptlrpc_set_wait()) set ffff94c818106f00 going to sleep for 11 seconds 00000100:00100000:3.0:1788869350.125845:0:5750:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765421422848 00000100:00100000:3.0:1788869350.125850:0:5750:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765421422848 00000100:00100000:3.0:1788869350.125891:0:5750:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1788869350.125898:0:5750:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c81f14c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:121cd5bc-7f07-4cf7-8e2e-4356c89c0696+13:7440:x1875765421422848:12345-0@lo:503: 00000100:00100000:3.0:1788869350.126229:0:5750:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c81f14c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:121cd5bc-7f07-4cf7-8e2e-4356c89c0696+13:7440:x1875765421422848:12345-0@lo:503: Request processed in 331us (591us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869350.126237:0:5750:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1788869350.126369:0:7440:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94c8349ec700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:121cd5bc-7f07-4cf7-8e2e-4356c89c0696:7440:1875765421422848:0@lo:503: 00000040:00080000:0.0:1788869350.126702:0:7440:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1788869350.126763:0:7440:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94c8349ec700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:121cd5bc-7f07-4cf7-8e2e-4356c89c0696:7440:1875765421422976:0@lo:502: 00000100:00100000:0.0:1788869350.126796:0:7440:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869350.126831:0:7440:0:(client.c:2702:ptlrpc_set_wait()) set ffff94c818106f00 going to sleep for 11 seconds 00000100:00100000:3.0:1788869350.128413:0:5749:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765421422976 00000100:00100000:3.0:1788869350.128426:0:5749:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765421422976 00000100:00100000:3.0:1788869350.128495:0:5749:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1788869350.128507:0:5749:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c81f149c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:121cd5bc-7f07-4cf7-8e2e-4356c89c0696+13:7440:x1875765421422976:12345-0@lo:502: 00000100:00100000:3.0:1788869350.128781:0:5749:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c81f149c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:121cd5bc-7f07-4cf7-8e2e-4356c89c0696+13:7440:x1875765421422976:12345-0@lo:502: Request processed in 276us (1983us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869350.128789:0:5749:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1788869350.129399:0:7440:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94c8349ec700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:121cd5bc-7f07-4cf7-8e2e-4356c89c0696:7440:1875765421422976:0@lo:502: 00000040:00080000:0.0:1788869350.129690:0:7440:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:0.0:1788869350.129752:0:7440:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:0.0:1788869350.129791:0:7440:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94c8349ec700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:121cd5bc-7f07-4cf7-8e2e-4356c89c0696:7440:1875765421423104:0@lo:502: 00000100:00100000:0.0:1788869350.129844:0:7440:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869350.129891:0:7440:0:(client.c:2702:ptlrpc_set_wait()) set ffff94c818106f00 going to sleep for 11 seconds 00000100:00100000:3.0:1788869350.129894:0:5748:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765421423104 00000100:00100000:3.0:1788869350.129900:0:5748:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765421423104 00000100:00100000:3.0:1788869350.129943:0:5748:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1788869350.129952:0:5748:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c81f14a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:121cd5bc-7f07-4cf7-8e2e-4356c89c0696+13:7440:x1875765421423104:12345-0@lo:502: 00000100:00100000:3.0:1788869350.130112:0:5748:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c81f14a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:121cd5bc-7f07-4cf7-8e2e-4356c89c0696+13:7440:x1875765421423104:12345-0@lo:502: Request processed in 161us (273us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869350.130121:0:5748:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1788869350.130171:0:7440:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94c8349ec700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:121cd5bc-7f07-4cf7-8e2e-4356c89c0696:7440:1875765421423104:0@lo:502: 00000040:00080000:0.0:1788869350.130279:0:7440:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:0.0:1788869350.130289:0:7440:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:0.0:1788869350.131132:0:7452:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788869350.131145:0:7452:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788869350.131148:0:7452:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1788869350.131154:0:7452:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff94c83f970800 00000020:00000080:0.0:1788869350.131157:0:7452:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1788869350.131176:0:7452:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788869350.131179:0:7452:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788869350.131181:0:7452:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:0.0:1788869350.131184:0:7452:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:1.0:1788869350.131346:0:7440:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:1.0:1788869350.131366:0:7440:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.139@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788869350.131389:0:7440:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.139@tcp lock: ffff94c818d1fa00/0x3d2d1916761d6316 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x3d2d1916761d631d expref: -99 pid: 7440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869350.131402:0:7440:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.139@tcp lock: ffff94c818d1fa00/0x3d2d1916761d6316 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x3d2d1916761d631d expref: -99 pid: 7440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788869350.131545:0:7440:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1788869350.131549:0:7440:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff94c83f970800 10000000:01000000:1.0:1788869350.131553:0:7440:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff94c83f970800 10000000:01000000:1.0:1788869350.131558:0:7440:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1788869350.131565:0:7440:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff94c83f970800 from 1 10000000:01000000:1.0:1788869350.131568:0:7440:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1788869350.131603:0:7440:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.139@tcp lock: ffff94c8421f3800/0x3d2d1916761d6324 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869350.131613:0:7440:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.139@tcp lock: ffff94c8421f3800/0x3d2d1916761d6324 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869350.131625:0:7440:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.139@tcp lock: ffff94c8421f3800/0x3d2d1916761d6324 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788869350.131644:0:7440:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94c81f1f0700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:121cd5bc-7f07-4cf7-8e2e-4356c89c0696:7440:1875765421423232:0@lo:101: 00000100:00100000:1.0:1788869350.131688:0:7440:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869350.132713:0:7440:0:(client.c:2702:ptlrpc_set_wait()) set ffff94c8201d1cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788869350.132893:0:5749:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765421423232 00000100:00100000:3.0:1788869350.132902:0:5749:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765421423232 00000100:00100000:3.0:1788869350.132993:0:5749:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1788869350.133002:0:5749:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c81f148c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:121cd5bc-7f07-4cf7-8e2e-4356c89c0696+13:7440:x1875765421423232:12345-0@lo:101: 00010000:00010000:3.0:1788869350.133025:0:5749:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788869350.133040:0:5749:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff94c81a583e00/0x3d2d1916761d632b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x3d2d1916761d6324 expref: -99 pid: 5749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869350.133071:0:5749:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff94c81a583e00/0x3d2d1916761d632b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3d2d1916761d6324 expref: 14 pid: 5749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869350.133082:0:5749:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff94c81a583e00/0x3d2d1916761d632b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3d2d1916761d6324 expref: 14 pid: 5749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869350.133093:0:5749:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94c81a583e00, rc 0) 00000100:00100000:3.0:1788869350.133186:0:5749:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c81f148c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:121cd5bc-7f07-4cf7-8e2e-4356c89c0696+14:7440:x1875765421423232:12345-0@lo:101: Request processed in 184us (1496us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869350.133193:0:5749:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1788869350.133390:0:7440:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94c81f1f0700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:121cd5bc-7f07-4cf7-8e2e-4356c89c0696:7440:1875765421423232:0@lo:101: 00010000:00010000:2.0:1788869350.133408:0:7440:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.139@tcp lock: ffff94c8421f3800/0x3d2d1916761d6324 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x3d2d1916761d632b expref: -99 pid: 7440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869350.133418:0:7440:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.139@tcp lock: ffff94c8421f3800/0x3d2d1916761d6324 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x3d2d1916761d632b expref: -99 pid: 7440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788869350.133572:0:7440:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94c803fbad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:121cd5bc-7f07-4cf7-8e2e-4356c89c0696:7440:1875765421423360:0@lo:501: 00000100:00100000:2.0:1788869350.133610:0:7440:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869350.133638:0:7440:0:(client.c:2702:ptlrpc_set_wait()) set ffff94c81828aa80 going to sleep for 11 seconds 00000100:00100000:3.0:1788869350.133688:0:5749:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765421423360 00000100:00100000:3.0:1788869350.133692:0:5749:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765421423360 00000100:00100000:3.0:1788869350.133725:0:5749:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1788869350.133732:0:5749:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c81f14b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:121cd5bc-7f07-4cf7-8e2e-4356c89c0696+14:7440:x1875765421423360:12345-0@lo:501: 00000100:00100000:3.0:1788869350.134134:0:5749:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c81f14b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:121cd5bc-7f07-4cf7-8e2e-4356c89c0696+14:7440:x1875765421423360:12345-0@lo:501: Request processed in 401us (522us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869350.134142:0:5749:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1788869350.134916:0:7440:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94c803fbad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:121cd5bc-7f07-4cf7-8e2e-4356c89c0696:7440:1875765421423360:0@lo:501: 00000100:00100000:2.0:1788869350.134958:0:7440:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94c803fbad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:121cd5bc-7f07-4cf7-8e2e-4356c89c0696:7440:1875765421423488:0@lo:503: 00000100:00100000:2.0:1788869350.135005:0:7440:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869350.135079:0:7440:0:(client.c:2702:ptlrpc_set_wait()) set ffff94c81828aa80 going to sleep for 11 seconds 00000100:00100000:1.0:1788869350.135117:0:5750:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765421423488 00000100:00100000:1.0:1788869350.135122:0:5750:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765421423488 00000100:00100000:1.0:1788869350.135192:0:5750:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1788869350.135201:0:5750:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c81f148050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:121cd5bc-7f07-4cf7-8e2e-4356c89c0696+14:7440:x1875765421423488:12345-0@lo:503: 00000100:00100000:1.0:1788869350.135492:0:5750:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c81f148050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:121cd5bc-7f07-4cf7-8e2e-4356c89c0696+14:7440:x1875765421423488:12345-0@lo:503: Request processed in 292us (486us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869350.135500:0:5750:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1788869350.135561:0:7440:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94c803fbad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:121cd5bc-7f07-4cf7-8e2e-4356c89c0696:7440:1875765421423488:0@lo:503: 00000040:00080000:2.0:1788869350.135886:0:7440:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1788869350.135948:0:7440:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94c803fbad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:121cd5bc-7f07-4cf7-8e2e-4356c89c0696:7440:1875765421423616:0@lo:502: 00000100:00100000:2.0:1788869350.135979:0:7440:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869350.136157:0:7440:0:(client.c:2702:ptlrpc_set_wait()) set ffff94c81828aa80 going to sleep for 11 seconds 00000100:00100000:3.0:1788869350.136186:0:5749:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765421423616 00000100:00100000:3.0:1788869350.136190:0:5749:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765421423616 00000100:00100000:3.0:1788869350.136215:0:5749:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1788869350.136222:0:5749:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c81f149050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:121cd5bc-7f07-4cf7-8e2e-4356c89c0696+14:7440:x1875765421423616:12345-0@lo:502: 00000100:00100000:3.0:1788869350.136593:0:5749:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c81f149050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:121cd5bc-7f07-4cf7-8e2e-4356c89c0696+14:7440:x1875765421423616:12345-0@lo:502: Request processed in 371us (612us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869350.136600:0:5749:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1788869350.136682:0:7440:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94c803fbad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:121cd5bc-7f07-4cf7-8e2e-4356c89c0696:7440:1875765421423616:0@lo:502: 00000040:00080000:2.0:1788869350.136999:0:7440:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:2.0:1788869350.137046:0:7440:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:2.0:1788869350.137080:0:7440:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:2.0:1788869350.137132:0:7440:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:2.0:1788869350.137170:0:7440:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:2.0:1788869350.137224:0:7440:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:2.0:1788869350.137406:0:7440:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:2.0:1788869350.137460:0:7440:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:2.0:1788869350.137501:0:7440:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:2.0:1788869350.137527:0:7440:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:2.0:1788869350.137550:0:7440:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:2.0:1788869350.137582:0:7440:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:2.0:1788869350.137606:0:7440:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:2.0:1788869350.137629:0:7440:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:2.0:1788869350.137676:0:7440:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:2.0:1788869350.137704:0:7440:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:2.0:1788869350.137728:0:7440:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:2.0:1788869350.137759:0:7440:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:2.0:1788869350.137783:0:7440:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:2.0:1788869350.137806:0:7440:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:2.0:1788869350.137904:0:7440:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:2.0:1788869350.137931:0:7440:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:2.0:1788869350.137955:0:7440:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:2.0:1788869350.138002:0:7440:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:2.0:1788869350.138028:0:7440:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 128 off12440 00000040:00080000:2.0:1788869350.138051:0:7440:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12664 00000040:00080000:2.0:1788869350.138083:0:7440:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12888 00000040:00080000:3.0:1788869350.138199:0:7440:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off12968 00000040:00080000:3.0:1788869350.138233:0:7440:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13192 00000040:00080000:3.0:1788869350.138350:0:7440:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13416 00000040:00080000:3.0:1788869350.138382:0:7440:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 88 off13504 00000040:00080000:3.0:1788869350.138408:0:7440:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 128 off13632 00000040:00080000:3.0:1788869350.138432:0:7440:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 144 off13776 00000040:00080000:3.0:1788869350.138493:0:7440:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 128 off13904 00000040:00080000:3.0:1788869350.138523:0:7440:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 224 off14128 00000040:00080000:3.0:1788869350.138558:0:7440:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14352 00000040:00080000:3.0:1788869350.138583:0:7440:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].37, 80 off14432 00000100:00100000:3.0:1788869350.138625:0:7440:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94c82d043100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:121cd5bc-7f07-4cf7-8e2e-4356c89c0696:7440:1875765421423744:0@lo:502: 00000100:00100000:3.0:1788869350.138690:0:7440:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869350.138727:0:7440:0:(client.c:2702:ptlrpc_set_wait()) set ffff94c8205cd240 going to sleep for 11 seconds 00000100:00100000:3.0:1788869350.138747:0:5749:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765421423744 00000100:00100000:3.0:1788869350.138753:0:5749:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765421423744 00000100:00100000:3.0:1788869350.138791:0:5749:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1788869350.138797:0:5749:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c81f148450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:121cd5bc-7f07-4cf7-8e2e-4356c89c0696+14:7440:x1875765421423744:12345-0@lo:502: 00000100:00100000:0.0:1788869350.139697:0:5749:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c81f148450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:121cd5bc-7f07-4cf7-8e2e-4356c89c0696+14:7440:x1875765421423744:12345-0@lo:502: Request processed in 895us (1001us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869350.139707:0:5749:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1788869350.139922:0:7440:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94c82d043100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:121cd5bc-7f07-4cf7-8e2e-4356c89c0696:7440:1875765421423744:0@lo:502: 00000040:00080000:3.0:1788869350.140014:0:7440:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].38, 224 off14656 00000040:00080000:3.0:1788869350.140028:0:7440:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 38 count 39 00000020:01000004:3.0:1788869350.140992:0:7454:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:3.0:1788869350.141012:0:7454:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff94c8356ccd40) 00000020:00000080:3.0:1788869350.141041:0:7454:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type lwp with refcount 2 00000020:01000004:3.0:1788869350.141380:0:7454:0:(tgt_mount.c:153:server_get_mount()) get mount ffff94c83f970800 from lustre-OST0001, refs=3 00000020:01000004:3.0:1788869350.141385:0:7454:0:(tgt_mount.c:187:server_put_mount()) put mount ffff94c83f970800 from lustre-OST0001, refs=3 00000020:01000004:3.0:1788869350.141389:0:7454:0:(obd_mount.c:710:lustre_put_lsi()) put ffff94c83f970800 3 00010000:00080000:3.0:1788869350.141426:0:7454:0:(ldlm_lib.c:102:import_set_conn()) imp ffff94c835502000@lustre-MDT0000-lwp-OST0001: add connection 192.168.201.139@tcp at head 00010000:00010000:3.0:1788869350.147061:0:7454:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-4 is initialized 00000020:00000080:3.0:1788869350.147199:0:7454:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:3.0:1788869350.147731:0:7454:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1788869350.147752:0:7454:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0x3d2d1916761d6339 00000100:00080000:3.0:1788869350.147767:0:7454:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788869350.147776:0:7454:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff94c835502000 using connection 192.168.201.139@tcp/0@lo 00000100:00100000:3.0:1788869350.147892:0:7454:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff94c82d043100 x1875765421423872/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788869350.147957:0:3282:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94c82d043100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3282:1875765421423872:0@lo:38: 00000100:00100000:2.0:1788869350.148059:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869350.148196:0:5756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765421423872 00000100:00100000:1.0:1788869350.148206:0:5756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765421423872 00000100:00100000:1.0:1788869350.148297:0:5756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788869350.148317:0:5756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c803fbad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3282:x1875765421423872:12345-0@lo:38: 00010000:00080000:1.0:1788869350.148350:0:5756:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 98 last 0 00000020:00000080:1.0:1788869350.148394:0:5756:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0x3d2d1916761d6340 00000004:00100000:1.0:1788869350.148416:0:5756:0:(mdt_handler.c:7366:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1788869350.148494:0:7454:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00100000:3.0:1788869350.148588:0:3285:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94c82d041c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3285:1875765421424000:0@lo:400: 00000100:00100000:3.0:1788869350.148627:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869350.148657:0:3285:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788869350.148665:0:3285:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94c82d043480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3285:1875765421424128:0@lo:400: 00000100:00100000:3.0:1788869350.148694:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869350.148732:0:3284:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788869350.148745:0:3284:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94c82d040000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3284:1875765421424256:0@lo:400: 00000100:00100000:3.0:1788869350.148789:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1788869350.148956:0:5756:0:(import.c:65:import_set_state_nolock()) ffff94c83cbf5800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788869350.149034:0:5757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765421424000 00000100:00100000:3.0:1788869350.149039:0:5757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765421424000 00000100:00100000:3.0:1788869350.149069:0:5757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765421424128 00000100:00100000:3.0:1788869350.149072:0:5757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765421424128 00000100:00100000:3.0:1788869350.149111:0:5757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788869350.149120:0:5757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c82d040380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3285:x1875765421424000:12345-0@lo:400: 00000100:00080000:0.0:1788869350.149197:0:5751:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788869350.149909:0:5756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c803fbad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3282:x1875765421423872:12345-0@lo:38: Request processed in 1592us (1855us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869350.149920:0:5756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788869350.149947:0:5756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788869350.149956:0:5756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c82d043b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3285:x1875765421424128:12345-0@lo:400: 00000100:00100000:1.0:1788869350.150005:0:5756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c82d043b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3285:x1875765421424128:12345-0@lo:400: Request processed in 51us (1310us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869350.150012:0:5756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:0.0:1788869350.150072:0:3285:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff94c82d043480 x1875765421424128/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788869366 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788869350.150092:0:3285:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94c82d043480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3285:1875765421424128:0@lo:400: 00010000:00080000:2.0:1788869350.150104:0:3282:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff94c82d043100 x1875765421423872/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788869360 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788869350.150118:0:3282:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:2.0:1788869350.150127:0:3282:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 1 00000100:00080000:2.0:1788869350.150136:0:3282:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:2.0:1788869350.150142:0:3282:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1788869350.150146:0:3282:0:(import.c:65:import_set_state_nolock()) ffff94c835502000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1788869350.150167:0:3282:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94c82d043100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3282:1875765421423872:0@lo:38: 00000100:00100000:0.0:1788869350.150825:0:7456:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94c8349ec700 pname:cluuid:pid:xid:nid:opc:job lwp_notify_lust:lustre-MDT0000-lwp-OST0001_UUID:7456:1875765421424384:0@lo:901: 00000100:00100000:3.0:1788869350.150896:0:5757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c82d040380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3285:x1875765421424000:12345-0@lo:400: Request processed in 1774us (2266us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869350.150907:0:5757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788869350.150922:0:7456:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869350.150949:0:6544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765421424256 00000100:00100000:3.0:1788869350.150958:0:6544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765421424256 00000100:00100000:0.0:1788869350.150966:0:7456:0:(client.c:2702:ptlrpc_set_wait()) set ffff94c8181063c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788869350.151021:0:6544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788869350.151030:0:6544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c82d042300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3284:x1875765421424256:12345-0@lo:400: 00000100:00100000:3.0:1788869350.151088:0:6544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c82d042300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3284:x1875765421424256:12345-0@lo:400: Request processed in 58us (2299us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869350.151094:0:6544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:3.0:1788869350.151111:0:5751:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1788869350.151137:0:3284:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff94c82d040000 x1875765421424256/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788869366 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788869350.151147:0:3284:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:3.0:1788869350.151161:0:3284:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94c82d040000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3284:1875765421424256:0@lo:400: 00010000:00080000:1.0:1788869350.151215:0:3285:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff94c82d041c00 x1875765421424000/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788869366 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788869350.151228:0:3285:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94c82d041c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3285:1875765421424000:0@lo:400: 00000100:00100000:2.0:1788869350.151388:0:5766:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765421424384 00000100:00100000:2.0:1788869350.151393:0:5766:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765421424384 00000100:00100000:2.0:1788869350.151450:0:5766:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788869350.151459:0:5766:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c8349edf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-OST0001_UUID+5:7456:x1875765421424384:12345-0@lo:901: 00000100:00080000:3.0:1788869350.151934:0:5751:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788869350.152113:0:5766:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c8349edf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-OST0001_UUID+5:7456:x1875765421424384:12345-0@lo:901: Request processed in 655us (1192us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869350.152123:0:5766:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:0.0:1788869350.152207:0:7456:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff94c8349ec700 x1875765421424384/t0(0) o901->lustre-MDT0000-lwp-OST0001@0@lo:29/10 lens 248/4320 e 0 to 0 dl 1788869366 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000040:00080000:2.0:1788869350.152212:0:7454:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000100:00100000:0.0:1788869350.152234:0:7456:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94c8349ec700 pname:cluuid:pid:xid:nid:opc:job lwp_notify_lust:lustre-MDT0000-lwp-OST0001_UUID:7456:1875765421424384:0@lo:901: 00000020:01000000:1.0:1788869350.152766:0:7440:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-38 (rc=0) 10000000:01000000:1.0:1788869350.152801:0:7440:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.139@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1788869350.152914:0:7440:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.139@tcp lock: ffff94c8421f3800/0x3d2d1916761d6324 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x3d2d1916761d632b expref: -99 pid: 7440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869350.152927:0:7440:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.139@tcp lock: ffff94c8421f3800/0x3d2d1916761d6324 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x3d2d1916761d632b expref: -99 pid: 7440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1788869350.152988:0:7440:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1788869350.152990:0:7440:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1788869350.152991:0:7440:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788869350.152997:0:7440:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788869350.152999:0:7440:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788869350.153000:0:7440:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788869350.153002:0:7440:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788869350.153003:0:7440:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1788869350.153005:0:7440:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1788869350.153006:0:7440:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788869350.153008:0:7440:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1788869350.153013:0:7440:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020062 00000020:01000004:1.0:1788869350.153015:0:7440:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1788869350.153017:0:7440:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1788869350.153018:0:7440:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788869350.153019:0:7440:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788869350.153020:0:7440:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788869350.153020:0:7440:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788869350.153021:0:7440:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788869350.153022:0:7440:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1788869350.153023:0:7440:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1788869350.153024:0:7440:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788869350.153025:0:7440:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1788869350.153058:0:7440:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:1.0:1788869350.153075:0:7440:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94c81f1f3100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:121cd5bc-7f07-4cf7-8e2e-4356c89c0696:7440:1875765421424512:0@lo:253: 00000100:00100000:1.0:1788869350.153130:0:7440:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869350.153209:0:7440:0:(client.c:2702:ptlrpc_set_wait()) set ffff94c8201d1300 going to sleep for 11 seconds 00000100:00100000:2.0:1788869350.153412:0:5748:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765421424512 00000100:00100000:2.0:1788869350.153420:0:5748:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765421424512 00000100:00100000:0.0:1788869350.153552:0:5748:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1788869350.153568:0:5748:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c81f149450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:121cd5bc-7f07-4cf7-8e2e-4356c89c0696+14:7440:x1875765421424512:12345-0@lo:253: 20000000:01000000:0.0:1788869350.153599:0:5748:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:0.0:1788869350.153613:0:5748:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:0.0:1788869350.178981:0:5748:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1788869350.179001:0:5748:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:1.0:1788869350.179046:0:5771:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1788869350.179057:0:5771:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1788869350.179079:0:5771:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff94c8421f2200/0x3d2d1916761d6347 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869350.179098:0:5771:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff94c818d1e000/0x3d2d1916761d6298 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3d2d1916761d6291 expref: 14 pid: 5750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869350.179107:0:5771:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff94c8421f2200/0x3d2d1916761d6347 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869350.179148:0:5771:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff94c818d1e000/0x3d2d1916761d6298 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x3d2d1916761d6291 expref: 14 pid: 5750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869350.179181:0:5771:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff94c818d1e000/0x3d2d1916761d6298 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x3d2d1916761d6291 expref: 14 pid: 5750 timeout: 248 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788869350.179196:0:5771:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94c81f1f2300 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5771:1875765421424640:0@lo:104: 00000100:00100000:1.0:1788869350.179302:0:5771:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869350.179345:0:5771:0:(client.c:2702:ptlrpc_set_wait()) set ffff94c807dffc00 going to sleep for 11 seconds 00000100:00100000:3.0:1788869350.179629:0:5738:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765421424640 00000100:00100000:3.0:1788869350.179642:0:5738:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765421424640 00000100:00100000:3.0:1788869350.179727:0:5738:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788869350.179741:0:5738:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c81f1f0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:121cd5bc-7f07-4cf7-8e2e-4356c89c0696+3:5771:x1875765421424640:12345-0@lo:104: 00010000:00010000:3.0:1788869350.179761:0:5738:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.139@tcp lock: ffff94c818d1e800/0x3d2d1916761d6291 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x3d2d1916761d6298 expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869350.179871:0:5738:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788869350.179878:0:5738:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c81f1f0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:121cd5bc-7f07-4cf7-8e2e-4356c89c0696+3:5771:x1875765421424640:12345-0@lo:104: Request processed in 141us (575us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869350.179885:0:5738:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00010000:2.0:1788869350.180416:0:7447:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788869350.180427:0:7447:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.139@tcp lock: ffff94c818d1e800/0x3d2d1916761d6291 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x3d2d1916761d6298 expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788869350.180506:0:5771:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94c81f1f2300 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5771:1875765421424640:0@lo:104: 00010000:00010000:1.0:1788869350.180535:0:5771:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff94c8421f2200/0x3d2d1916761d6347 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869350.180756:0:7447:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94c818d1e800 already unused, calling callback (ffffffffc1ce9c20) 10000000:00010000:2.0:1788869350.180765:0:7447:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.139@tcp lock: ffff94c818d1e800/0x3d2d1916761d6291 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x3d2d1916761d6298 expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869350.180775:0:7447:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.139@tcp lock: ffff94c818d1e800/0x3d2d1916761d6291 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x3d2d1916761d6298 expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788869350.180785:0:7447:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.139@tcp lock: ffff94c818d1e800/0x3d2d1916761d6291 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x3d2d1916761d6298 expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788869350.180791:0:7447:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1788869350.181107:0:7447:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.139@tcp lock: ffff94c818d1e800/0x3d2d1916761d6291 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3d2d1916761d6298 expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869350.181115:0:7447:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788869350.181151:0:7447:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.139@tcp lock: ffff94c818d1e800/0x3d2d1916761d6291 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3d2d1916761d6298 expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869350.181159:0:7447:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.139@tcp lock: ffff94c818d1e800/0x3d2d1916761d6291 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3d2d1916761d6298 expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869350.181178:0:7447:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788869350.181180:0:7447:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788869350.181182:0:7447:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788869350.181338:0:3283:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788869350.181356:0:3283:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94c803fb8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:121cd5bc-7f07-4cf7-8e2e-4356c89c0696:3283:1875765421424768:0@lo:103: 00000100:00100000:2.0:1788869350.181414:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869350.181775:0:5740:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765421424768 00000100:00100000:2.0:1788869350.181783:0:5740:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765421424768 00010000:00010000:2.0:1788869350.181813:0:5740:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff94c818d1e000/0x3d2d1916761d6298 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3d2d1916761d6291 expref: 15 pid: 5750 timeout: 248 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788869350.181851:0:5740:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788869350.181860:0:5740:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c810ef2c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:121cd5bc-7f07-4cf7-8e2e-4356c89c0696+15:3283:x1875765421424768:12345-0@lo:103: 00010000:00010000:2.0:1788869350.181929:0:5740:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788869350.181935:0:5740:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff94c818d1e000/0x3d2d1916761d6298 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3d2d1916761d6291 expref: 15 pid: 5750 timeout: 248 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869350.181948:0:5740:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff94c818d1e000/0x3d2d1916761d6298 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x3d2d1916761d6291 expref: 15 pid: 5750 timeout: 248 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869350.181964:0:5740:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff94c818d1e000/0x3d2d1916761d6298 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x3d2d1916761d6291 expref: 15 pid: 5750 timeout: 248 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869350.181977:0:5740:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff94c8421f2200/0x3d2d1916761d6347 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869350.181993:0:5740:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff94c8421f2200/0x3d2d1916761d6347 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1788869350.182009:0:5740:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.004618324s 00010000:00010000:2.0:1788869350.182014:0:5740:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff94c8421f2200/0x3d2d1916761d6347 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869350.182021:0:5740:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff94c8421f2200/0x3d2d1916761d6347 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869350.182028:0:5740:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff94c8421f2200/0x3d2d1916761d6347 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869350.182035:0:5740:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff94c8421f2200/0x3d2d1916761d6347 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869350.182042:0:5740:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94c8421f2200 already unused, calling callback (ffffffffc1703220) 00010000:00010000:2.0:1788869350.182046:0:5740:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff94c8421f2200/0x3d2d1916761d6347 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869350.182053:0:5740:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff94c8421f2200/0x3d2d1916761d6347 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869350.182072:0:5740:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff94c8421f2200/0x3d2d1916761d6347 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869350.182083:0:5740:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788869350.182132:0:5740:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c810ef2c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:121cd5bc-7f07-4cf7-8e2e-4356c89c0696+14:3283:x1875765421424768:12345-0@lo:103: Request processed in 273us (719us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869350.182140:0:5740:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00010000:1.0:1788869350.182238:0:5771:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff94c8421f2200/0x3d2d1916761d6347 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869350.182275:0:5771:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff94c8421f2200/0x3d2d1916761d6347 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869350.182283:0:5771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff94c8421f2200/0x3d2d1916761d6347 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788869350.182685:0:3283:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94c803fb8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:121cd5bc-7f07-4cf7-8e2e-4356c89c0696:3283:1875765421424768:0@lo:103: 00000100:00100000:0.0:1788869350.190701:0:5748:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c81f149450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:121cd5bc-7f07-4cf7-8e2e-4356c89c0696+13:7440:x1875765421424512:12345-0@lo:253: Request processed in 37127us (37559us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869350.190718:0:5748:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1788869350.190841:0:7440:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94c81f1f3100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:121cd5bc-7f07-4cf7-8e2e-4356c89c0696:7440:1875765421424512:0@lo:253: 10000000:01000000:1.0:1788869350.190859:0:7440:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:1.0:1788869350.190863:0:7440:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1788869350.190865:0:7440:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1788869350.190866:0:7440:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788869350.190868:0:7440:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788869350.190869:0:7440:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788869350.190870:0:7440:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788869350.190872:0:7440:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788869350.190873:0:7440:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1788869350.190874:0:7440:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1788869350.190890:0:7440:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788869350.190891:0:7440:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:1.0:1788869350.190911:0:7440:0:(tgt_mount.c:2689:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:1.0:1788869350.194530:0:7440:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:1.0:1788869350.194717:0:7440:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:1.0:1788869350.194900:0:7440:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:1.0:1788869350.195053:0:7440:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:1.0:1788869350.195306:0:7440:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:1.0:1788869350.195572:0:7440:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:3.0:1788869350.196859:0:7440:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00002000:00080000:0.0:1788869350.363379:0:7440:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:0.0:1788869350.363389:0:7440:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:0.0:1788869350.363434:0:7440:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1788869350.363555:0:7440:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.201.139@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1788869350.363581:0:7440:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=49 00000080:00000004:0.0:1788869350.363616:0:7440:0:(super25.c:181:lustre_fill_super()) lustre-ost2/ost2: Mount complete 00010000:00010000:1.0:1788869350.811617:0:5742:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788869351.518427:0:3286:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788869351.518454:0:3286:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94c81f1f3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3286:1875765421424896:0@lo:13: 00000100:00100000:3.0:1788869351.518519:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869351.518645:0:6548:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765421424896 00000100:00100000:1.0:1788869351.518652:0:6548:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765421424896 00000100:00100000:1.0:1788869351.518698:0:6548:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788869351.518706:0:6548:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c82d040000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3286:x1875765421424896:12345-0@lo:13: 00002000:00000024:1.0:1788869351.518738:0:6548:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788869351.518782:0:6548:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c82d040000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3286:x1875765421424896:12345-0@lo:13: Request processed in 77us (263us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869351.518790:0:6548:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1788869351.518827:0:3286:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff94c81f1f3100 x1875765421424896/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788869367 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788869351.518844:0:3286:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94c81f1f3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3286:1875765421424896:0@lo:13: 00010000:00010000:1.0:1788869351.835587:0:5743:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788869352.861144:0:7447:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1788869353.763534:0:7796:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg139-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:3.0:1788869353.885399:0:5742:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1788869354.590423:0:5752:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1788869354.590434:0:5752:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff94c839dd4000 from 30 10000000:01000000:3.0:1788869354.590441:0:5752:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1788869354.590497:0:5752:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.139@tcp lock: ffff94c81a582c00/0x3d2d1916761d634e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869354.590511:0:5752:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.139@tcp lock: ffff94c81a582c00/0x3d2d1916761d634e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869354.590523:0:5752:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.139@tcp lock: ffff94c81a582c00/0x3d2d1916761d634e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788869354.590553:0:5752:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94c82d043800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:121cd5bc-7f07-4cf7-8e2e-4356c89c0696:5752:1875765421425024:0@lo:101: 00000100:00100000:3.0:1788869354.590640:0:5752:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869354.590728:0:5752:0:(client.c:2702:ptlrpc_set_wait()) set ffff94c81f09bb40 going to sleep for 11 seconds 00000100:00100000:0.0:1788869354.601240:0:5749:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765421425024 00000100:00100000:0.0:1788869354.601273:0:5749:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765421425024 00000100:00100000:0.0:1788869354.601337:0:5749:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1788869354.601349:0:5749:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c81f148850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:121cd5bc-7f07-4cf7-8e2e-4356c89c0696+13:5752:x1875765421425024:12345-0@lo:101: 00010000:00010000:0.0:1788869354.601468:0:5749:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788869354.601494:0:5749:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff94c818d1fe00/0x3d2d1916761d6355 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x3d2d1916761d634e expref: -99 pid: 5749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869354.601528:0:5749:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff94c818d1fe00/0x3d2d1916761d6355 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3d2d1916761d634e expref: 14 pid: 5749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869354.601553:0:5749:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff94c818d1fe00/0x3d2d1916761d6355 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3d2d1916761d634e expref: 14 pid: 5749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869354.601565:0:5749:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94c818d1fe00, rc 0) 00000100:00100000:0.0:1788869354.601669:0:5749:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c81f148850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:121cd5bc-7f07-4cf7-8e2e-4356c89c0696+14:5752:x1875765421425024:12345-0@lo:101: Request processed in 322us (11028us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869354.601676:0:5749:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1788869354.601788:0:5752:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94c82d043800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:121cd5bc-7f07-4cf7-8e2e-4356c89c0696:5752:1875765421425024:0@lo:101: 00010000:00010000:1.0:1788869354.601811:0:5752:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.139@tcp lock: ffff94c81a582c00/0x3d2d1916761d634e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x3d2d1916761d6355 expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869354.601822:0:5752:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.139@tcp lock: ffff94c81a582c00/0x3d2d1916761d634e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x3d2d1916761d6355 expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788869354.601913:0:5752:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94c81f1f3100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:121cd5bc-7f07-4cf7-8e2e-4356c89c0696:5752:1875765421425152:0@lo:501: 00000100:00100000:1.0:1788869354.601948:0:5752:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869354.601979:0:5752:0:(client.c:2702:ptlrpc_set_wait()) set ffff94c81828a780 going to sleep for 11 seconds 00000100:00100000:0.0:1788869354.603538:0:5748:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765421425152 00000100:00100000:0.0:1788869354.603549:0:5748:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765421425152 00000100:00100000:0.0:1788869354.603589:0:5748:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1788869354.603597:0:5748:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c81f149850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:121cd5bc-7f07-4cf7-8e2e-4356c89c0696+14:5752:x1875765421425152:12345-0@lo:501: 00000100:00100000:0.0:1788869354.604036:0:5748:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c81f149850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:121cd5bc-7f07-4cf7-8e2e-4356c89c0696+14:5752:x1875765421425152:12345-0@lo:501: Request processed in 438us (2086us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869354.604046:0:5748:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1788869354.604112:0:5752:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94c81f1f3100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:121cd5bc-7f07-4cf7-8e2e-4356c89c0696:5752:1875765421425152:0@lo:501: 00000100:00100000:0.0:1788869354.604171:0:5752:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94c8349ec700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:121cd5bc-7f07-4cf7-8e2e-4356c89c0696:5752:1875765421425280:0@lo:503: 00000100:00100000:0.0:1788869354.605382:0:5752:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869354.605433:0:5752:0:(client.c:2702:ptlrpc_set_wait()) set ffff94c805068d80 going to sleep for 11 seconds 00000100:00100000:3.0:1788869354.605591:0:5749:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765421425280 00000100:00100000:3.0:1788869354.605599:0:5749:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765421425280 00000100:00100000:3.0:1788869354.605643:0:5749:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:3.0:1788869354.605652:0:5749:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c81f14a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:121cd5bc-7f07-4cf7-8e2e-4356c89c0696+14:5752:x1875765421425280:12345-0@lo:503: 00000100:00100000:3.0:1788869354.606001:0:5749:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c81f14a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:121cd5bc-7f07-4cf7-8e2e-4356c89c0696+14:5752:x1875765421425280:12345-0@lo:503: Request processed in 350us (623us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869354.606010:0:5749:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:3.0:1788869354.606061:0:5752:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94c8349ec700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:121cd5bc-7f07-4cf7-8e2e-4356c89c0696:5752:1875765421425280:0@lo:503: 00000100:00100000:3.0:1788869354.606324:0:7871:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94c82d041f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:121cd5bc-7f07-4cf7-8e2e-4356c89c0696:7871:1875765421425408:0@lo:502: 00000100:00100000:3.0:1788869354.606376:0:7871:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869354.606398:0:7871:0:(client.c:2702:ptlrpc_set_wait()) set ffff94c81f09ba80 going to sleep for 11 seconds 00000100:00100000:0.0:1788869354.606499:0:5748:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765421425408 00000100:00100000:0.0:1788869354.606503:0:5748:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765421425408 00000100:00100000:0.0:1788869354.606536:0:5748:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:0.0:1788869354.606542:0:5748:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c81f14bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:121cd5bc-7f07-4cf7-8e2e-4356c89c0696+14:7871:x1875765421425408:12345-0@lo:502: 00000100:00100000:0.0:1788869354.606749:0:5748:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c81f14bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:121cd5bc-7f07-4cf7-8e2e-4356c89c0696+14:7871:x1875765421425408:12345-0@lo:502: Request processed in 207us (384us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869354.606756:0:5748:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:3.0:1788869354.606841:0:7871:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94c82d041f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:121cd5bc-7f07-4cf7-8e2e-4356c89c0696:7871:1875765421425408:0@lo:502: 00000100:00100000:3.0:1788869354.606887:0:7871:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94c82d041f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:121cd5bc-7f07-4cf7-8e2e-4356c89c0696:7871:1875765421425536:0@lo:502: 00000100:00100000:3.0:1788869354.606915:0:7871:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869354.606933:0:7871:0:(client.c:2702:ptlrpc_set_wait()) set ffff94c81f09ba80 going to sleep for 11 seconds 00000100:00100000:0.0:1788869354.606973:0:5748:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765421425536 00000100:00100000:0.0:1788869354.606977:0:5748:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765421425536 00000100:00100000:0.0:1788869354.607231:0:5748:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1788869354.607238:0:5748:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c81f14a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:121cd5bc-7f07-4cf7-8e2e-4356c89c0696+14:7871:x1875765421425536:12345-0@lo:502: 00000100:00100000:0.0:1788869354.607389:0:5748:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c81f14a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:121cd5bc-7f07-4cf7-8e2e-4356c89c0696+14:7871:x1875765421425536:12345-0@lo:502: Request processed in 152us (472us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869354.607397:0:5748:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:3.0:1788869354.611559:0:7871:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94c82d041f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:121cd5bc-7f07-4cf7-8e2e-4356c89c0696:7871:1875765421425536:0@lo:502: 00000040:00080000:3.0:1788869354.611615:0:7871:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:2.0:1788869354.611771:0:5752:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:2.0:1788869354.611800:0:5752:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.139@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1788869354.611814:0:5752:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.139@tcp lock: ffff94c81a582c00/0x3d2d1916761d634e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x3d2d1916761d6355 expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869354.611828:0:5752:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.139@tcp lock: ffff94c81a582c00/0x3d2d1916761d634e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x3d2d1916761d6355 expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788869354.611838:0:5752:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:2.0:1788869354.611841:0:5752:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 8 10000000:01000000:2.0:1788869354.611844:0:5752:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:2.0:1788869354.611884:0:5752:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.139@tcp lock: ffff94c80153a400/0x3d2d1916761d635c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869354.611893:0:5752:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.139@tcp lock: ffff94c80153a400/0x3d2d1916761d635c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869354.611904:0:5752:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.139@tcp lock: ffff94c80153a400/0x3d2d1916761d635c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788869354.611928:0:5752:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94c803fb9180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:121cd5bc-7f07-4cf7-8e2e-4356c89c0696:5752:1875765421425664:0@lo:101: 00000100:00100000:2.0:1788869354.612005:0:5752:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869354.612060:0:5752:0:(client.c:2702:ptlrpc_set_wait()) set ffff94c8086be0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788869354.612246:0:5749:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765421425664 00000100:00100000:3.0:1788869354.612282:0:5749:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765421425664 00000100:00100000:3.0:1788869354.612324:0:5749:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:3.0:1788869354.612334:0:5749:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c81f14ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:121cd5bc-7f07-4cf7-8e2e-4356c89c0696+14:5752:x1875765421425664:12345-0@lo:101: 00010000:00010000:3.0:1788869354.612350:0:5749:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788869354.613300:0:5749:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff94c81a582a00/0x3d2d1916761d6363 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x3d2d1916761d635c expref: -99 pid: 5749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869354.613334:0:5749:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff94c81a582a00/0x3d2d1916761d6363 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3d2d1916761d635c expref: 15 pid: 5749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869354.613346:0:5749:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff94c81a582a00/0x3d2d1916761d6363 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3d2d1916761d635c expref: 15 pid: 5749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869354.613357:0:5749:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94c81a582a00, rc 0) 00000100:00100000:3.0:1788869354.613424:0:5749:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c81f14ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:121cd5bc-7f07-4cf7-8e2e-4356c89c0696+15:5752:x1875765421425664:12345-0@lo:101: Request processed in 1091us (1419us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869354.613432:0:5749:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:2.0:1788869354.613532:0:5752:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94c803fb9180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:121cd5bc-7f07-4cf7-8e2e-4356c89c0696:5752:1875765421425664:0@lo:101: 00010000:00010000:2.0:1788869354.613550:0:5752:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.139@tcp lock: ffff94c80153a400/0x3d2d1916761d635c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x3d2d1916761d6363 expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869354.613560:0:5752:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.139@tcp lock: ffff94c80153a400/0x3d2d1916761d635c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x3d2d1916761d6363 expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788869354.613635:0:5752:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94c803fb9180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:121cd5bc-7f07-4cf7-8e2e-4356c89c0696:5752:1875765421425792:0@lo:501: 00000100:00100000:2.0:1788869354.613662:0:5752:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869354.613696:0:5752:0:(client.c:2702:ptlrpc_set_wait()) set ffff94c8086be0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788869354.613746:0:5750:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765421425792 00000100:00100000:3.0:1788869354.613752:0:5750:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765421425792 00000100:00100000:3.0:1788869354.613790:0:5750:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:3.0:1788869354.613800:0:5750:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c81f14b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:121cd5bc-7f07-4cf7-8e2e-4356c89c0696+15:5752:x1875765421425792:12345-0@lo:501: 00000100:00100000:3.0:1788869354.614072:0:5750:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c81f14b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:121cd5bc-7f07-4cf7-8e2e-4356c89c0696+15:5752:x1875765421425792:12345-0@lo:501: Request processed in 274us (409us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869354.614085:0:5750:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:2.0:1788869354.614152:0:5752:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94c803fb9180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:121cd5bc-7f07-4cf7-8e2e-4356c89c0696:5752:1875765421425792:0@lo:501: 00000100:00100000:2.0:1788869354.614178:0:5752:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94c803fb9180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:121cd5bc-7f07-4cf7-8e2e-4356c89c0696:5752:1875765421425920:0@lo:503: 00000100:00100000:2.0:1788869354.614223:0:5752:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869354.614240:0:5752:0:(client.c:2702:ptlrpc_set_wait()) set ffff94c8086be0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788869354.614889:0:5750:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765421425920 00000100:00100000:3.0:1788869354.614895:0:5750:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765421425920 00000100:00100000:3.0:1788869354.614923:0:5750:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:3.0:1788869354.614930:0:5750:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c81f14b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:121cd5bc-7f07-4cf7-8e2e-4356c89c0696+15:5752:x1875765421425920:12345-0@lo:503: 00000100:00100000:3.0:1788869354.615307:0:5750:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c81f14b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:121cd5bc-7f07-4cf7-8e2e-4356c89c0696+15:5752:x1875765421425920:12345-0@lo:503: Request processed in 376us (1082us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869354.615314:0:5750:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:3.0:1788869354.615361:0:5752:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94c803fb9180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:121cd5bc-7f07-4cf7-8e2e-4356c89c0696:5752:1875765421425920:0@lo:503: 00000100:00100000:3.0:1788869354.615565:0:7872:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94c82d041f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:121cd5bc-7f07-4cf7-8e2e-4356c89c0696:7872:1875765421426048:0@lo:502: 00000100:00100000:3.0:1788869354.615600:0:7872:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869354.615619:0:5750:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765421426048 00000100:00100000:3.0:1788869354.615622:0:5750:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765421426048 00000100:00100000:3.0:1788869354.615641:0:5750:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:3.0:1788869354.615647:0:5750:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c81f0fd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:121cd5bc-7f07-4cf7-8e2e-4356c89c0696+15:7872:x1875765421426048:12345-0@lo:502: 00000100:00100000:3.0:1788869354.615792:0:5750:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c81f0fd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:121cd5bc-7f07-4cf7-8e2e-4356c89c0696+15:7872:x1875765421426048:12345-0@lo:502: Request processed in 144us (190us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869354.615799:0:5750:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:3.0:1788869354.615835:0:7872:0:(client.c:2702:ptlrpc_set_wait()) set ffff94c8205cd240 going to sleep for 11 seconds 00000100:00100000:3.0:1788869354.615850:0:7872:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94c82d041f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:121cd5bc-7f07-4cf7-8e2e-4356c89c0696:7872:1875765421426048:0@lo:502: 00000020:01000000:3.0:1788869354.615871:0:7872:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788869354.615881:0:7872:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788869354.615883:0:7872:0:(obd_config.c:1561:class_process_config()) marker 23 (0x1) lustre sys.timeout 00000020:00000080:3.0:1788869354.615890:0:7872:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1788869354.615892:0:7872:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:3.0:1788869354.615907:0:7872:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94c82d041f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:121cd5bc-7f07-4cf7-8e2e-4356c89c0696:7872:1875765421426176:0@lo:502: 00000100:00100000:3.0:1788869354.615942:0:7872:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869354.615960:0:5750:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765421426176 00000100:00100000:3.0:1788869354.615963:0:5750:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765421426176 00000100:00100000:3.0:1788869354.615980:0:5750:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:3.0:1788869354.615986:0:5750:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c81f0fc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:121cd5bc-7f07-4cf7-8e2e-4356c89c0696+15:7872:x1875765421426176:12345-0@lo:502: 00000100:00100000:3.0:1788869354.616077:0:5750:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c81f0fc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:121cd5bc-7f07-4cf7-8e2e-4356c89c0696+15:7872:x1875765421426176:12345-0@lo:502: Request processed in 90us (133us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869354.616083:0:5750:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:3.0:1788869354.616108:0:7872:0:(client.c:2702:ptlrpc_set_wait()) set ffff94c8201d1540 going to sleep for 11 seconds 00000100:00100000:3.0:1788869354.616118:0:7872:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94c82d041f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:121cd5bc-7f07-4cf7-8e2e-4356c89c0696:7872:1875765421426176:0@lo:502: 00000020:01000000:3.0:1788869354.616133:0:7872:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788869354.616136:0:7872:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788869354.616138:0:7872:0:(obd_config.c:1561:class_process_config()) marker 23 (0x2) lustre sys.timeout 00000040:00080000:3.0:1788869354.616142:0:7872:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 11 count 11 00000020:01000000:3.0:1788869354.616181:0:5752:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 8-10 (rc=0) 10000000:01000000:3.0:1788869354.616198:0:5752:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.139@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:3.0:1788869354.618554:0:5752:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.139@tcp lock: ffff94c80153a400/0x3d2d1916761d635c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x3d2d1916761d6363 expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869354.618573:0:5752:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.139@tcp lock: ffff94c80153a400/0x3d2d1916761d635c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x3d2d1916761d6363 expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788869354.618587:0:5752:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1788869354.618589:0:5752:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff94c805125000 from 30 10000000:01000000:3.0:1788869354.618592:0:5752:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1788869354.618633:0:5752:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.139@tcp lock: ffff94c81a583000/0x3d2d1916761d636a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869354.618642:0:5752:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.139@tcp lock: ffff94c81a583000/0x3d2d1916761d636a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869354.618661:0:5752:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.139@tcp lock: ffff94c81a583000/0x3d2d1916761d636a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788869354.618683:0:5752:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94c82d041f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:121cd5bc-7f07-4cf7-8e2e-4356c89c0696:5752:1875765421426304:0@lo:101: 00000100:00100000:3.0:1788869354.618742:0:5752:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869354.618784:0:5752:0:(client.c:2702:ptlrpc_set_wait()) set ffff94c8201d1540 going to sleep for 11 seconds 00000100:00100000:3.0:1788869354.618846:0:5750:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765421426304 00000100:00100000:3.0:1788869354.618853:0:5750:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765421426304 00000100:00100000:3.0:1788869354.618900:0:5750:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:3.0:1788869354.618909:0:5750:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c81f0fd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:121cd5bc-7f07-4cf7-8e2e-4356c89c0696+15:5752:x1875765421426304:12345-0@lo:101: 00010000:00010000:3.0:1788869354.618921:0:5750:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788869354.618937:0:5750:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff94c81a582e00/0x3d2d1916761d6371 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x3d2d1916761d636a expref: -99 pid: 5750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869354.618962:0:5750:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff94c81a582e00/0x3d2d1916761d6371 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3d2d1916761d636a expref: 16 pid: 5750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869354.618974:0:5750:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff94c81a582e00/0x3d2d1916761d6371 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3d2d1916761d636a expref: 16 pid: 5750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869354.618984:0:5750:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94c81a582e00, rc 0) 00000100:00100000:3.0:1788869354.619024:0:5750:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c81f0fd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:121cd5bc-7f07-4cf7-8e2e-4356c89c0696+16:5752:x1875765421426304:12345-0@lo:101: Request processed in 116us (281us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869354.619031:0:5750:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:3.0:1788869354.619080:0:5752:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94c82d041f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:121cd5bc-7f07-4cf7-8e2e-4356c89c0696:5752:1875765421426304:0@lo:101: 00010000:00010000:3.0:1788869354.619095:0:5752:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.139@tcp lock: ffff94c81a583000/0x3d2d1916761d636a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x3d2d1916761d6371 expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869354.619115:0:5752:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.139@tcp lock: ffff94c81a583000/0x3d2d1916761d636a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x3d2d1916761d6371 expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788869354.619169:0:5752:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94c82d041f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:121cd5bc-7f07-4cf7-8e2e-4356c89c0696:5752:1875765421426432:0@lo:501: 00000100:00100000:3.0:1788869354.619194:0:5752:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869354.619210:0:5752:0:(client.c:2702:ptlrpc_set_wait()) set ffff94c8201d1540 going to sleep for 11 seconds 00000100:00100000:3.0:1788869354.619223:0:5748:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765421426432 00000100:00100000:3.0:1788869354.619227:0:5748:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765421426432 00000100:00100000:3.0:1788869354.619269:0:5748:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:3.0:1788869354.619276:0:5748:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c81f0fe050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:121cd5bc-7f07-4cf7-8e2e-4356c89c0696+16:5752:x1875765421426432:12345-0@lo:501: 00000100:00100000:3.0:1788869354.621697:0:5748:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c81f0fe050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:121cd5bc-7f07-4cf7-8e2e-4356c89c0696+16:5752:x1875765421426432:12345-0@lo:501: Request processed in 2414us (2493us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869354.621711:0:5748:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:2.0:1788869354.621849:0:5752:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94c82d041f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:121cd5bc-7f07-4cf7-8e2e-4356c89c0696:5752:1875765421426432:0@lo:501: 00000100:00100000:2.0:1788869354.621902:0:5752:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94c803fb8e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:121cd5bc-7f07-4cf7-8e2e-4356c89c0696:5752:1875765421426560:0@lo:503: 00000100:00100000:2.0:1788869354.621946:0:5752:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869354.622013:0:5752:0:(client.c:2702:ptlrpc_set_wait()) set ffff94c8086be600 going to sleep for 11 seconds 00000100:00100000:3.0:1788869354.625076:0:5749:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765421426560 00000100:00100000:3.0:1788869354.625090:0:5749:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765421426560 00000100:00100000:3.0:1788869354.625152:0:5749:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:3.0:1788869354.625162:0:5749:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c81f0ffc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:121cd5bc-7f07-4cf7-8e2e-4356c89c0696+16:5752:x1875765421426560:12345-0@lo:503: 00000100:00100000:3.0:1788869354.625441:0:5749:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c81f0ffc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:121cd5bc-7f07-4cf7-8e2e-4356c89c0696+16:5752:x1875765421426560:12345-0@lo:503: Request processed in 280us (3494us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869354.625449:0:5749:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:3.0:1788869354.625509:0:5752:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94c803fb8e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:121cd5bc-7f07-4cf7-8e2e-4356c89c0696:5752:1875765421426560:0@lo:503: 00000100:00100000:1.0:1788869354.626192:0:7874:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94c81f1f2300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:121cd5bc-7f07-4cf7-8e2e-4356c89c0696:7874:1875765421426688:0@lo:502: 00000100:00100000:1.0:1788869354.626242:0:7874:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869354.626306:0:7874:0:(client.c:2702:ptlrpc_set_wait()) set ffff94c81828a240 going to sleep for 11 seconds 00000100:00100000:3.0:1788869354.626455:0:5750:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765421426688 00000100:00100000:3.0:1788869354.626460:0:5750:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765421426688 00000100:00100000:3.0:1788869354.626497:0:5750:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:3.0:1788869354.626505:0:5750:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c81f0fe450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:121cd5bc-7f07-4cf7-8e2e-4356c89c0696+16:7874:x1875765421426688:12345-0@lo:502: 00000100:00100000:3.0:1788869354.626698:0:5750:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c81f0fe450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:121cd5bc-7f07-4cf7-8e2e-4356c89c0696+16:7874:x1875765421426688:12345-0@lo:502: Request processed in 192us (454us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869354.626705:0:5750:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:1.0:1788869354.626802:0:7874:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94c81f1f2300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:121cd5bc-7f07-4cf7-8e2e-4356c89c0696:7874:1875765421426688:0@lo:502: 00000100:00100000:1.0:1788869354.626845:0:7874:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94c81f1f2300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:121cd5bc-7f07-4cf7-8e2e-4356c89c0696:7874:1875765421426816:0@lo:502: 00000100:00100000:1.0:1788869354.626873:0:7874:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869354.626902:0:7874:0:(client.c:2702:ptlrpc_set_wait()) set ffff94c81828a240 going to sleep for 11 seconds 00000100:00100000:3.0:1788869354.626938:0:5748:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765421426816 00000100:00100000:3.0:1788869354.626942:0:5748:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765421426816 00000100:00100000:3.0:1788869354.626991:0:5748:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:3.0:1788869354.626998:0:5748:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c81f0fec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:121cd5bc-7f07-4cf7-8e2e-4356c89c0696+16:7874:x1875765421426816:12345-0@lo:502: 00000100:00100000:3.0:1788869354.627119:0:5748:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c81f0fec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:121cd5bc-7f07-4cf7-8e2e-4356c89c0696+16:7874:x1875765421426816:12345-0@lo:502: Request processed in 121us (244us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869354.627126:0:5748:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:1.0:1788869354.628434:0:7874:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94c81f1f2300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:121cd5bc-7f07-4cf7-8e2e-4356c89c0696:7874:1875765421426816:0@lo:502: 00000040:00080000:1.0:1788869354.628462:0:7874:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:3.0:1788869354.632356:0:5752:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:3.0:1788869354.632407:0:5752:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.139@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1788869354.632421:0:5752:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.139@tcp lock: ffff94c81a583000/0x3d2d1916761d636a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x3d2d1916761d6371 expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869354.632438:0:5752:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.139@tcp lock: ffff94c81a583000/0x3d2d1916761d636a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x3d2d1916761d6371 expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788869354.632449:0:5752:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1788869354.632452:0:5752:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff94c805125000 from 5 10000000:01000000:3.0:1788869354.632454:0:5752:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1788869354.632504:0:5752:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.139@tcp lock: ffff94c81a583800/0x3d2d1916761d6378 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869354.632513:0:5752:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.139@tcp lock: ffff94c81a583800/0x3d2d1916761d6378 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869354.632526:0:5752:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.139@tcp lock: ffff94c81a583800/0x3d2d1916761d6378 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788869354.632562:0:5752:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94c82d042a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:121cd5bc-7f07-4cf7-8e2e-4356c89c0696:5752:1875765421426944:0@lo:101: 00000100:00100000:3.0:1788869354.632651:0:5752:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869354.632704:0:5752:0:(client.c:2702:ptlrpc_set_wait()) set ffff94c822e22e40 going to sleep for 11 seconds 00000100:00100000:2.0:1788869354.632755:0:5749:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765421426944 00000100:00100000:2.0:1788869354.632763:0:5749:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765421426944 00000100:00100000:2.0:1788869354.632819:0:5749:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:2.0:1788869354.632829:0:5749:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c81f0ff450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:121cd5bc-7f07-4cf7-8e2e-4356c89c0696+16:5752:x1875765421426944:12345-0@lo:101: 00010000:00010000:2.0:1788869354.632844:0:5749:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788869354.632859:0:5749:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff94c80153b600/0x3d2d1916761d637f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x3d2d1916761d6378 expref: -99 pid: 5749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869354.632884:0:5749:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff94c80153b600/0x3d2d1916761d637f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3d2d1916761d6378 expref: 17 pid: 5749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869354.632896:0:5749:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff94c80153b600/0x3d2d1916761d637f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3d2d1916761d6378 expref: 17 pid: 5749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869354.632916:0:5749:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94c80153b600, rc 0) 00000100:00100000:2.0:1788869354.632955:0:5749:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c81f0ff450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:121cd5bc-7f07-4cf7-8e2e-4356c89c0696+17:5752:x1875765421426944:12345-0@lo:101: Request processed in 127us (303us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869354.632961:0:5749:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:3.0:1788869354.633034:0:5752:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94c82d042a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:121cd5bc-7f07-4cf7-8e2e-4356c89c0696:5752:1875765421426944:0@lo:101: 00010000:00010000:3.0:1788869354.633048:0:5752:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.139@tcp lock: ffff94c81a583800/0x3d2d1916761d6378 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3d2d1916761d637f expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869354.633058:0:5752:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.139@tcp lock: ffff94c81a583800/0x3d2d1916761d6378 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x3d2d1916761d637f expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788869354.633107:0:5752:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94c82d042a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:121cd5bc-7f07-4cf7-8e2e-4356c89c0696:5752:1875765421427072:0@lo:256: 00000100:00100000:3.0:1788869354.633136:0:5752:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869354.633158:0:5752:0:(client.c:2702:ptlrpc_set_wait()) set ffff94c822e22e40 going to sleep for 11 seconds 00000100:00100000:3.0:1788869354.633171:0:5750:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765421427072 00000100:00100000:3.0:1788869354.633174:0:5750:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765421427072 00000100:00100000:3.0:1788869354.633192:0:5750:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:3.0:1788869354.633198:0:5750:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c81f0ff850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:121cd5bc-7f07-4cf7-8e2e-4356c89c0696+17:5752:x1875765421427072:12345-0@lo:256: 20000000:01000000:3.0:1788869354.633213:0:5750:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1788869354.633231:0:5750:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1788869354.633234:0:5750:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 5 00000100:00100000:3.0:1788869354.633334:0:5750:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c81f0ff850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:121cd5bc-7f07-4cf7-8e2e-4356c89c0696+17:5752:x1875765421427072:12345-0@lo:256: Request processed in 135us (195us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869354.633341:0:5750:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:3.0:1788869354.633380:0:5752:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94c82d042a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:121cd5bc-7f07-4cf7-8e2e-4356c89c0696:5752:1875765421427072:0@lo:256: 10000000:01000000:3.0:1788869354.633420:0:5752:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.139@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1788869354.633426:0:5752:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.139@tcp lock: ffff94c81a583800/0x3d2d1916761d6378 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3d2d1916761d637f expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869354.633437:0:5752:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.139@tcp lock: ffff94c81a583800/0x3d2d1916761d6378 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3d2d1916761d637f expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788869354.633444:0:5752:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:3.0:1788869354.633446:0:5752:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 25 10000000:01000000:3.0:1788869354.633449:0:5752:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:3.0:1788869354.633463:0:5752:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.139@tcp lock: ffff94c81a583400/0x3d2d1916761d6386 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869354.633471:0:5752:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.139@tcp lock: ffff94c81a583400/0x3d2d1916761d6386 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869354.633479:0:5752:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.139@tcp lock: ffff94c81a583400/0x3d2d1916761d6386 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788869354.633489:0:5752:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94c82d042a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:121cd5bc-7f07-4cf7-8e2e-4356c89c0696:5752:1875765421427200:0@lo:101: 00000100:00100000:3.0:1788869354.633510:0:5752:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869354.633526:0:5752:0:(client.c:2702:ptlrpc_set_wait()) set ffff94c8205cde40 going to sleep for 11 seconds 00000100:00100000:3.0:1788869354.633536:0:5750:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765421427200 00000100:00100000:3.0:1788869354.633538:0:5750:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765421427200 00000100:00100000:3.0:1788869354.633552:0:5750:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:3.0:1788869354.633557:0:5750:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c81f0fdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:121cd5bc-7f07-4cf7-8e2e-4356c89c0696+17:5752:x1875765421427200:12345-0@lo:101: 00010000:00010000:3.0:1788869354.633563:0:5750:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788869354.633571:0:5750:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff94c81a582200/0x3d2d1916761d638d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x3d2d1916761d6386 expref: -99 pid: 5750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869354.633584:0:5750:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff94c81a582200/0x3d2d1916761d638d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3d2d1916761d6386 expref: 18 pid: 5750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869354.633602:0:5750:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff94c81a582200/0x3d2d1916761d638d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3d2d1916761d6386 expref: 18 pid: 5750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869354.633609:0:5750:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94c81a582200, rc 0) 00000100:00100000:3.0:1788869354.633632:0:5750:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c81f0fdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:121cd5bc-7f07-4cf7-8e2e-4356c89c0696+18:5752:x1875765421427200:12345-0@lo:101: Request processed in 74us (121us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869354.633637:0:5750:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:3.0:1788869354.633659:0:5752:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94c82d042a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:121cd5bc-7f07-4cf7-8e2e-4356c89c0696:5752:1875765421427200:0@lo:101: 00010000:00010000:3.0:1788869354.633669:0:5752:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.139@tcp lock: ffff94c81a583400/0x3d2d1916761d6386 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x3d2d1916761d638d expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869354.633677:0:5752:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.139@tcp lock: ffff94c81a583400/0x3d2d1916761d6386 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x3d2d1916761d638d expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788869354.633716:0:5752:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94c82d042a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:121cd5bc-7f07-4cf7-8e2e-4356c89c0696:5752:1875765421427328:0@lo:501: 00000100:00100000:3.0:1788869354.633735:0:5752:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869354.633746:0:5752:0:(client.c:2702:ptlrpc_set_wait()) set ffff94c8205cde40 going to sleep for 11 seconds 00000100:00100000:3.0:1788869354.633756:0:5750:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765421427328 00000100:00100000:3.0:1788869354.633759:0:5750:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765421427328 00000100:00100000:3.0:1788869354.633774:0:5750:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:3.0:1788869354.633779:0:5750:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c81f0fe850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:121cd5bc-7f07-4cf7-8e2e-4356c89c0696+18:5752:x1875765421427328:12345-0@lo:501: 00000100:00100000:3.0:1788869354.634039:0:5750:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c81f0fe850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:121cd5bc-7f07-4cf7-8e2e-4356c89c0696+18:5752:x1875765421427328:12345-0@lo:501: Request processed in 258us (302us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869354.634046:0:5750:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:3.0:1788869354.634070:0:5752:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94c82d042a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:121cd5bc-7f07-4cf7-8e2e-4356c89c0696:5752:1875765421427328:0@lo:501: 00000100:00100000:3.0:1788869354.634096:0:5752:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94c82d042a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:121cd5bc-7f07-4cf7-8e2e-4356c89c0696:5752:1875765421427456:0@lo:503: 00000100:00100000:3.0:1788869354.634132:0:5752:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869354.634143:0:5752:0:(client.c:2702:ptlrpc_set_wait()) set ffff94c818106540 going to sleep for 11 seconds 00000100:00100000:3.0:1788869354.634153:0:5750:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765421427456 00000100:00100000:3.0:1788869354.634156:0:5750:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765421427456 00000100:00100000:3.0:1788869354.634169:0:5750:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:3.0:1788869354.634174:0:5750:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c81f0fcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:121cd5bc-7f07-4cf7-8e2e-4356c89c0696+18:5752:x1875765421427456:12345-0@lo:503: 00000100:00100000:3.0:1788869354.634509:0:5750:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c81f0fcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:121cd5bc-7f07-4cf7-8e2e-4356c89c0696+18:5752:x1875765421427456:12345-0@lo:503: Request processed in 333us (375us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869354.634516:0:5750:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:3.0:1788869354.634547:0:5752:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94c82d042a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:121cd5bc-7f07-4cf7-8e2e-4356c89c0696:5752:1875765421427456:0@lo:503: 00000100:00100000:3.0:1788869354.634770:0:7875:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94c82d042a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:121cd5bc-7f07-4cf7-8e2e-4356c89c0696:7875:1875765421427584:0@lo:502: 00000100:00100000:3.0:1788869354.634804:0:7875:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869354.634822:0:5750:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765421427584 00000100:00100000:3.0:1788869354.634825:0:5750:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765421427584 00000100:00100000:3.0:1788869354.634840:0:5750:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:3.0:1788869354.634846:0:5750:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c81f0ff050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:121cd5bc-7f07-4cf7-8e2e-4356c89c0696+18:7875:x1875765421427584:12345-0@lo:502: 00000100:00100000:3.0:1788869354.635025:0:5750:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c81f0ff050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:121cd5bc-7f07-4cf7-8e2e-4356c89c0696+18:7875:x1875765421427584:12345-0@lo:502: Request processed in 179us (221us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869354.635032:0:5750:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:3.0:1788869354.635062:0:7875:0:(client.c:2702:ptlrpc_set_wait()) set ffff94c818106c00 going to sleep for 11 seconds 00000100:00100000:3.0:1788869354.635072:0:7875:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94c82d042a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:121cd5bc-7f07-4cf7-8e2e-4356c89c0696:7875:1875765421427584:0@lo:502: 00000020:01000000:3.0:1788869354.635092:0:7875:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1788869354.635099:0:7875:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-mdt1/mdt1 00000020:00000080:3.0:1788869354.635106:0:7875:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788869354.635109:0:7875:0:(obd_config.c:1561:class_process_config()) marker 18 (0x1) lustre-OST0001 add osc 00000020:00000080:3.0:1788869354.635115:0:7875:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1788869354.635123:0:7875:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.201.139@tcp to nid 0x20000c0a8c98b (192.168.201.139@tcp) 00000020:01000000:3.0:1788869354.635146:0:7875:0:(obd_config.c:1975:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:3.0:1788869354.635148:0:7875:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788869354.635173:0:7875:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff94c82c848000) 00000020:00000080:3.0:1788869354.635194:0:7875:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type osp with refcount 2 00000020:00000080:3.0:1788869354.635200:0:7875:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1788869354.635310:0:7875:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:3.0:1788869354.635316:0:7875:0:(osd_handler.c:1569:osd_obd_connect()) connect #6 00000020:00000080:3.0:1788869354.635324:0:7875:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x3d2d1916761d639b 00010000:00080000:3.0:1788869354.635356:0:7875:0:(ldlm_lib.c:102:import_set_conn()) imp ffff94c810e57800@lustre-OST0001-osc-MDT0000: add connection 192.168.201.139@tcp at head 00010000:00010000:3.0:1788869354.635728:0:7875:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-5 is initialized 00000040:01000000:3.0:1788869354.636019:0:7875:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:01000000:3.0:1788869354.636031:0:7875:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:3.0:1788869354.638734:0:7875:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788869354.638946:0:7875:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788869354.638997:0:7875:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].1, 64 off8256 00000040:00080000:3.0:1788869354.639053:0:7875:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1, 64 off8256 00000040:00080000:3.0:1788869354.640433:0:7877:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788869354.640441:0:7877:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x6:0x0] at index 1 of catalog [0x1:0x5:0x0] 00000020:00000080:3.0:1788869354.641024:0:7875:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1788869354.641036:0:7875:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00d 00000004:01000000:3.0:1788869354.641069:0:7875:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:3.0:1788869354.641093:0:7875:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x3d2d1916761d63a2 00000100:00080000:3.0:1788869354.641106:0:7875:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788869354.641113:0:7875:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff94c810e57800 using connection 192.168.201.139@tcp/0@lo 00000100:00100000:3.0:1788869354.641153:0:7875:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff94c82d042a00 x1875765421427712/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788869354.641208:0:3282:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94c82d042a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3282:1875765421427712:0@lo:8: 00000100:00100000:2.0:1788869354.641308:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1788869354.641396:0:7875:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:3.0:1788869354.641445:0:7875:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788869354.641449:0:7875:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788869354.641456:0:7875:0:(obd_config.c:1561:class_process_config()) marker 18 (0x2) lustre-OST0001 add osc 00000020:01000000:3.0:1788869354.641460:0:7875:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788869354.641464:0:7875:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788869354.641465:0:7875:0:(obd_config.c:1561:class_process_config()) marker 21 (0x1) lustre sys.timeout 00000020:00000080:3.0:1788869354.641468:0:7875:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1788869354.641470:0:7875:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:3.0:1788869354.641495:0:7875:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94c82d042680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:121cd5bc-7f07-4cf7-8e2e-4356c89c0696:7875:1875765421427840:0@lo:502: 00000100:00100000:3.0:1788869354.641535:0:7875:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869354.641564:0:5750:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765421427840 00000100:00100000:3.0:1788869354.641572:0:5750:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765421427840 00000100:00100000:3.0:1788869354.641613:0:5750:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:3.0:1788869354.641621:0:5750:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c81f0fc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:121cd5bc-7f07-4cf7-8e2e-4356c89c0696+18:7875:x1875765421427840:12345-0@lo:502: 00000100:00100000:3.0:1788869354.641834:0:5750:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c81f0fc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:121cd5bc-7f07-4cf7-8e2e-4356c89c0696+18:7875:x1875765421427840:12345-0@lo:502: Request processed in 212us (297us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869354.641842:0:5750:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:3.0:1788869354.641883:0:7875:0:(client.c:2702:ptlrpc_set_wait()) set ffff94c81042e0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788869354.641905:0:7875:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94c82d042680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:121cd5bc-7f07-4cf7-8e2e-4356c89c0696:7875:1875765421427840:0@lo:502: 00000020:01000000:3.0:1788869354.641930:0:7875:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788869354.641933:0:7875:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788869354.641935:0:7875:0:(obd_config.c:1561:class_process_config()) marker 21 (0x2) lustre sys.timeout 00000040:00080000:3.0:1788869354.641938:0:7875:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 34 count 34 00000020:01000000:3.0:1788869354.641983:0:5752:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 25-33 (rc=0) 10000000:01000000:3.0:1788869354.642005:0:5752:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.139@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:3.0:1788869354.642016:0:5752:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.139@tcp lock: ffff94c81a583400/0x3d2d1916761d6386 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x3d2d1916761d638d expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869354.642028:0:5752:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.139@tcp lock: ffff94c81a583400/0x3d2d1916761d6386 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x3d2d1916761d638d expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788869354.642039:0:5752:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:3.0:1788869354.642046:0:5752:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-sptlrpc-ffff94c81f1a99c0 from 1 10000000:01000000:3.0:1788869354.642049:0:5752:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1788869354.642074:0:5752:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.139@tcp lock: ffff94c800030e00/0x3d2d1916761d63a9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869354.642083:0:5752:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.139@tcp lock: ffff94c800030e00/0x3d2d1916761d63a9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869354.642094:0:5752:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.139@tcp lock: ffff94c800030e00/0x3d2d1916761d63a9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788869354.642104:0:5752:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94c82d042680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:121cd5bc-7f07-4cf7-8e2e-4356c89c0696:5752:1875765421427968:0@lo:101: 00000100:00100000:3.0:1788869354.642128:0:5752:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869354.642141:0:5752:0:(client.c:2702:ptlrpc_set_wait()) set ffff94c81042e0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788869354.642288:0:6546:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765421427712 00000100:00100000:1.0:1788869354.642292:0:6546:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765421427712 00000100:00100000:1.0:1788869354.642318:0:6546:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788869354.642324:0:6546:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c803fb9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3282:x1875765421427712:12345-0@lo:8: 00010000:00080000:1.0:1788869354.642348:0:6546:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 102 last 0 00000020:00000080:1.0:1788869354.642385:0:6546:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x3d2d1916761d63b0 00002000:00100000:1.0:1788869354.642401:0:6546:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff94c83cbf7800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113718 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:1.0:1788869354.642406:0:6546:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00000001:00000004:1.0:1788869354.642411:0:6546:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00002000:00100000:1.0:1788869354.642524:0:6546:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:1.0:1788869354.642651:0:6546:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1788869354.642676:0:6546:0:(import.c:65:import_set_state_nolock()) ffff94c83cbf0000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788869354.643023:0:6546:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c803fb9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3282:x1875765421427712:12345-0@lo:8: Request processed in 697us (1714us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869354.643030:0:6546:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788869354.643125:0:3283:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94c81f1f1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3283:1875765421428224:0@lo:400: 00000100:00100000:1.0:1788869354.643158:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869354.643178:0:3283:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788869354.643183:0:3283:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94c81f1f3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3283:1875765421428352:0@lo:400: 00000100:00100000:1.0:1788869354.643201:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869354.643230:0:5756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765421428224 00000100:00100000:1.0:1788869354.643234:0:5756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765421428224 00000100:00100000:1.0:1788869354.643345:0:5756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788869354.643352:0:5756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c81f1f2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3283:x1875765421428224:12345-0@lo:400: 00000100:00100000:0.0:1788869354.643408:0:3285:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94c81f1f1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3285:1875765421428480:0@lo:400: 00000100:00100000:0.0:1788869354.643440:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869354.643461:0:3285:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788869354.643466:0:3285:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94c81f1f2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3285:1875765421428096:0@lo:400: 00000100:00100000:0.0:1788869354.643483:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869354.643506:0:6547:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765421428352 00000100:00100000:0.0:1788869354.643509:0:6547:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765421428352 00000100:00100000:0.0:1788869354.643536:0:6547:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788869354.643542:0:6547:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c81f1f1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3283:x1875765421428352:12345-0@lo:400: 00000100:00100000:0.0:1788869354.643573:0:6547:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c81f1f1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3283:x1875765421428352:12345-0@lo:400: Request processed in 31us (371us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869354.643579:0:6547:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788869354.643599:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765421428480 00000100:00100000:0.0:1788869354.643601:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765421428480 00000100:00100000:0.0:1788869354.643614:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765421428096 00000100:00100000:0.0:1788869354.643616:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765421428096 00000100:00100000:0.0:1788869354.643626:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788869354.643631:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c8349ee680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3285:x1875765421428480:12345-0@lo:400: 00000100:00100000:0.0:1788869354.643660:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c8349ee680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3285:x1875765421428480:12345-0@lo:400: Request processed in 29us (220us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869354.643666:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788869354.643685:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788869354.643690:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c8349ed180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3285:x1875765421428096:12345-0@lo:400: 00000100:00100000:0.0:1788869354.643715:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c8349ed180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3285:x1875765421428096:12345-0@lo:400: Request processed in 25us (231us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869354.643721:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00010000:00080000:0.0:1788869354.643753:0:3283:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff94c81f1f3800 x1875765421428352/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788869370 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788869354.643766:0:3283:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94c81f1f3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3283:1875765421428352:0@lo:400: 00010000:00080000:0.0:1788869354.643791:0:3285:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff94c81f1f2300 x1875765421428096/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788869370 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788869354.643800:0:3285:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94c81f1f2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3285:1875765421428096:0@lo:400: 00010000:00080000:0.0:1788869354.643809:0:3285:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff94c81f1f1500 x1875765421428480/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788869370 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788869354.643817:0:3285:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94c81f1f1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3285:1875765421428480:0@lo:400: 00000100:00100000:1.0:1788869354.643955:0:5756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c81f1f2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3283:x1875765421428224:12345-0@lo:400: Request processed in 603us (795us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869354.643962:0:5756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00080000:1.0:1788869354.643980:0:5751:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788869354.643985:0:5751:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788869354.645510:0:5749:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765421427968 00000100:00100000:3.0:1788869354.645524:0:5749:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765421427968 00000100:00100000:3.0:1788869354.645626:0:5749:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:3.0:1788869354.645634:0:5749:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c81f0fd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:121cd5bc-7f07-4cf7-8e2e-4356c89c0696+18:5752:x1875765421427968:12345-0@lo:101: 00010000:00010000:3.0:1788869354.645648:0:5749:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788869354.645667:0:5749:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff94c800030400/0x3d2d1916761d63b7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x3d2d1916761d63a9 expref: -99 pid: 5749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869354.645696:0:5749:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff94c800030400/0x3d2d1916761d63b7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3d2d1916761d63a9 expref: 19 pid: 5749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869354.645708:0:5749:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff94c800030400/0x3d2d1916761d63b7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3d2d1916761d63a9 expref: 19 pid: 5749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869354.645717:0:5749:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94c800030400, rc 0) 00000100:00100000:3.0:1788869354.645773:0:5749:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c81f0fd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:121cd5bc-7f07-4cf7-8e2e-4356c89c0696+19:5752:x1875765421427968:12345-0@lo:101: Request processed in 139us (3643us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869354.645785:0:5749:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:3.0:1788869354.645837:0:5752:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94c82d042680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:121cd5bc-7f07-4cf7-8e2e-4356c89c0696:5752:1875765421427968:0@lo:101: 00010000:00010000:3.0:1788869354.645857:0:5752:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.139@tcp lock: ffff94c800030e00/0x3d2d1916761d63a9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x3d2d1916761d63b7 expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869354.645867:0:5752:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.139@tcp lock: ffff94c800030e00/0x3d2d1916761d63a9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x3d2d1916761d63b7 expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788869354.645935:0:5752:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94c82d042680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:121cd5bc-7f07-4cf7-8e2e-4356c89c0696:5752:1875765421428608:0@lo:501: 00000100:00100000:3.0:1788869354.645965:0:5752:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869354.645994:0:5752:0:(client.c:2702:ptlrpc_set_wait()) set ffff94c81042e0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788869354.646007:0:5750:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765421428608 00000100:00100000:3.0:1788869354.646010:0:5750:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765421428608 00000100:00100000:3.0:1788869354.646025:0:5750:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:3.0:1788869354.646030:0:5750:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c81f0fc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:121cd5bc-7f07-4cf7-8e2e-4356c89c0696+19:5752:x1875765421428608:12345-0@lo:501: 00000100:00100000:3.0:1788869354.646285:0:5750:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c81f0fc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:121cd5bc-7f07-4cf7-8e2e-4356c89c0696+19:5752:x1875765421428608:12345-0@lo:501: Request processed in 253us (319us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788869354.646292:0:5750:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:3.0:1788869354.646321:0:5752:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94c82d042680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:121cd5bc-7f07-4cf7-8e2e-4356c89c0696:5752:1875765421428608:0@lo:501: 10000000:01000000:3.0:1788869354.646347:0:5752:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.139@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:3.0:1788869354.646354:0:5752:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.139@tcp lock: ffff94c800030e00/0x3d2d1916761d63a9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x3d2d1916761d63b7 expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869354.646362:0:5752:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.139@tcp lock: ffff94c800030e00/0x3d2d1916761d63a9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x3d2d1916761d63b7 expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00080000:0.0:1788869354.646479:0:3283:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff94c81f1f1f80 x1875765421428224/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788869370 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788869354.646492:0:3283:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94c81f1f1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3283:1875765421428224:0@lo:400: 00010000:00080000:2.0:1788869354.647417:0:3282:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff94c82d042a00 x1875765421427712/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788869364 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788869354.647430:0:3282:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1788869354.647439:0:3282:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 1 00000100:00080000:2.0:1788869354.647448:0:3282:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:2.0:1788869354.647454:0:3282:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:2.0:1788869354.647458:0:3282:0:(import.c:65:import_set_state_nolock()) ffff94c810e57800 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:2.0:1788869354.648395:0:3282:0:(osp_dev.c:1705:osp_import_event()) got connected 00000100:00100000:2.0:1788869354.648406:0:3282:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94c82d042a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3282:1875765421427712:0@lo:8: 00000004:00080000:0.0:1788869354.650792:0:7877:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:0.0:1788869354.650979:0:7877:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 102942728098ns, next at 0ns, rc = 0 00000004:00080000:3.0:1788869354.695573:0:7878:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x100010000:0x1:0x0] 00000100:00100000:3.0:1788869354.695618:0:7878:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94c82d040e00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7878:1875765421428864:0@lo:7: 00000100:00100000:3.0:1788869354.695707:0:7878:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869354.695765:0:7878:0:(client.c:2702:ptlrpc_set_wait()) set ffff94c81042e0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788869354.695787:0:3286:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94c82d042680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3286:1875765421428736:0@lo:13: 00000100:00100000:3.0:1788869354.695812:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869354.695854:0:6548:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765421428736 00000100:00100000:3.0:1788869354.695863:0:6546:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765421428864 00000100:00100000:1.0:1788869354.695864:0:6548:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765421428736 00000100:00100000:3.0:1788869354.695870:0:6546:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765421428864 00000100:00100000:1.0:1788869354.695932:0:6548:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788869354.697177:0:6548:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c82d040700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3286:x1875765421428736:12345-0@lo:13: 00002000:00000024:1.0:1788869354.697217:0:6548:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3860856832 avail 3858759680 00000100:00100000:1.0:1788869354.697316:0:6548:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c82d040700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3286:x1875765421428736:12345-0@lo:13: Request processed in 1375us (1501us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869354.697325:0:6548:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:1.0:1788869354.697351:0:5751:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:3.0:1788869354.701024:0:3286:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff94c82d042680 x1875765421428736/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788869370 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788869354.701058:0:3286:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94c82d042680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3286:1875765421428736:0@lo:13: 00000100:00100000:1.0:1788869354.701506:0:6547:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788869354.701515:0:6546:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:1.0:1788869354.701522:0:6547:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c82d041180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:7878:x1875765421428864:12345-0@lo:7: 00000100:00100000:3.0:1788869354.701528:0:6546:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00002000:00080000:1.0:1788869354.706925:0:6547:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x0 00002000:00080000:1.0:1788869354.706934:0:6547:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x100010000:0x0:0x0] 00000100:00100000:1.0:1788869354.707050:0:6547:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c82d041180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:7878:x1875765421428864:12345-0@lo:7: Request processed in 5528us (11338us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869354.707063:0:6547:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:2.0:1788869354.707652:0:7878:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff94c82d040e00 x1875765421428864/t0(0) o7->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1788869370 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788869354.707672:0:7878:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94c82d040e00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7878:1875765421428864:0@lo:7: 00000004:00080000:2.0:1788869354.707692:0:7878:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0000: Got last_fid [0x100010000:0x0:0x0] 00000100:00100000:2.0:1788869354.707746:0:7878:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94c803fba680 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7878:1875765421428992:0@lo:5: 00000100:00100000:2.0:1788869354.707790:0:7878:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869354.707972:0:7878:0:(client.c:2702:ptlrpc_set_wait()) set ffff94c80893ba80 going to sleep for 11 seconds 00000100:00100000:1.0:1788869354.708982:0:7884:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765421428992 00000100:00100000:1.0:1788869354.708992:0:7884:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765421428992 00000100:00100000:3.0:1788869354.711280:0:6546:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788869354.711301:0:6546:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c803fbaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:7878:x1875765421428992:12345-0@lo:5: 00002000:00080000:3.0:1788869354.711342:0:6546:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:3.0:1788869354.711348:0:6546:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 1 objects in group 0x0 at 1 00000100:00100000:3.0:1788869354.711815:0:6546:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c803fbaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:7878:x1875765421428992:12345-0@lo:5: Request processed in 520us (4023us total) trans 4294967297 rc 0/0 00000100:00100000:3.0:1788869354.711824:0:6546:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:3.0:1788869354.711886:0:7878:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff94c803fba680 x1875765421428992/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788869370 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788869354.711907:0:7878:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94c803fba680 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7878:1875765421428992:0@lo:5: 00000004:00080000:3.0:1788869354.711925:0:7878:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x100010000:0x1:0x0] from OST, last_created [0x100010000:0x1:0x0]last_used is [0x100010000:0x1:0x0] 00000100:00100000:3.0:1788869354.711971:0:7878:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94c82d042680 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7878:1875765421429120:0@lo:700: 00000100:00100000:3.0:1788869354.712009:0:7878:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869354.712059:0:7878:0:(client.c:2702:ptlrpc_set_wait()) set ffff94c81042e000 going to sleep for 11 seconds 00000100:00100000:0.0:1788869354.713567:0:6553:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765421429120 00000100:00100000:0.0:1788869354.713580:0:6553:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765421429120 00000100:00100000:0.0:1788869354.713722:0:6553:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788869354.713734:0:6553:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c82d040e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+7:7878:x1875765421429120:12345-0@lo:700: 00000100:00100000:0.0:1788869354.713779:0:6553:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94c8349eea00 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:6553:1875765421429248:0@lo:700: 00000100:00100000:0.0:1788869354.713832:0:6553:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869354.713858:0:6553:0:(client.c:2702:ptlrpc_set_wait()) set ffff94c805068840 going to sleep for 11 seconds 00000100:00100000:3.0:1788869354.716599:0:5762:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765421429248 00000100:00100000:3.0:1788869354.716614:0:5762:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765421429248 00000100:00100000:3.0:1788869354.716672:0:5762:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788869354.716685:0:5762:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c8349ed500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:6553:x1875765421429248:12345-0@lo:700: 00000004:00080000:0.0:1788869354.724477:0:5777:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 40000000:02000000:1.0:1788869354.743815:0:5762:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:1:ost 00000100:00100000:1.0:1788869354.747063:0:5762:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c8349ed500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:6553:x1875765421429248:12345-0@lo:700: Request processed in 30372us (33220us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869354.747090:0:5762:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1788869354.747116:0:6553:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff94c8349eea00 x1875765421429248/t0(0) o700->lustre-MDT0000-lwp-OST0001@0@lo:32/10 lens 264/248 e 0 to 0 dl 1788869370 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788869354.747136:0:6553:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94c8349eea00 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:6553:1875765421429248:0@lo:700: 40000000:02000000:0.0:1788869354.747154:0:6553:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0001-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:1:ost] 00000001:00100000:3.0:1788869354.848973:0:7458:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00080000:3.0:1788869354.848995:0:7458:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967297 is committed 00000100:00100000:2.0:1788869354.849070:0:6553:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c82d040e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:7878:x1875765421429120:12345-0@lo:700: Request processed in 135330us (137051us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869354.849105:0:6553:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1788869354.849125:0:7878:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff94c82d042680 x1875765421429120/t0(0) o700->lustre-OST0001-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1788869370 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788869354.849143:0:7878:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94c82d042680 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7878:1875765421429120:0@lo:700: 00000004:02000040:2.0:1788869354.870400:0:7878:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0001-osc-MDT0000: update sequence from 0x100010000 to 0x280000400 00000100:00100000:3.0:1788869354.874863:0:7878:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94c82d042680 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7878:1875765421429376:0@lo:5: 00000100:00100000:3.0:1788869354.874935:0:7878:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869354.874989:0:6547:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765421429376 00000100:00100000:3.0:1788869354.874997:0:6547:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765421429376 00000100:00100000:3.0:1788869354.875057:0:6547:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788869354.875068:0:6547:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c82d042a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:7878:x1875765421429376:12345-0@lo:5: 00000100:00100000:2.0:1788869354.876384:0:7878:0:(client.c:2702:ptlrpc_set_wait()) set ffff94c81042e000 going to sleep for 11 seconds 00002000:00080000:2.0:1788869354.881722:0:6547:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x280000400 00002000:00080000:2.0:1788869354.881820:0:6547:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x280000400 at 2 00000100:00100000:3.0:1788869354.885131:0:6547:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c82d042a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:7878:x1875765421429376:12345-0@lo:5: Request processed in 10059us (10190us total) trans 4294967298 rc 0/0 00000100:00100000:3.0:1788869354.885143:0:6547:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:2.0:1788869354.885215:0:7878:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff94c82d042680 x1875765421429376/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788869370 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788869354.885234:0:7878:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:2.0:1788869354.885292:0:7878:0:(client.c:3156:ptlrpc_free_committed()) @@@ stopping search req@ffff94c82d042680 x1875765421429376/t4294967298(4294967298) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788869370 ref 3 fl Rpc:RQU/204/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788869354.885309:0:7878:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94c82d042680 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7878:1875765421429376:0@lo:5: 00000004:00080000:2.0:1788869354.885328:0:7878:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x280000400:0x1:0x0]-[0x280000400:0x21:0x0] 00010000:00010000:0.0:1788869354.907660:0:5743:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788869355.934488:0:7447:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788869356.635390:0:3284:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788869356.635420:0:3284:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94c81f1f1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3284:1875765421429504:0@lo:13: 00000100:00100000:1.0:1788869356.635484:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869356.635873:0:6548:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765421429504 00000100:00100000:1.0:1788869356.635880:0:6548:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765421429504 00000100:00080000:0.0:1788869356.635931:0:5751:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788869356.635937:0:6548:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788869356.635947:0:6548:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c81f1f1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3284:x1875765421429504:12345-0@lo:13: 00002000:00000024:1.0:1788869356.635985:0:6548:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788869356.636033:0:6548:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c81f1f1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3284:x1875765421429504:12345-0@lo:13: Request processed in 88us (548us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869356.636040:0:6548:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:0.0:1788869356.636070:0:3284:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff94c81f1f1f80 x1875765421429504/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788869372 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788869356.636093:0:3284:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94c81f1f1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3284:1875765421429504:0@lo:13: 00010000:00010000:0.0:1788869356.956385:0:5742:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1788869357.033804:0:7458:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967298 is committed 00000100:00100000:3.0:1788869357.308445:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1788869357.308483:0:5750:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765413019776 00000100:00100000:3.0:1788869357.308499:0:5750:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765413019776 00000100:00100000:3.0:1788869357.308538:0:5750:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 107 00000100:00100000:3.0:1788869357.308547:0:5750:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c81f0f9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0+-99:2344:x1875765413019776:12345-192.168.201.39@tcp:250: 00010000:00080000:3.0:1788869357.308578:0:5750:0:(ldlm_lib.c:1445:target_handle_connect()) MGS: connection from 3cca3acf-4935-4d0d-9982-d5d931f1c86b@192.168.201.39@tcp t0 exp 0000000000000000 cur 105 last 0 00000020:00000080:3.0:1788869357.308616:0:5750:0:(genops.c:1406:class_connect()) connect: client 3cca3acf-4935-4d0d-9982-d5d931f1c86b, cookie 0x3d2d1916761d63be 00000100:00080000:3.0:1788869357.308773:0:5750:0:(import.c:65:import_set_state_nolock()) ffff94c810e53000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788869357.308838:0:5750:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c81f0f9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3cca3acf-4935-4d0d-9982-d5d931f1c86b+5:2344:x1875765413019776:12345-192.168.201.39@tcp:250: Request processed in 290us (403us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869357.308847:0:5750:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 107 00000100:00100000:2.0:1788869357.312801:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1788869357.312841:0:5748:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765413019904 00000100:00100000:2.0:1788869357.312850:0:5748:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765413019904 00000100:00100000:2.0:1788869357.312901:0:5748:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 108 00000100:00100000:2.0:1788869357.312912:0:5748:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c81f0fa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3cca3acf-4935-4d0d-9982-d5d931f1c86b+5:5541:x1875765413019904:12345-192.168.201.39@tcp:101: 00010000:00010000:2.0:1788869357.312928:0:5748:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788869357.312946:0:5748:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff94c80153aa00/0x3d2d1916761d63c5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x375c010249035705 expref: -99 pid: 5748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869357.312989:0:5748:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff94c80153aa00/0x3d2d1916761d63c5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.201.39@tcp remote: 0x375c010249035705 expref: 6 pid: 5748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869357.313001:0:5748:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff94c80153aa00/0x3d2d1916761d63c5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.201.39@tcp remote: 0x375c010249035705 expref: 6 pid: 5748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869357.313027:0:5748:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94c80153aa00, rc 0) 00000100:00100000:2.0:1788869357.313083:0:5748:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c81f0fa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3cca3acf-4935-4d0d-9982-d5d931f1c86b+6:5541:x1875765413019904:12345-192.168.201.39@tcp:101: Request processed in 173us (290us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869357.313091:0:5748:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 108 00000100:00100000:1.0:1788869357.317471:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1788869357.317823:0:5749:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765413020032 00000100:00100000:3.0:1788869357.317833:0:5749:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765413020032 00000100:00100000:3.0:1788869357.317913:0:5749:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 109 00000100:00100000:3.0:1788869357.317922:0:5749:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c81f0fbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3cca3acf-4935-4d0d-9982-d5d931f1c86b+6:5541:x1875765413020032:12345-192.168.201.39@tcp:501: 00000100:00100000:3.0:1788869357.318183:0:5749:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c81f0fbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3cca3acf-4935-4d0d-9982-d5d931f1c86b+6:5541:x1875765413020032:12345-192.168.201.39@tcp:501: Request processed in 262us (720us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788869357.318192:0:5749:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 109 00000100:00100000:3.0:1788869357.324123:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1788869357.324268:0:5748:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765413020160 00000100:00100000:0.0:1788869357.324278:0:5748:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765413020160 00000100:00100000:0.0:1788869357.324338:0:5748:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 110 00000100:00100000:0.0:1788869357.324349:0:5748:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c81f0fa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3cca3acf-4935-4d0d-9982-d5d931f1c86b+6:5541:x1875765413020160:12345-192.168.201.39@tcp:101: 00010000:00010000:0.0:1788869357.324365:0:5748:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788869357.324383:0:5748:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff94c818d1fc00/0x3d2d1916761d63cc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x375c01024903570c expref: -99 pid: 5748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869357.324413:0:5748:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff94c818d1fc00/0x3d2d1916761d63cc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.201.39@tcp remote: 0x375c01024903570c expref: 7 pid: 5748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869357.324424:0:5748:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff94c818d1fc00/0x3d2d1916761d63cc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.201.39@tcp remote: 0x375c01024903570c expref: 7 pid: 5748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869357.324444:0:5748:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94c818d1fc00, rc 0) 00000100:00100000:0.0:1788869357.324507:0:5748:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c81f0fa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3cca3acf-4935-4d0d-9982-d5d931f1c86b+7:5541:x1875765413020160:12345-192.168.201.39@tcp:101: Request processed in 160us (401us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869357.324515:0:5748:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 110 00000100:00100000:2.0:1788869357.326545:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1788869357.326616:0:5749:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765413020288 00000100:00100000:3.0:1788869357.326624:0:5749:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765413020288 00000100:00100000:3.0:1788869357.326714:0:5749:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 111 00000100:00100000:3.0:1788869357.326723:0:5749:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c81f0fac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3cca3acf-4935-4d0d-9982-d5d931f1c86b+7:5541:x1875765413020288:12345-192.168.201.39@tcp:501: 00000100:00100000:3.0:1788869357.327129:0:5749:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c81f0fac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3cca3acf-4935-4d0d-9982-d5d931f1c86b+8:5541:x1875765413020288:12345-192.168.201.39@tcp:501: Request processed in 406us (591us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869357.327137:0:5749:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 111 00000100:00100000:1.0:1788869357.329579:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1788869357.329664:0:5750:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765413020416 00000100:00100000:0.0:1788869357.329673:0:5750:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765413020416 00000100:00100000:0.0:1788869357.329722:0:5750:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 112 00000100:00100000:0.0:1788869357.329732:0:5750:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c81f0fb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3cca3acf-4935-4d0d-9982-d5d931f1c86b+8:5541:x1875765413020416:12345-192.168.201.39@tcp:503: 00000100:00100000:0.0:1788869357.330061:0:5750:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c81f0fb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3cca3acf-4935-4d0d-9982-d5d931f1c86b+8:5541:x1875765413020416:12345-192.168.201.39@tcp:503: Request processed in 329us (487us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869357.330070:0:5750:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 112 00000100:00100000:3.0:1788869357.333751:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1788869357.333792:0:5749:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765413020544 00000100:00100000:3.0:1788869357.333805:0:5749:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765413020544 00000100:00100000:3.0:1788869357.333854:0:5749:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 113 00000100:00100000:3.0:1788869357.333863:0:5749:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c81f0fb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3cca3acf-4935-4d0d-9982-d5d931f1c86b+8:5559:x1875765413020544:12345-192.168.201.39@tcp:502: 00000100:00100000:3.0:1788869357.334219:0:5749:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c81f0fb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3cca3acf-4935-4d0d-9982-d5d931f1c86b+8:5559:x1875765413020544:12345-192.168.201.39@tcp:502: Request processed in 355us (477us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869357.334233:0:5749:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 113 00000100:00100000:2.0:1788869357.399504:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1788869357.399543:0:5748:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765413020672 00000100:00100000:2.0:1788869357.399552:0:5748:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765413020672 00000100:00100000:2.0:1788869357.399604:0:5748:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 114 00000100:00100000:2.0:1788869357.399616:0:5748:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c81f0f9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3cca3acf-4935-4d0d-9982-d5d931f1c86b+8:5559:x1875765413020672:12345-192.168.201.39@tcp:502: 00000100:00100000:2.0:1788869357.399935:0:5748:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c81f0f9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3cca3acf-4935-4d0d-9982-d5d931f1c86b+8:5559:x1875765413020672:12345-192.168.201.39@tcp:502: Request processed in 321us (438us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869357.399945:0:5748:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 114 00000100:00100000:1.0:1788869357.402736:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1788869357.403208:0:5750:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765413020800 00000100:00100000:3.0:1788869357.403217:0:5750:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765413020800 00000100:00100000:3.0:1788869357.403680:0:5750:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 115 00000100:00100000:3.0:1788869357.403691:0:5750:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c81f0fa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3cca3acf-4935-4d0d-9982-d5d931f1c86b+8:5541:x1875765413020800:12345-192.168.201.39@tcp:101: 00010000:00010000:3.0:1788869357.403708:0:5750:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788869357.403725:0:5750:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff94c800031000/0x3d2d1916761d63d3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x375c010249035736 expref: -99 pid: 5750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869357.403754:0:5750:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff94c800031000/0x3d2d1916761d63d3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.201.39@tcp remote: 0x375c010249035736 expref: 9 pid: 5750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869357.403767:0:5750:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff94c800031000/0x3d2d1916761d63d3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.201.39@tcp remote: 0x375c010249035736 expref: 9 pid: 5750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869357.403776:0:5750:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94c800031000, rc 0) 00000100:00100000:3.0:1788869357.403877:0:5750:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c81f0fa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3cca3acf-4935-4d0d-9982-d5d931f1c86b+9:5541:x1875765413020800:12345-192.168.201.39@tcp:101: Request processed in 188us (1148us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869357.403885:0:5750:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 115 00000100:00100000:3.0:1788869357.406684:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1788869357.406757:0:5749:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765413020928 00000100:00100000:0.0:1788869357.406766:0:5749:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765413020928 00000100:00100000:0.0:1788869357.406811:0:5749:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 116 00000100:00100000:0.0:1788869357.406821:0:5749:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c81f0f8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3cca3acf-4935-4d0d-9982-d5d931f1c86b+9:5541:x1875765413020928:12345-192.168.201.39@tcp:256: 20000000:01000000:0.0:1788869357.406843:0:5749:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:0.0:1788869357.406862:0:5749:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:0.0:1788869357.406866:0:5749:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:0.0:1788869357.406869:0:5749:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:0.0:1788869357.406872:0:5749:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 5 00000100:00100000:0.0:1788869357.409161:0:5749:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c81f0f8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3cca3acf-4935-4d0d-9982-d5d931f1c86b+9:5541:x1875765413020928:12345-192.168.201.39@tcp:256: Request processed in 2333us (2475us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869357.409175:0:5749:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 116 00000100:00100000:3.0:1788869357.412125:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1788869357.412361:0:5748:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765413021056 00000100:00100000:0.0:1788869357.412371:0:5748:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765413021056 00000100:00100000:0.0:1788869357.412461:0:5748:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 117 00000100:00100000:0.0:1788869357.412487:0:5748:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c81f0fb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3cca3acf-4935-4d0d-9982-d5d931f1c86b+9:5541:x1875765413021056:12345-192.168.201.39@tcp:101: 00010000:00010000:0.0:1788869357.412504:0:5748:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788869357.412520:0:5748:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff94c818d1f000/0x3d2d1916761d63da lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x375c01024903573d expref: -99 pid: 5748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869357.412546:0:5748:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff94c818d1f000/0x3d2d1916761d63da lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.201.39@tcp remote: 0x375c01024903573d expref: 10 pid: 5748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869357.412558:0:5748:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff94c818d1f000/0x3d2d1916761d63da lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.201.39@tcp remote: 0x375c01024903573d expref: 10 pid: 5748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869357.412567:0:5748:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94c818d1f000, rc 0) 00000100:00100000:0.0:1788869357.412613:0:5748:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c81f0fb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3cca3acf-4935-4d0d-9982-d5d931f1c86b+10:5541:x1875765413021056:12345-192.168.201.39@tcp:101: Request processed in 131us (571us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869357.412619:0:5748:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 117 00000100:00100000:0.0:1788869357.414921:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1788869357.414991:0:5749:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765413021184 00000100:00100000:1.0:1788869357.415006:0:5749:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765413021184 00000100:00100000:1.0:1788869357.415077:0:5749:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 118 00000100:00100000:1.0:1788869357.415107:0:5749:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c81f0f8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3cca3acf-4935-4d0d-9982-d5d931f1c86b+10:5541:x1875765413021184:12345-192.168.201.39@tcp:501: 00000100:00100000:1.0:1788869357.415533:0:5749:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c81f0f8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3cca3acf-4935-4d0d-9982-d5d931f1c86b+10:5541:x1875765413021184:12345-192.168.201.39@tcp:501: Request processed in 429us (615us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869357.415545:0:5749:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 118 00000100:00100000:3.0:1788869357.417424:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1788869357.417475:0:5748:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765413021312 00000100:00100000:1.0:1788869357.417488:0:5748:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765413021312 00000100:00100000:1.0:1788869357.417555:0:5748:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 119 00000100:00100000:1.0:1788869357.417571:0:5748:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c81f0f9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3cca3acf-4935-4d0d-9982-d5d931f1c86b+10:5541:x1875765413021312:12345-192.168.201.39@tcp:503: 00000100:00100000:1.0:1788869357.418446:0:5748:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c81f0f9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3cca3acf-4935-4d0d-9982-d5d931f1c86b+10:5541:x1875765413021312:12345-192.168.201.39@tcp:503: Request processed in 877us (1027us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869357.418459:0:5748:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 119 00000100:00100000:0.0:1788869357.423338:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1788869357.423376:0:5749:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765413021440 00000100:00100000:0.0:1788869357.423386:0:5749:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765413021440 00000100:00100000:0.0:1788869357.423432:0:5749:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 120 00000100:00100000:0.0:1788869357.423442:0:5749:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c81f0f8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3cca3acf-4935-4d0d-9982-d5d931f1c86b+10:5563:x1875765413021440:12345-192.168.201.39@tcp:502: 00000100:00100000:0.0:1788869357.423680:0:5749:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c81f0f8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3cca3acf-4935-4d0d-9982-d5d931f1c86b+10:5563:x1875765413021440:12345-192.168.201.39@tcp:502: Request processed in 238us (361us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869357.423689:0:5749:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 120 00000100:00100000:0.0:1788869357.425814:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1788869357.425884:0:5748:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765413021568 00000100:00100000:1.0:1788869357.425893:0:5748:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765413021568 00000100:00100000:1.0:1788869357.425944:0:5748:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 121 00000100:00100000:1.0:1788869357.425952:0:5748:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c81f0f9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3cca3acf-4935-4d0d-9982-d5d931f1c86b+10:5563:x1875765413021568:12345-192.168.201.39@tcp:502: 00000100:00100000:1.0:1788869357.426220:0:5748:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c81f0f9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3cca3acf-4935-4d0d-9982-d5d931f1c86b+10:5563:x1875765413021568:12345-192.168.201.39@tcp:502: Request processed in 267us (410us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869357.426228:0:5748:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 121 00000100:00100000:3.0:1788869357.428626:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1788869357.428748:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765413021696 00000100:00100000:1.0:1788869357.428756:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765413021696 00000100:00100000:1.0:1788869357.428795:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 4 00000100:00100000:1.0:1788869357.428802:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c82d041f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2344:x1875765413021696:12345-192.168.201.39@tcp:38: 00010000:00080000:1.0:1788869357.428829:0:5786:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0000: connection from 2125b9b3-626e-4cbe-be83-fb446e976ce2@192.168.201.39@tcp t0 exp 0000000000000000 cur 105 last 0 00000020:00000080:1.0:1788869357.428876:0:5786:0:(genops.c:1406:class_connect()) connect: client 2125b9b3-626e-4cbe-be83-fb446e976ce2, cookie 0x3d2d1916761d63e1 00000004:00100000:1.0:1788869357.428905:0:5786:0:(mdt_handler.c:7362:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000001:00000004:1.0:1788869357.428918:0:5786:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000100:00080000:2.0:1788869357.443575:0:5786:0:(import.c:65:import_set_state_nolock()) ffff94c834da8800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788869357.443640:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c82d041f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2125b9b3-626e-4cbe-be83-fb446e976ce2+6:2344:x1875765413021696:12345-192.168.201.39@tcp:38: Request processed in 14836us (15020us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869357.443652:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 4 00010000:00010000:0.0:1788869357.979734:0:5743:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788869358.446931:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1788869358.447050:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1788869358.447242:0:5756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765413021952 00000100:00100000:2.0:1788869358.447286:0:5756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765413021952 00000100:00080000:0.0:1788869358.447410:0:5751:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788869358.447481:0:5755:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765413021824 00000100:00100000:3.0:1788869358.447485:0:5755:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765413021824 00000100:00100000:3.0:1788869358.447521:0:5755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 5 00000100:00100000:3.0:1788869358.447532:0:5755:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c81f1f2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2125b9b3-626e-4cbe-be83-fb446e976ce2+7:5541:x1875765413021952:12345-192.168.201.39@tcp:41: 00000004:00000024:3.0:1788869358.447593:0:5755:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261778432 avail 2259681280 00000100:00100000:3.0:1788869358.447661:0:5755:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c81f1f2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2125b9b3-626e-4cbe-be83-fb446e976ce2+7:5541:x1875765413021952:12345-192.168.201.39@tcp:41: Request processed in 131us (746us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869358.447669:0:5755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 5 00000100:00100000:3.0:1788869358.447685:0:5755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 6 00000100:00100000:3.0:1788869358.447690:0:5755:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c81f1f3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2125b9b3-626e-4cbe-be83-fb446e976ce2+6:0:x1875765413021824:12345-192.168.201.39@tcp:41: 00000004:00000024:3.0:1788869358.447699:0:5755:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261778432 avail 2259681280 00000100:00100000:3.0:1788869358.447715:0:5755:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c81f1f3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2125b9b3-626e-4cbe-be83-fb446e976ce2+6:0:x1875765413021824:12345-192.168.201.39@tcp:41: Request processed in 25us (666us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869358.447721:0:5755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 6 00000100:00100000:1.0:1788869358.449442:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1788869358.449522:0:5755:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765413022080 00000100:00100000:3.0:1788869358.449529:0:5755:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765413022080 00000100:00100000:3.0:1788869358.449577:0:5755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 7 00000100:00100000:3.0:1788869358.449587:0:5755:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c81f1f3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2125b9b3-626e-4cbe-be83-fb446e976ce2+6:5541:x1875765413022080:12345-192.168.201.39@tcp:40: 00000100:00100000:3.0:1788869358.449661:0:5755:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c81f1f3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2125b9b3-626e-4cbe-be83-fb446e976ce2+6:5541:x1875765413022080:12345-192.168.201.39@tcp:40: Request processed in 76us (225us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869358.449667:0:5755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 7 00000100:00100000:0.0:1788869358.452649:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1788869358.452736:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1788869358.452780:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1788869358.452833:0:5750:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765413022464 00000100:00100000:1.0:1788869358.452844:0:5750:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765413022464 00000100:00100000:1.0:1788869358.452911:0:5750:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 122 00000100:00100000:1.0:1788869358.452922:0:5750:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c81f0f8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3cca3acf-4935-4d0d-9982-d5d931f1c86b+10:2346:x1875765413022464:12345-192.168.201.39@tcp:400: 00000100:00100000:1.0:1788869358.453001:0:5750:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c81f0f8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3cca3acf-4935-4d0d-9982-d5d931f1c86b+10:2346:x1875765413022464:12345-192.168.201.39@tcp:400: Request processed in 81us (263us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869358.453010:0:5750:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 122 00000100:00100000:0.0:1788869358.453575:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1788869358.453702:0:5758:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765413022592 00000100:00100000:2.0:1788869358.453708:0:5758:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765413022592 00000100:00100000:2.0:1788869358.453755:0:5758:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 0 00000100:00100000:2.0:1788869358.453763:0:5758:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c8349ec700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2125b9b3-626e-4cbe-be83-fb446e976ce2+6:5541:x1875765413022592:12345-192.168.201.39@tcp:33: 00000100:00100000:3.0:1788869358.455502:0:6546:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765413022208 00000100:00100000:3.0:1788869358.455513:0:6546:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765413022208 00000100:00100000:3.0:1788869358.455555:0:6546:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765413022336 00000100:00100000:3.0:1788869358.455558:0:6546:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765413022336 00000100:00100000:3.0:1788869358.455577:0:6546:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 8 00000100:00100000:3.0:1788869358.455584:0:6546:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c8349eea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2344:x1875765413022208:12345-192.168.201.39@tcp:8: 00010000:00080000:3.0:1788869358.455614:0:6546:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0000: connection from 2125b9b3-626e-4cbe-be83-fb446e976ce2@192.168.201.39@tcp t0 exp 0000000000000000 cur 106 last 0 00000020:00000080:3.0:1788869358.455649:0:6546:0:(genops.c:1406:class_connect()) connect: client 2125b9b3-626e-4cbe-be83-fb446e976ce2, cookie 0x3d2d1916761d63e8 00002000:00100000:3.0:1788869358.455669:0:6546:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 2125b9b3-626e-4cbe-be83-fb446e976ce2/ffff94c810e56000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113718 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1788869358.455699:0:6546:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:3.0:1788869358.456089:0:6546:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1788869358.456127:0:6546:0:(import.c:65:import_set_state_nolock()) ffff94c810e52800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788869358.456194:0:6546:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c8349eea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2125b9b3-626e-4cbe-be83-fb446e976ce2+6:2344:x1875765413022208:12345-192.168.201.39@tcp:8: Request processed in 608us (3554us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869358.456202:0:6546:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 8 00000100:00100000:3.0:1788869358.456224:0:6546:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 9 00000100:00100000:3.0:1788869358.456229:0:6546:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c8349eed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2344:x1875765413022336:12345-192.168.201.39@tcp:8: 00010000:00080000:3.0:1788869358.456245:0:6546:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0001: connection from 2125b9b3-626e-4cbe-be83-fb446e976ce2@192.168.201.39@tcp t0 exp 0000000000000000 cur 106 last 0 00000020:00000080:3.0:1788869358.456289:0:6546:0:(genops.c:1406:class_connect()) connect: client 2125b9b3-626e-4cbe-be83-fb446e976ce2, cookie 0x3d2d1916761d63ef 00002000:00100000:3.0:1788869358.456296:0:6546:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 2125b9b3-626e-4cbe-be83-fb446e976ce2/ffff94c810e54800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113718 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1788869358.459457:0:6546:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:3.0:1788869358.459831:0:6546:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1788869358.459879:0:6546:0:(import.c:65:import_set_state_nolock()) ffff94c810e50800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788869358.459977:0:6546:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c8349eed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2125b9b3-626e-4cbe-be83-fb446e976ce2+6:2344:x1875765413022336:12345-192.168.201.39@tcp:8: Request processed in 3744us (7194us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869358.459989:0:6546:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 9 00000004:00080000:2.0:1788869358.469598:0:5758:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 15763us 00000004:00200000:1.0:1788869358.477124:0:5758:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000100:00100000:1.0:1788869358.477414:0:5758:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c8349ec700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2125b9b3-626e-4cbe-be83-fb446e976ce2+6:5541:x1875765413022592:12345-192.168.201.39@tcp:33: Request processed in 23642us (23830us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869358.477432:0:5758:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 0 00000100:00100000:0.0:1788869358.621949:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1788869358.622056:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765413022720 00000100:00100000:1.0:1788869358.622073:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765413022720 00000100:00100000:1.0:1788869358.622179:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 8 00000100:00100000:1.0:1788869358.622193:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c8349ece00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2125b9b3-626e-4cbe-be83-fb446e976ce2+6:5580:x1875765413022720:12345-192.168.201.39@tcp:101: 00010000:00010000:1.0:1788869358.622220:0:5786:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788869358.622482:0:5786:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94c8421f2800/0x3d2d1916761d63f6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x375c010249035767 expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869358.622578:0:5786:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94c8421f3a00/0x3d2d1916761d63fd lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869358.622593:0:5786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94c8421f3a00/0x3d2d1916761d63fd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869358.622626:0:5786:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94c8421f3a00/0x3d2d1916761d63fd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788869358.622831:0:5786:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000004:00200000:1.0:1788869358.622836:0:5786:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:1.0:1788869358.622917:0:5786:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff94c8421f3a00/0x3d2d1916761d63fd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869358.622949:0:5786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94c8421f2800/0x3d2d1916761d63f6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0x375c010249035767 expref: 8 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869358.622969:0:5786:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94c8421f3a00/0x3d2d1916761d63fd lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0x375c010249035767 expref: 7 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869358.622979:0:5786:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff94c81a585200) 00010000:00010000:1.0:1788869358.622982:0:5786:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788869358.622986:0:5786:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94c8421f3a00, rc 0) 00000100:00100000:1.0:1788869358.623552:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c8349ece00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2125b9b3-626e-4cbe-be83-fb446e976ce2+7:5580:x1875765413022720:12345-192.168.201.39@tcp:101: Request processed in 1359us (1610us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869358.623562:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 8 00010000:00010000:3.0:1788869359.003641:0:7447:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788869359.708238:0:3284:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94c803fba680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:121cd5bc-7f07-4cf7-8e2e-4356c89c0696:3284:1875765421429632:0@lo:400: 00000100:00100000:1.0:1788869359.708375:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869359.708450:0:3283:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94c803fb9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3283:1875765421430016:0@lo:400: 00000100:00100000:3.0:1788869359.708492:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869359.708583:0:3286:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94c803fb8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3286:1875765421429888:0@lo:400: 00000100:00100000:3.0:1788869359.708614:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869359.708635:0:3286:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1788869359.708641:0:3286:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94c803fb8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3286:1875765421429760:0@lo:400: 00000100:00100000:3.0:1788869359.708682:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869359.708702:0:3286:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94c803fba300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3286:1875765421430272:0@lo:400: 00000100:00100000:3.0:1788869359.708724:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869359.708769:0:6547:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765421430016 00000100:00100000:3.0:1788869359.708778:0:6547:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765421430016 00000100:00100000:3.0:1788869359.708841:0:6547:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765421430272 00000100:00100000:3.0:1788869359.708845:0:6547:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765421430272 00000100:00100000:3.0:1788869359.708874:0:6547:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788869359.708884:0:6547:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c82d043800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3283:x1875765421430016:12345-0@lo:400: 00000100:00100000:3.0:1788869359.708946:0:6547:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c82d043800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3283:x1875765421430016:12345-0@lo:400: Request processed in 62us (452us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869359.708954:0:6547:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788869359.708972:0:6547:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788869359.708978:0:6547:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c82d041c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3286:x1875765421430272:12345-0@lo:400: 00000100:00100000:3.0:1788869359.709010:0:6547:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c82d041c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3286:x1875765421430272:12345-0@lo:400: Request processed in 33us (285us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869359.709017:0:6547:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788869359.709035:0:5755:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765421429888 00000100:00100000:3.0:1788869359.709039:0:5755:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765421429888 00000100:00100000:3.0:1788869359.709068:0:5755:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765421429760 00000100:00100000:3.0:1788869359.709071:0:5755:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765421429760 00000100:00100000:3.0:1788869359.709092:0:5755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788869359.709099:0:5755:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c82d042d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3286:x1875765421429888:12345-0@lo:400: 00000100:00100000:3.0:1788869359.709131:0:5755:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c82d042d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3286:x1875765421429888:12345-0@lo:400: Request processed in 32us (516us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869359.709137:0:5755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788869359.709148:0:5755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788869359.709154:0:5755:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c82d041500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3286:x1875765421429760:12345-0@lo:400: 00000100:00100000:3.0:1788869359.709192:0:5755:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c82d041500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3286:x1875765421429760:12345-0@lo:400: Request processed in 38us (508us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869359.709198:0:5755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00080000:3.0:1788869359.709216:0:5751:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788869359.709222:0:5751:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788869359.709224:0:5751:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788869359.709332:0:3284:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94c803fb8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3284:1875765421430144:0@lo:400: 00000100:00100000:1.0:1788869359.709365:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869359.709394:0:5755:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765421430144 00000100:00100000:1.0:1788869359.709398:0:5755:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765421430144 00000100:00100000:1.0:1788869359.709430:0:5755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788869359.709444:0:5755:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c81f1f0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3284:x1875765421430144:12345-0@lo:400: 00000100:00100000:1.0:1788869359.709479:0:5755:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c81f1f0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3284:x1875765421430144:12345-0@lo:400: Request processed in 36us (114us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869359.709486:0:5755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00080000:1.0:1788869359.709501:0:5751:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788869359.709534:0:3284:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94c803fb8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3284:1875765421430144:0@lo:400: 00000100:00100000:1.0:1788869359.709590:0:3286:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94c803fb8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3286:1875765421429760:0@lo:400: 00010000:00080000:1.0:1788869359.709611:0:3286:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff94c803fba300 x1875765421430272/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788869375 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788869359.709622:0:3286:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:1.0:1788869359.709636:0:3286:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94c803fba300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3286:1875765421430272:0@lo:400: 00000100:00100000:1.0:1788869359.709646:0:3286:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94c803fb8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3286:1875765421429888:0@lo:400: 00000100:00100000:0.0:1788869359.709770:0:3285:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788869359.709780:0:3285:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94c8349ef100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3285:1875765421430400:0@lo:13: 00000100:00100000:0.0:1788869359.709814:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869359.709853:0:6549:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765421430400 00000100:00100000:0.0:1788869359.709857:0:6549:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765421430400 00000100:00100000:0.0:1788869359.709885:0:6549:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788869359.709892:0:6549:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c8349ed880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3285:x1875765421430400:12345-0@lo:13: 00002000:00000024:0.0:1788869359.709927:0:6549:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788869359.709965:0:6549:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c8349ed880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3285:x1875765421430400:12345-0@lo:13: Request processed in 73us (149us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869359.709970:0:6549:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:0.0:1788869359.709996:0:3285:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff94c8349ef100 x1875765421430400/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788869375 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788869359.710011:0:3285:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94c8349ef100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3285:1875765421430400:0@lo:13: 00000100:00100000:2.0:1788869359.710081:0:5748:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765421429632 00000100:00100000:2.0:1788869359.710093:0:5748:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765421429632 00000100:00100000:2.0:1788869359.710133:0:5748:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:2.0:1788869359.710140:0:5748:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c8061d9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:121cd5bc-7f07-4cf7-8e2e-4356c89c0696+19:3284:x1875765421429632:12345-0@lo:400: 00000100:00100000:2.0:1788869359.710184:0:5748:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c8061d9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:121cd5bc-7f07-4cf7-8e2e-4356c89c0696+19:3284:x1875765421429632:12345-0@lo:400: Request processed in 45us (1809us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869359.710191:0:5748:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00100000:2.0:1788869359.710226:0:3284:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94c803fba680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:121cd5bc-7f07-4cf7-8e2e-4356c89c0696:3284:1875765421429632:0@lo:400: 00010000:00080000:3.0:1788869359.710379:0:3283:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff94c803fb9180 x1875765421430016/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788869375 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788869359.710391:0:3283:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94c803fb9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3283:1875765421430016:0@lo:400: 00010000:00010000:0.0:1788869360.027474:0:5742:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788869360.265733:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1788869360.266454:0:5757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765413022848 00000100:00100000:3.0:1788869360.266469:0:5757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765413022848 00000100:00100000:3.0:1788869360.266573:0:5757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 9 00000100:00100000:3.0:1788869360.266584:0:5757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c81f1f2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2125b9b3-626e-4cbe-be83-fb446e976ce2+7:5633:x1875765413022848:12345-192.168.201.39@tcp:41: 00000004:00000024:3.0:1788869360.266645:0:5757:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261778432 avail 2259681280 00000100:00100000:3.0:1788869360.266732:0:5757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c81f1f2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2125b9b3-626e-4cbe-be83-fb446e976ce2+7:5633:x1875765413022848:12345-192.168.201.39@tcp:41: Request processed in 149us (1012us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869360.266741:0:5757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 9 00000100:00080000:1.0:1788869360.266831:0:5751:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788869360.269550:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1788869360.269748:0:6549:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765413022976 00000100:00100000:0.0:1788869360.269757:0:6549:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765413022976 00000100:00080000:1.0:1788869360.269850:0:5751:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788869360.269873:0:6549:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 5 00000100:00100000:0.0:1788869360.269886:0:6549:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c803fba680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:2125b9b3-626e-4cbe-be83-fb446e976ce2+6:5633:x1875765413022976:12345-192.168.201.39@tcp:13: 00002000:00000024:0.0:1788869360.269931:0:6549:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788869360.269997:0:6549:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c803fba680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:2125b9b3-626e-4cbe-be83-fb446e976ce2+6:5633:x1875765413022976:12345-192.168.201.39@tcp:13: Request processed in 114us (456us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869360.270018:0:6549:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 5 00000100:00100000:0.0:1788869360.272093:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1788869360.272245:0:6548:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765413023104 00000100:00100000:2.0:1788869360.272338:0:6548:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765413023104 00000100:00100000:2.0:1788869360.272440:0:6548:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 6 00000100:00100000:2.0:1788869360.272456:0:6548:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c8349ef100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:2125b9b3-626e-4cbe-be83-fb446e976ce2+6:5633:x1875765413023104:12345-192.168.201.39@tcp:13: 00002000:00000024:2.0:1788869360.272477:0:6548:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788869360.272603:0:6548:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c8349ef100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:2125b9b3-626e-4cbe-be83-fb446e976ce2+6:5633:x1875765413023104:12345-192.168.201.39@tcp:13: Request processed in 156us (517us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869360.272610:0:6548:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 6 00000100:00080000:1.0:1788869360.272718:0:5751:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:2.0:1788869361.055445:0:5743:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788869361.755648:0:3284:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788869361.755676:0:3284:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94c81f1f2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3284:1875765421430528:0@lo:13: 00000100:00100000:2.0:1788869361.755749:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869361.755904:0:6548:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765421430528 00000100:00100000:0.0:1788869361.755914:0:6548:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765421430528 00000100:00100000:0.0:1788869361.755984:0:6548:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788869361.755993:0:6548:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c803fbbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3284:x1875765421430528:12345-0@lo:13: 00002000:00000024:0.0:1788869361.756028:0:6548:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788869361.756082:0:6548:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c803fbbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3284:x1875765421430528:12345-0@lo:13: Request processed in 89us (332us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869361.756099:0:6548:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:2.0:1788869361.756301:0:3284:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff94c81f1f2680 x1875765421430528/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788869377 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788869361.756320:0:3284:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94c81f1f2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3284:1875765421430528:0@lo:13: 00000100:00080000:1.0:1788869361.756389:0:5751:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1788869362.076847:0:7447:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1788869362.607124:0:8103:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00000001:00100000:3.0:1788869362.821741:0:5777:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 2125b9b3-626e-4cbe-be83-fb446e976ce2 00000001:00100000:1.0:1788869362.822299:0:6571:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 2125b9b3-626e-4cbe-be83-fb446e976ce2 00000001:00100000:0.0:1788869362.838967:0:7458:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 2125b9b3-626e-4cbe-be83-fb446e976ce2 00010000:00010000:0.0:1788869363.103182:0:5742:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788869363.640690:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1788869363.640730:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1788869363.640772:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1788869363.640797:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1788869363.640823:0:5749:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765413023232 00000100:00100000:0.0:1788869363.640833:0:5749:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765413023232 00000100:00100000:0.0:1788869363.640886:0:5749:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 124 00000100:00100000:0.0:1788869363.640897:0:5749:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c8061da050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3cca3acf-4935-4d0d-9982-d5d931f1c86b+10:2345:x1875765413023232:12345-192.168.201.39@tcp:400: 00000100:00100000:0.0:1788869363.640978:0:5749:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c8061da050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3cca3acf-4935-4d0d-9982-d5d931f1c86b+10:2345:x1875765413023232:12345-192.168.201.39@tcp:400: Request processed in 82us (297us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869363.640986:0:5749:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 124 00000100:00100000:0.0:1788869363.641041:0:5756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765413023360 00000100:00100000:0.0:1788869363.641045:0:5756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765413023360 00000100:00100000:0.0:1788869363.641086:0:5756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 13 00000100:00100000:0.0:1788869363.641093:0:5756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c8349ec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2125b9b3-626e-4cbe-be83-fb446e976ce2+6:2345:x1875765413023360:12345-192.168.201.39@tcp:400: 00000100:00100000:0.0:1788869363.641135:0:5756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c8349ec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2125b9b3-626e-4cbe-be83-fb446e976ce2+6:2345:x1875765413023360:12345-192.168.201.39@tcp:400: Request processed in 42us (404us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869363.641141:0:5756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 13 00000100:00080000:0.0:1788869363.641287:0:5751:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788869363.641758:0:6547:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765413023616 00000100:00100000:3.0:1788869363.641763:0:6547:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765413023616 00000100:00100000:3.0:1788869363.641878:0:6547:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765413023488 00000100:00100000:3.0:1788869363.641881:0:6547:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765413023488 00000100:00100000:3.0:1788869363.641907:0:6547:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 4 00000100:00100000:3.0:1788869363.641915:0:6547:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c82cdc7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2125b9b3-626e-4cbe-be83-fb446e976ce2+5:2346:x1875765413023616:12345-192.168.201.39@tcp:400: 00000100:00100000:3.0:1788869363.641952:0:6547:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c82cdc7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2125b9b3-626e-4cbe-be83-fb446e976ce2+5:2346:x1875765413023616:12345-192.168.201.39@tcp:400: Request processed in 38us (1179us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869363.641966:0:6547:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 4 00000100:00100000:3.0:1788869363.641981:0:6547:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 5 00000100:00100000:3.0:1788869363.641987:0:6547:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c82cdc4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2125b9b3-626e-4cbe-be83-fb446e976ce2+5:2346:x1875765413023488:12345-192.168.201.39@tcp:400: 00000100:00100000:3.0:1788869363.642027:0:6547:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c82cdc4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2125b9b3-626e-4cbe-be83-fb446e976ce2+5:2346:x1875765413023488:12345-192.168.201.39@tcp:400: Request processed in 40us (1229us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869363.642033:0:6547:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 5 00000100:00080000:0.0:1788869363.642616:0:5751:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788869363.642621:0:5751:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:0.0:1788869364.123506:0:5743:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788869364.833956:0:3284:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94c803fb8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3284:1875765421430656:0@lo:13: 00000100:00100000:2.0:1788869364.834059:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869364.834157:0:6548:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765421430656 00000100:00100000:2.0:1788869364.834165:0:6548:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765421430656 00000100:00100000:2.0:1788869364.834239:0:6548:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788869364.834275:0:6548:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c803fb9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3284:x1875765421430656:12345-0@lo:13: 00002000:00000024:2.0:1788869364.834321:0:6548:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788869364.834374:0:6548:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c803fb9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3284:x1875765421430656:12345-0@lo:13: Request processed in 126us (315us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869364.834382:0:6548:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00080000:2.0:1788869364.834404:0:5751:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:2.0:1788869364.834441:0:3284:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff94c803fb8000 x1875765421430656/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788869380 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788869364.834466:0:3284:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94c803fb8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3284:1875765421430656:0@lo:13: 00000100:00100000:1.0:1788869364.835659:0:3285:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94c82cdc4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:121cd5bc-7f07-4cf7-8e2e-4356c89c0696:3285:1875765421430784:0@lo:400: 00000100:00100000:1.0:1788869364.835746:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869364.835801:0:3285:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94c82cdc5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3285:1875765421431296:0@lo:400: 00000100:00100000:1.0:1788869364.835832:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869364.835865:0:3285:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788869364.835872:0:3285:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94c82cdc7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3285:1875765421430912:0@lo:400: 00000100:00100000:1.0:1788869364.835895:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869364.836206:0:5755:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765421431296 00000100:00100000:1.0:1788869364.836216:0:5755:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765421431296 00000100:00100000:0.0:1788869364.836363:0:5750:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765421430784 00000100:00100000:0.0:1788869364.836374:0:5750:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765421430784 00000100:00100000:0.0:1788869364.836436:0:5750:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:0.0:1788869364.836450:0:5750:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c810e10050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:121cd5bc-7f07-4cf7-8e2e-4356c89c0696+19:3285:x1875765421430784:12345-0@lo:400: 00000100:00100000:1.0:1788869364.836458:0:5755:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765421430912 00000100:00100000:1.0:1788869364.836466:0:5755:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765421430912 00000100:00100000:1.0:1788869364.836502:0:5755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788869364.836512:0:5755:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c81f1f2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3285:x1875765421431296:12345-0@lo:400: 00000100:00100000:0.0:1788869364.836544:0:5750:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c810e10050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:121cd5bc-7f07-4cf7-8e2e-4356c89c0696+19:3285:x1875765421430784:12345-0@lo:400: Request processed in 98us (796us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869364.836555:0:5750:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00100000:1.0:1788869364.836589:0:5755:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c81f1f2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3285:x1875765421431296:12345-0@lo:400: Request processed in 77us (753us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869364.836599:0:5755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788869364.836623:0:5755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788869364.836632:0:5755:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c81f1f1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3285:x1875765421430912:12345-0@lo:400: 00000100:00100000:1.0:1788869364.836670:0:5755:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c81f1f1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3285:x1875765421430912:12345-0@lo:400: Request processed in 40us (774us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869364.836677:0:5755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788869364.836731:0:3285:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94c82cdc7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3285:1875765421430912:0@lo:400: 00000100:00100000:1.0:1788869364.836748:0:3285:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94c82cdc4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:121cd5bc-7f07-4cf7-8e2e-4356c89c0696:3285:1875765421430784:0@lo:400: 00000100:00100000:1.0:1788869364.836758:0:3285:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94c82cdc5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3285:1875765421431296:0@lo:400: 00000100:00080000:0.0:1788869364.836874:0:5751:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788869364.837023:0:3283:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94c82cdc5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3283:1875765421431040:0@lo:400: 00000100:00100000:2.0:1788869364.837069:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869364.837120:0:3283:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788869364.837127:0:3283:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94c82cdc6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3283:1875765421431168:0@lo:400: 00000100:00100000:2.0:1788869364.837156:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869364.837184:0:5755:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765421431040 00000100:00100000:1.0:1788869364.837203:0:5755:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765421431040 00000100:00080000:2.0:1788869364.837244:0:5751:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788869364.838032:0:5755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1788869364.838056:0:5755:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c803fb8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3283:x1875765421431040:12345-0@lo:400: 00000100:00100000:1.0:1788869364.838210:0:5755:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c803fb8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3283:x1875765421431040:12345-0@lo:400: Request processed in 158us (1140us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869364.838219:0:5755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1788869364.841138:0:3283:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94c82cdc5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3283:1875765421431040:0@lo:400: 00000100:00100000:0.0:1788869364.844794:0:6547:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765421431168 00000100:00100000:0.0:1788869364.844817:0:6547:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765421431168 00000100:00100000:0.0:1788869364.844944:0:6547:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788869364.844957:0:6547:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c803fb9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3283:x1875765421431168:12345-0@lo:400: 00000100:00080000:1.0:1788869364.845018:0:5751:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788869364.845091:0:6547:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c803fb9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3283:x1875765421431168:12345-0@lo:400: Request processed in 136us (7932us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869364.845100:0:6547:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:2.0:1788869364.845206:0:3283:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff94c82cdc6d80 x1875765421431168/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788869380 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788869364.845224:0:3283:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94c82cdc6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3283:1875765421431168:0@lo:400: 00010000:00010000:3.0:1788869365.150233:0:7447:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1788869365.903820:0:8253:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007fff38ff0880 20000000:00000080:3.0:1788869365.903840:0:8253:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff94c83c6cb400 uarg=0000000000000000 20000000:01000000:3.0:1788869365.903882:0:8253:0:(mgs_llog.c:2006:mgs_parse_devname()) Device name lustre without fsname 20000000:01000000:3.0:1788869365.903885:0:8253:0:(mgs_llog.c:6065:mgs_set_conf_param()) lustre is seen as a file system name 20000000:01000000:3.0:1788869365.903888:0:8253:0:(mgs_llog.c:6096:mgs_set_conf_param()) set_conf_param fs='lustre' device='lustre' param='sys.jobid_var=procname_uid' 20000000:01000000:3.0:1788869365.903894:0:8253:0:(mgs_llog.c:4744:mgs_write_log_param()) next param 'sys.jobid_var=procname_uid' 20000000:01000000:3.0:1788869365.903901:0:8253:0:(mgs_llog.c:4177:mgs_write_log_sys()) global 'sys.jobid_var=procname_uid' val=procname_uid 20000000:01000000:3.0:1788869365.903917:0:8253:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:3.0:1788869365.903920:0:8253:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:3.0:1788869365.904127:0:8253:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:3.0:1788869365.904131:0:8253:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.jobid_var fl=4 00000040:00080000:1.0:1788869365.905415:0:8254:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000040:00080000:3.0:1788869365.906323:0:8253:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].39, 224 off14880 00000040:00080000:2.0:1788869365.906574:0:8253:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].40, 120 off15000 00000040:00080000:2.0:1788869365.906623:0:8253:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].41, 224 off15224 20000000:01000000:2.0:1788869365.906642:0:8253:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:2.0:1788869365.906645:0:8253:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.jobid_var fl=4 00000040:00080000:0.0:1788869365.908457:0:8255:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 34 count 34 00000040:00080000:2.0:1788869365.908957:0:8253:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 224 off14144 00000040:00080000:2.0:1788869365.909013:0:8253:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 120 off14264 00000040:00080000:2.0:1788869365.909059:0:8253:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14488 20000000:01000000:2.0:1788869365.913492:0:8253:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:2.0:1788869365.913496:0:8253:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0001/lustre/sys.jobid_var fl=4 00000040:00080000:0.0:1788869365.915483:0:8256:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 8 count 8 00000040:00080000:2.0:1788869365.915955:0:8253:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9632 00000040:00080000:2.0:1788869365.916024:0:8253:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 120 off9752 00000040:00080000:2.0:1788869365.916058:0:8253:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 224 off9976 20000000:01000000:2.0:1788869365.916145:0:8253:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:2.0:1788869365.916148:0:8253:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.jobid_var fl=4 00000040:00080000:1.0:1788869365.919536:0:8257:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 11 count 11 00000040:00080000:2.0:1788869365.920874:0:8253:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 224 off10160 00000040:00080000:2.0:1788869365.920958:0:8253:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 120 off10280 00000040:00080000:2.0:1788869365.921004:0:8253:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].13, 224 off10504 10000000:01000000:2.0:1788869365.921028:0:8253:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:2.0:1788869365.921054:0:8253:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff94c80153be00/0x3d2d1916761d6404 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869365.921076:0:8253:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff94c818d1e600/0x3d2d1916761d6301 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3d2d1916761d62fa expref: 18 pid: 5749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869365.921085:0:8253:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff94c81a583e00/0x3d2d1916761d632b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3d2d1916761d6324 expref: 18 pid: 5749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869365.921093:0:8253:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff94c818d1fe00/0x3d2d1916761d6355 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3d2d1916761d634e expref: 18 pid: 5749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869365.921101:0:8253:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff94c81a582a00/0x3d2d1916761d6363 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3d2d1916761d635c expref: 18 pid: 5749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869365.921108:0:8253:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff94c81a582e00/0x3d2d1916761d6371 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3d2d1916761d636a expref: 18 pid: 5750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869365.921116:0:8253:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff94c81a582200/0x3d2d1916761d638d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3d2d1916761d6386 expref: 18 pid: 5750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869365.921144:0:8253:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff94c800030400/0x3d2d1916761d63b7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3d2d1916761d63a9 expref: 18 pid: 5749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869365.921156:0:8253:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff94c80153aa00/0x3d2d1916761d63c5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.201.39@tcp remote: 0x375c010249035705 expref: 9 pid: 5748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869365.921165:0:8253:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff94c818d1fc00/0x3d2d1916761d63cc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.201.39@tcp remote: 0x375c01024903570c expref: 9 pid: 5748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869365.921184:0:8253:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff94c80153be00/0x3d2d1916761d6404 lrc: 12/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 8253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869365.921238:0:8253:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff94c818d1fc00/0x3d2d1916761d63cc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 192.168.201.39@tcp remote: 0x375c01024903570c expref: 9 pid: 5748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869365.921316:0:8253:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff94c818d1fc00/0x3d2d1916761d63cc lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 192.168.201.39@tcp remote: 0x375c01024903570c expref: 9 pid: 5748 timeout: 214 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788869365.921336:0:8253:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94c803fbb480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8253:1875765421431424:192.168.201.39@tcp:104: 00010000:00010000:2.0:1788869365.921469:0:8253:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff94c80153aa00/0x3d2d1916761d63c5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 192.168.201.39@tcp remote: 0x375c010249035705 expref: 9 pid: 5748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869365.921478:0:8253:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff94c80153aa00/0x3d2d1916761d63c5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 192.168.201.39@tcp remote: 0x375c010249035705 expref: 9 pid: 5748 timeout: 214 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788869365.921488:0:8253:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94c803fbb800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8253:1875765421431552:192.168.201.39@tcp:104: 00010000:00010000:2.0:1788869365.921522:0:8253:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff94c800030400/0x3d2d1916761d63b7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x3d2d1916761d63a9 expref: 18 pid: 5749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869365.921542:0:8253:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff94c800030400/0x3d2d1916761d63b7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x3d2d1916761d63a9 expref: 18 pid: 5749 timeout: 264 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788869365.921552:0:8253:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94c803fb9180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8253:1875765421431680:0@lo:104: 00000100:00100000:2.0:1788869365.921603:0:8253:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788869365.921645:0:8253:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff94c81a582200/0x3d2d1916761d638d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x3d2d1916761d6386 expref: 18 pid: 5750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869365.921653:0:8253:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff94c81a582200/0x3d2d1916761d638d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x3d2d1916761d6386 expref: 18 pid: 5750 timeout: 264 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788869365.921662:0:8253:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94c803fba300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8253:1875765421431808:0@lo:104: 00000100:00100000:2.0:1788869365.921688:0:8253:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788869365.921710:0:8253:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff94c81a582e00/0x3d2d1916761d6371 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x3d2d1916761d636a expref: 18 pid: 5750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869365.921718:0:8253:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff94c81a582e00/0x3d2d1916761d6371 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x3d2d1916761d636a expref: 18 pid: 5750 timeout: 264 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788869365.921726:0:8253:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94c803fb8a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8253:1875765421431936:0@lo:104: 00010000:00010000:2.0:1788869365.921752:0:8253:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff94c81a582a00/0x3d2d1916761d6363 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x3d2d1916761d635c expref: 18 pid: 5749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869365.921760:0:8253:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff94c81a582a00/0x3d2d1916761d6363 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x3d2d1916761d635c expref: 18 pid: 5749 timeout: 264 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788869365.921768:0:8253:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94c803fb8700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8253:1875765421432064:0@lo:104: 00010000:00010000:2.0:1788869365.921811:0:8253:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff94c818d1fe00/0x3d2d1916761d6355 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x3d2d1916761d634e expref: 18 pid: 5749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869365.921825:0:8253:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff94c818d1fe00/0x3d2d1916761d6355 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x3d2d1916761d634e expref: 18 pid: 5749 timeout: 264 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788869365.921834:0:8253:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94c82c840380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8253:1875765421432192:0@lo:104: 00010000:00010000:2.0:1788869365.921866:0:8253:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff94c81a583e00/0x3d2d1916761d632b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x3d2d1916761d6324 expref: 18 pid: 5749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869365.921874:0:8253:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff94c81a583e00/0x3d2d1916761d632b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x3d2d1916761d6324 expref: 18 pid: 5749 timeout: 264 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788869365.921882:0:8253:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94c82c840000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8253:1875765421432320:0@lo:104: 00010000:00010000:2.0:1788869365.921908:0:8253:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff94c818d1e600/0x3d2d1916761d6301 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x3d2d1916761d62fa expref: 18 pid: 5749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869365.921915:0:8253:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff94c818d1e600/0x3d2d1916761d6301 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x3d2d1916761d62fa expref: 18 pid: 5749 timeout: 264 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788869365.921923:0:8253:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94c82c843480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8253:1875765421432448:0@lo:104: 00000100:00100000:2.0:1788869365.921944:0:8253:0:(client.c:2702:ptlrpc_set_wait()) set ffff94c81828aa80 going to sleep for 11 seconds 00000100:00100000:3.0:1788869365.922194:0:5787:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:3.0:1788869365.922223:0:5787:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869365.922288:0:5787:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869365.922297:0:5787:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869365.922318:0:5787:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869365.922328:0:5787:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869365.922338:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765421431680 00000100:00100000:3.0:1788869365.922345:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765421431680 00000100:00100000:1.0:1788869365.922443:0:5737:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765421431808 00000100:00100000:1.0:1788869365.922449:0:5737:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765421431808 00000100:00100000:3.0:1788869365.922452:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765421431936 00000100:00100000:3.0:1788869365.922458:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765421431936 00000100:00100000:1.0:1788869365.922473:0:5737:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765421432064 00000100:00100000:1.0:1788869365.922478:0:5737:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765421432064 00000100:00100000:3.0:1788869365.922484:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765421432192 00000100:00100000:3.0:1788869365.922488:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765421432192 00000100:00100000:1.0:1788869365.922499:0:5737:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765421432320 00000100:00100000:1.0:1788869365.922504:0:5737:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765421432320 00000100:00100000:3.0:1788869365.922506:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765421432448 00000100:00100000:3.0:1788869365.922511:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765421432448 00000100:00100000:1.0:1788869365.922529:0:5737:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788869365.922546:0:5737:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c803fb8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:121cd5bc-7f07-4cf7-8e2e-4356c89c0696+9:8253:x1875765421431680:12345-0@lo:104: 00010000:00010000:1.0:1788869365.922562:0:5737:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.139@tcp lock: ffff94c800030e00/0x3d2d1916761d63a9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x3d2d1916761d63b7 expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869365.922633:0:5737:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788869365.922640:0:5737:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c803fb8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:121cd5bc-7f07-4cf7-8e2e-4356c89c0696+9:8253:x1875765421431680:12345-0@lo:104: Request processed in 102us (1038us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869365.922729:0:8253:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94c803fb9180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8253:1875765421431680:0@lo:104: 00010000:00010000:0.0:1788869365.925632:0:5742:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788869365.925650:0:5742:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.139@tcp lock: ffff94c800030e00/0x3d2d1916761d63a9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x3d2d1916761d63b7 expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869365.925682:0:5742:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94c800030e00 already unused, calling callback (ffffffffc1ce9c20) 10000000:00010000:0.0:1788869365.925686:0:5742:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.139@tcp lock: ffff94c800030e00/0x3d2d1916761d63a9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400400000000 nid: local remote: 0x3d2d1916761d63b7 expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869365.925696:0:5742:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.139@tcp lock: ffff94c800030e00/0x3d2d1916761d63a9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1408400000000 nid: local remote: 0x3d2d1916761d63b7 expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788869365.925703:0:5742:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.139@tcp lock: ffff94c800030e00/0x3d2d1916761d63a9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1409400000000 nid: local remote: 0x3d2d1916761d63b7 expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788869365.925709:0:5742:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788869365.925772:0:5742:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.139@tcp lock: ffff94c800030e00/0x3d2d1916761d63a9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3d2d1916761d63b7 expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869365.925778:0:5742:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788869365.925806:0:5742:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.139@tcp lock: ffff94c800030e00/0x3d2d1916761d63a9 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3d2d1916761d63b7 expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869365.925813:0:5742:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.139@tcp lock: ffff94c800030e00/0x3d2d1916761d63a9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3d2d1916761d63b7 expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869365.925829:0:5742:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788869365.925830:0:5742:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788869365.925832:0:5742:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788869365.925861:0:3286:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94c82cdc7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:121cd5bc-7f07-4cf7-8e2e-4356c89c0696:3286:1875765421432576:0@lo:103: 00000100:00100000:3.0:1788869365.925926:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788869365.925940:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869365.925949:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c83fd2f850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:121cd5bc-7f07-4cf7-8e2e-4356c89c0696+9:8253:x1875765421431808:12345-0@lo:104: 00010000:00010000:3.0:1788869365.925964:0:5787:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.139@tcp lock: ffff94c81a583400/0x3d2d1916761d6386 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0x3d2d1916761d638d expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869365.926041:0:5787:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788869365.926049:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c83fd2f850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:121cd5bc-7f07-4cf7-8e2e-4356c89c0696+9:8253:x1875765421431808:12345-0@lo:104: Request processed in 111us (4359us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869365.926057:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1788869365.926102:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788869365.926109:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c82d043100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:121cd5bc-7f07-4cf7-8e2e-4356c89c0696+8:8253:x1875765421431936:12345-0@lo:104: 00010000:00010000:3.0:1788869365.926118:0:5787:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.139@tcp lock: ffff94c81a583000/0x3d2d1916761d636a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0x3d2d1916761d6371 expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869365.926153:0:5787:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1788869365.926158:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c82d043100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:121cd5bc-7f07-4cf7-8e2e-4356c89c0696+8:8253:x1875765421431936:12345-0@lo:104: Request processed in 50us (3936us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869365.926165:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788869365.926191:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788869365.926198:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c82d043480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:121cd5bc-7f07-4cf7-8e2e-4356c89c0696+7:8253:x1875765421432064:12345-0@lo:104: 00010000:00010000:3.0:1788869365.926207:0:5787:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.139@tcp lock: ffff94c80153a400/0x3d2d1916761d635c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0x3d2d1916761d6363 expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869365.926248:0:5787:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:3.0:1788869365.926280:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c82d043480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:121cd5bc-7f07-4cf7-8e2e-4356c89c0696+7:8253:x1875765421432064:12345-0@lo:104: Request processed in 83us (3992us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869365.926288:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788869365.926305:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1788869365.926314:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c82d042680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:121cd5bc-7f07-4cf7-8e2e-4356c89c0696+6:8253:x1875765421432192:12345-0@lo:104: 00010000:00010000:3.0:1788869365.926323:0:5787:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.139@tcp lock: ffff94c81a582c00/0x3d2d1916761d634e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0x3d2d1916761d6355 expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788869365.926352:0:5739:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765421432576 00010000:00010000:3.0:1788869365.926360:0:5787:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:0.0:1788869365.926361:0:5739:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765421432576 00010000:00010000:0.0:1788869365.926398:0:5739:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff94c800030400/0x3d2d1916761d63b7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3d2d1916761d63a9 expref: 19 pid: 5749 timeout: 264 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788869365.926434:0:5739:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788869365.926441:0:5739:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c82cdc4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:121cd5bc-7f07-4cf7-8e2e-4356c89c0696+19:3286:x1875765421432576:12345-0@lo:103: 00010000:00010000:0.0:1788869365.926454:0:5739:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788869365.926459:0:5739:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff94c800030400/0x3d2d1916761d63b7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3d2d1916761d63a9 expref: 19 pid: 5749 timeout: 264 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869365.926470:0:5739:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff94c800030400/0x3d2d1916761d63b7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x3d2d1916761d63a9 expref: 19 pid: 5749 timeout: 264 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869365.926487:0:5739:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff94c800030400/0x3d2d1916761d63b7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x3d2d1916761d63a9 expref: 19 pid: 5749 timeout: 264 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869365.926502:0:5739:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788869365.926528:0:5739:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c82cdc4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:121cd5bc-7f07-4cf7-8e2e-4356c89c0696+18:3286:x1875765421432576:12345-0@lo:103: Request processed in 88us (589us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869365.926530:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c82d042680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:121cd5bc-7f07-4cf7-8e2e-4356c89c0696+6:8253:x1875765421432192:12345-0@lo:104: Request processed in 57us (4070us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869365.926539:0:5739:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788869365.926545:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00010000:00010000:0.0:1788869365.926562:0:5743:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00000100:00100000:3.0:1788869365.926567:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00010000:00010000:0.0:1788869365.926569:0:5743:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.139@tcp lock: ffff94c81a583400/0x3d2d1916761d6386 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0x3d2d1916761d638d expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788869365.926577:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c82065ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:121cd5bc-7f07-4cf7-8e2e-4356c89c0696+5:8253:x1875765421432320:12345-0@lo:104: 00010000:00010000:0.0:1788869365.926583:0:5743:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94c81a583400 already unused, calling callback (ffffffffc1ce9c20) 10000000:00010000:0.0:1788869365.926588:0:5743:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.139@tcp lock: ffff94c81a583400/0x3d2d1916761d6386 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400400000000 nid: local remote: 0x3d2d1916761d638d expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869365.926591:0:5787:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.139@tcp lock: ffff94c8421f3800/0x3d2d1916761d6324 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x3d2d1916761d632b expref: -99 pid: 7440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869365.926598:0:5743:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.139@tcp lock: ffff94c81a583400/0x3d2d1916761d6386 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1408400000000 nid: local remote: 0x3d2d1916761d638d expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788869365.926608:0:5743:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.139@tcp lock: ffff94c81a583400/0x3d2d1916761d6386 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1409400000000 nid: local remote: 0x3d2d1916761d638d expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788869365.926620:0:5743:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1788869365.926634:0:5787:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:3.0:1788869365.926642:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c82065ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:121cd5bc-7f07-4cf7-8e2e-4356c89c0696+5:8253:x1875765421432320:12345-0@lo:104: Request processed in 67us (4322us total) trans 0 rc 0/0 00010000:00010000:0.0:1788869365.926643:0:5743:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.139@tcp lock: ffff94c81a583400/0x3d2d1916761d6386 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3d2d1916761d638d expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788869365.926655:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00010000:00010000:0.0:1788869365.926657:0:5743:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:3.0:1788869365.926671:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00010000:00010000:0.0:1788869365.926680:0:5743:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.139@tcp lock: ffff94c81a583400/0x3d2d1916761d6386 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3d2d1916761d638d expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869365.926688:0:5743:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.139@tcp lock: ffff94c81a583400/0x3d2d1916761d6386 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3d2d1916761d638d expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869365.926700:0:5743:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:0.0:1788869365.926703:0:5743:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.139@tcp lock: ffff94c81a583000/0x3d2d1916761d636a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x3d2d1916761d6371 expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869365.926709:0:5743:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94c81a583000 already unused, calling callback (ffffffffc1ce9c20) 10000000:00010000:0.0:1788869365.926712:0:5743:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.139@tcp lock: ffff94c81a583000/0x3d2d1916761d636a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0x3d2d1916761d6371 expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869365.926718:0:5743:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.139@tcp lock: ffff94c81a583000/0x3d2d1916761d636a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0x3d2d1916761d6371 expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788869365.926724:0:5743:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.139@tcp lock: ffff94c81a583000/0x3d2d1916761d636a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0x3d2d1916761d6371 expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788869365.926729:0:5743:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788869365.926741:0:5743:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.139@tcp lock: ffff94c81a583000/0x3d2d1916761d636a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3d2d1916761d6371 expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788869365.926742:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c82065ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:121cd5bc-7f07-4cf7-8e2e-4356c89c0696+4:8253:x1875765421432448:12345-0@lo:104: 00010000:00010000:0.0:1788869365.926754:0:5743:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788869365.926758:0:5787:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.139@tcp lock: ffff94c80153ae00/0x3d2d1916761d62fa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x3d2d1916761d6301 expref: -99 pid: 7440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869365.926768:0:5743:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.139@tcp lock: ffff94c81a583000/0x3d2d1916761d636a lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3d2d1916761d6371 expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869365.926776:0:5743:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.139@tcp lock: ffff94c81a583000/0x3d2d1916761d636a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3d2d1916761d6371 expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869365.926787:0:5743:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1788869365.926790:0:5743:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.139@tcp lock: ffff94c80153a400/0x3d2d1916761d635c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x3d2d1916761d6363 expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869365.926796:0:5787:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00010000:00010000:0.0:1788869365.926797:0:5743:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94c80153a400 already unused, calling callback (ffffffffc1ce9c20) 10000000:00010000:0.0:1788869365.926800:0:5743:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.139@tcp lock: ffff94c80153a400/0x3d2d1916761d635c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x3d2d1916761d6363 expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788869365.926810:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c82065ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:121cd5bc-7f07-4cf7-8e2e-4356c89c0696+4:8253:x1875765421432448:12345-0@lo:104: Request processed in 130us (4478us total) trans 0 rc 0/0 00010000:00010000:0.0:1788869365.926813:0:5743:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.139@tcp lock: ffff94c80153a400/0x3d2d1916761d635c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x3d2d1916761d6363 expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788869365.926822:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 10000000:00010000:0.0:1788869365.926829:0:5743:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.139@tcp lock: ffff94c80153a400/0x3d2d1916761d635c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x3d2d1916761d6363 expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788869365.926836:0:5743:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1788869365.926853:0:7447:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1788869365.926854:0:5743:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.139@tcp lock: ffff94c80153a400/0x3d2d1916761d635c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3d2d1916761d6363 expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869365.926861:0:7447:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.139@tcp lock: ffff94c81a582c00/0x3d2d1916761d634e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x3d2d1916761d6355 expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869365.926863:0:5743:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788869365.926873:0:7447:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94c81a582c00 already unused, calling callback (ffffffffc1ce9c20) 00010000:00010000:0.0:1788869365.926876:0:5743:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.139@tcp lock: ffff94c80153a400/0x3d2d1916761d635c lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3d2d1916761d6363 expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788869365.926877:0:7447:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.139@tcp lock: ffff94c81a582c00/0x3d2d1916761d634e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0x3d2d1916761d6355 expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869365.926899:0:7447:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.139@tcp lock: ffff94c81a582c00/0x3d2d1916761d634e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0x3d2d1916761d6355 expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869365.926899:0:5743:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.139@tcp lock: ffff94c80153a400/0x3d2d1916761d635c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3d2d1916761d6363 expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788869365.926919:0:7447:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.139@tcp lock: ffff94c81a582c00/0x3d2d1916761d634e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x3d2d1916761d6355 expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869365.926924:0:5743:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 10000000:01000000:3.0:1788869365.926927:0:7447:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788869365.926935:0:5743:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.139@tcp lock: ffff94c8421f3800/0x3d2d1916761d6324 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x3d2d1916761d632b expref: -99 pid: 7440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869365.926943:0:5743:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94c8421f3800 already unused, calling callback (ffffffffc1ce9c20) 10000000:00010000:0.0:1788869365.926946:0:5743:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.139@tcp lock: ffff94c8421f3800/0x3d2d1916761d6324 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x3d2d1916761d632b expref: -99 pid: 7440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869365.926953:0:7447:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.139@tcp lock: ffff94c81a582c00/0x3d2d1916761d634e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3d2d1916761d6355 expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869365.926954:0:5743:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.139@tcp lock: ffff94c8421f3800/0x3d2d1916761d6324 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x3d2d1916761d632b expref: -99 pid: 7440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869365.926971:0:7447:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 10000000:00010000:0.0:1788869365.926973:0:5743:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.139@tcp lock: ffff94c8421f3800/0x3d2d1916761d6324 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x3d2d1916761d632b expref: -99 pid: 7440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869365.926980:0:7447:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.139@tcp lock: ffff94c81a582c00/0x3d2d1916761d634e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3d2d1916761d6355 expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788869365.926981:0:5743:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1788869365.926993:0:7447:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.139@tcp lock: ffff94c81a582c00/0x3d2d1916761d634e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3d2d1916761d6355 expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869365.927003:0:5743:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.139@tcp lock: ffff94c8421f3800/0x3d2d1916761d6324 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3d2d1916761d632b expref: -99 pid: 7440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869365.927006:0:7447:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788869365.927013:0:7447:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.139@tcp lock: ffff94c80153ae00/0x3d2d1916761d62fa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x3d2d1916761d6301 expref: -99 pid: 7440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869365.927014:0:5743:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788869365.927020:0:5743:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.139@tcp lock: ffff94c8421f3800/0x3d2d1916761d6324 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3d2d1916761d632b expref: -99 pid: 7440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869365.927029:0:5743:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.139@tcp lock: ffff94c8421f3800/0x3d2d1916761d6324 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3d2d1916761d632b expref: -99 pid: 7440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869365.927043:0:7447:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94c80153ae00 already unused, calling callback (ffffffffc1ce9c20) 10000000:00010000:3.0:1788869365.927049:0:7447:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.139@tcp lock: ffff94c80153ae00/0x3d2d1916761d62fa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x3d2d1916761d6301 expref: -99 pid: 7440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869365.927050:0:5743:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788869365.927053:0:5743:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788869365.927056:0:5743:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788869365.927064:0:5742:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788869365.927078:0:3286:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94c82065f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:121cd5bc-7f07-4cf7-8e2e-4356c89c0696:3286:1875765421433088:0@lo:103: 00000100:00100000:0.0:1788869365.927106:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869365.927142:0:3286:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94c82cdc7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:121cd5bc-7f07-4cf7-8e2e-4356c89c0696:3286:1875765421432576:0@lo:103: 00000100:00100000:0.0:1788869365.927167:0:3286:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788869365.927186:0:3286:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94c82cdc5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:121cd5bc-7f07-4cf7-8e2e-4356c89c0696:3286:1875765421432960:0@lo:103: 00000100:00100000:0.0:1788869365.927211:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869365.927238:0:3283:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94c82cdc5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:121cd5bc-7f07-4cf7-8e2e-4356c89c0696:3283:1875765421432704:0@lo:103: 00000100:00100000:0.0:1788869365.927287:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869365.927304:0:3283:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94c82cdc6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:121cd5bc-7f07-4cf7-8e2e-4356c89c0696:3283:1875765421433216:0@lo:103: 00000100:00100000:0.0:1788869365.927323:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869365.927339:0:3283:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788869365.927344:0:3283:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94c82cdc4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:121cd5bc-7f07-4cf7-8e2e-4356c89c0696:3283:1875765421432832:0@lo:103: 00000100:00100000:0.0:1788869365.927365:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869365.927395:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765421433088 00000100:00100000:0.0:1788869365.927399:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765421433088 00010000:00010000:0.0:1788869365.927418:0:5788:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff94c818d1fe00/0x3d2d1916761d6355 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3d2d1916761d634e expref: 18 pid: 5749 timeout: 264 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788869365.927435:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765421432960 00000100:00100000:0.0:1788869365.927437:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765421432960 00010000:00010000:0.0:1788869365.927446:0:5788:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff94c81a582a00/0x3d2d1916761d6363 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3d2d1916761d635c expref: 19 pid: 5749 timeout: 264 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788869365.927454:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765421432704 00000100:00100000:0.0:1788869365.927456:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765421432704 00010000:00010000:0.0:1788869365.927464:0:5788:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff94c81a582200/0x3d2d1916761d638d lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3d2d1916761d6386 expref: 20 pid: 5750 timeout: 264 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788869365.927473:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765421433216 00000100:00100000:0.0:1788869365.927474:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765421433216 00010000:00010000:0.0:1788869365.927484:0:5788:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff94c81a583e00/0x3d2d1916761d632b lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3d2d1916761d6324 expref: 21 pid: 5749 timeout: 264 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788869365.927506:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765421432832 00000100:00100000:0.0:1788869365.927509:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765421432832 00010000:00010000:0.0:1788869365.927522:0:5788:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff94c81a582e00/0x3d2d1916761d6371 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3d2d1916761d636a expref: 22 pid: 5750 timeout: 264 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788869365.927534:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788869365.927540:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c82cdc6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:121cd5bc-7f07-4cf7-8e2e-4356c89c0696+22:3286:x1875765421433088:12345-0@lo:103: 00010000:00010000:0.0:1788869365.927548:0:5788:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788869365.927553:0:5788:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff94c818d1fe00/0x3d2d1916761d6355 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3d2d1916761d634e expref: 22 pid: 5749 timeout: 264 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869365.927561:0:5788:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff94c818d1fe00/0x3d2d1916761d6355 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x3d2d1916761d634e expref: 22 pid: 5749 timeout: 264 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869365.927574:0:5788:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788869365.927603:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c82cdc6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:121cd5bc-7f07-4cf7-8e2e-4356c89c0696+22:3286:x1875765421433088:12345-0@lo:103: Request processed in 62us (495us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869365.927610:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788869365.927623:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788869365.927630:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c82cdc7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:121cd5bc-7f07-4cf7-8e2e-4356c89c0696+21:3286:x1875765421432960:12345-0@lo:103: 00010000:00010000:0.0:1788869365.927637:0:5788:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788869365.927641:0:5788:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff94c81a582a00/0x3d2d1916761d6363 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3d2d1916761d635c expref: 21 pid: 5749 timeout: 264 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869365.927648:0:5788:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff94c81a582a00/0x3d2d1916761d6363 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x3d2d1916761d635c expref: 21 pid: 5749 timeout: 264 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869365.927657:0:5788:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788869365.927684:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c82cdc7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:121cd5bc-7f07-4cf7-8e2e-4356c89c0696+21:3286:x1875765421432960:12345-0@lo:103: Request processed in 55us (471us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869365.927690:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788869365.927701:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788869365.927707:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c82cdc4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:121cd5bc-7f07-4cf7-8e2e-4356c89c0696+20:3283:x1875765421432704:12345-0@lo:103: 00010000:00010000:0.0:1788869365.927715:0:5788:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788869365.927719:0:5788:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff94c81a582200/0x3d2d1916761d638d lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3d2d1916761d6386 expref: 20 pid: 5750 timeout: 264 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869365.927728:0:5788:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff94c81a582200/0x3d2d1916761d638d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x3d2d1916761d6386 expref: 20 pid: 5750 timeout: 264 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869365.927738:0:5788:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788869365.927763:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c82cdc4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:121cd5bc-7f07-4cf7-8e2e-4356c89c0696+20:3283:x1875765421432704:12345-0@lo:103: Request processed in 57us (476us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869365.927770:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788869365.927782:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1788869365.927788:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c82cdc7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:121cd5bc-7f07-4cf7-8e2e-4356c89c0696+19:3283:x1875765421433216:12345-0@lo:103: 00010000:00010000:0.0:1788869365.927796:0:5788:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788869365.927800:0:5788:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff94c81a583e00/0x3d2d1916761d632b lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3d2d1916761d6324 expref: 19 pid: 5749 timeout: 264 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869365.927808:0:5788:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff94c81a583e00/0x3d2d1916761d632b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x3d2d1916761d6324 expref: 19 pid: 5749 timeout: 264 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869365.927818:0:5788:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788869365.927839:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c82cdc7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:121cd5bc-7f07-4cf7-8e2e-4356c89c0696+19:3283:x1875765421433216:12345-0@lo:103: Request processed in 51us (514us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869365.927845:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1788869365.927864:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1788869365.927870:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c82cdc6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:121cd5bc-7f07-4cf7-8e2e-4356c89c0696+18:3283:x1875765421432832:12345-0@lo:103: 00010000:00010000:0.0:1788869365.927878:0:5788:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788869365.927883:0:5788:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff94c81a582e00/0x3d2d1916761d6371 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3d2d1916761d636a expref: 18 pid: 5750 timeout: 264 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869365.927891:0:5788:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff94c81a582e00/0x3d2d1916761d6371 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x3d2d1916761d636a expref: 18 pid: 5750 timeout: 264 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869365.927901:0:5788:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788869365.927924:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c82cdc6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:121cd5bc-7f07-4cf7-8e2e-4356c89c0696+18:3283:x1875765421432832:12345-0@lo:103: Request processed in 54us (558us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869365.927930:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1788869365.927966:0:3286:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94c82cdc5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:121cd5bc-7f07-4cf7-8e2e-4356c89c0696:3286:1875765421432960:0@lo:103: 00000100:00100000:0.0:1788869365.927975:0:3286:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94c82065f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:121cd5bc-7f07-4cf7-8e2e-4356c89c0696:3286:1875765421433088:0@lo:103: 00000100:00100000:0.0:1788869365.927999:0:3283:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94c82cdc4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:121cd5bc-7f07-4cf7-8e2e-4356c89c0696:3283:1875765421432832:0@lo:103: 00000100:00100000:0.0:1788869365.928008:0:3283:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94c82cdc5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:121cd5bc-7f07-4cf7-8e2e-4356c89c0696:3283:1875765421432704:0@lo:103: 00000100:00100000:0.0:1788869365.928015:0:3283:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94c82cdc6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:121cd5bc-7f07-4cf7-8e2e-4356c89c0696:3283:1875765421433216:0@lo:103: 00000100:00100000:1.0:1788869365.929371:0:5737:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788869365.929591:0:8253:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94c803fbb480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8253:1875765421431424:192.168.201.39@tcp:104: 00000100:00100000:2.0:1788869365.929606:0:8253:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94c803fbb800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8253:1875765421431552:192.168.201.39@tcp:104: 00010000:00010000:2.0:1788869365.929619:0:8253:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff94c81a582200/0x3d2d1916761d638d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x3d2d1916761d6386 expref: 17 pid: 5750 timeout: 264 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788869365.929636:0:8253:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94c803fba300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8253:1875765421431808:0@lo:104: 00010000:00010000:2.0:1788869365.929667:0:8253:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff94c81a582e00/0x3d2d1916761d6371 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x3d2d1916761d636a expref: 16 pid: 5750 timeout: 264 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788869365.929675:0:8253:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94c803fb8a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8253:1875765421431936:0@lo:104: 00010000:00010000:2.0:1788869365.929685:0:8253:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff94c81a582a00/0x3d2d1916761d6363 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x3d2d1916761d635c expref: 15 pid: 5749 timeout: 264 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788869365.929692:0:8253:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94c803fb8700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8253:1875765421432064:0@lo:104: 00010000:00010000:2.0:1788869365.929700:0:8253:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff94c818d1fe00/0x3d2d1916761d6355 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x3d2d1916761d634e expref: 14 pid: 5749 timeout: 264 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788869365.929709:0:8253:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94c82c840380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8253:1875765421432192:0@lo:104: 00010000:00010000:2.0:1788869365.929718:0:8253:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff94c81a583e00/0x3d2d1916761d632b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x3d2d1916761d6324 expref: 13 pid: 5749 timeout: 264 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788869365.929727:0:8253:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94c82c840000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8253:1875765421432320:0@lo:104: 00000100:00100000:2.0:1788869365.929737:0:8253:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94c82c843480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8253:1875765421432448:0@lo:104: 00010000:00010000:2.0:1788869365.929778:0:8253:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff94c80153be00/0x3d2d1916761d6404 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869365.929973:0:7447:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.139@tcp lock: ffff94c80153ae00/0x3d2d1916761d62fa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x3d2d1916761d6301 expref: -99 pid: 7440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788869365.929985:0:7447:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.139@tcp lock: ffff94c80153ae00/0x3d2d1916761d62fa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x3d2d1916761d6301 expref: -99 pid: 7440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788869365.929993:0:7447:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788869365.930146:0:7447:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.139@tcp lock: ffff94c80153ae00/0x3d2d1916761d62fa lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3d2d1916761d6301 expref: -99 pid: 7440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869365.930154:0:7447:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788869365.930192:0:7447:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.139@tcp lock: ffff94c80153ae00/0x3d2d1916761d62fa lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3d2d1916761d6301 expref: -99 pid: 7440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869365.930200:0:7447:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.139@tcp lock: ffff94c80153ae00/0x3d2d1916761d62fa lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3d2d1916761d6301 expref: -99 pid: 7440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869365.930232:0:7447:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788869365.930234:0:7447:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788869365.930236:0:7447:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788869365.930919:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1788869365.930965:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1788869365.931009:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1788869365.931075:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765413023744 00000100:00100000:1.0:1788869365.931084:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765413023744 00010000:00010000:1.0:1788869365.931121:0:5788:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff94c818d1fc00/0x3d2d1916761d63cc lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.201.39@tcp remote: 0x375c01024903570c expref: 10 pid: 5748 timeout: 214 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788869365.931167:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765413023872 00000100:00100000:1.0:1788869365.931179:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765413023872 00010000:00010000:1.0:1788869365.931192:0:5788:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff94c80153aa00/0x3d2d1916761d63c5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.201.39@tcp remote: 0x375c010249035705 expref: 11 pid: 5748 timeout: 214 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788869365.931213:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 18 00000100:00100000:1.0:1788869365.931223:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c810ef3450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3cca3acf-4935-4d0d-9982-d5d931f1c86b+11:2347:x1875765413023744:12345-192.168.201.39@tcp:103: 00010000:00010000:1.0:1788869365.931236:0:5788:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788869365.931242:0:5788:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff94c818d1fc00/0x3d2d1916761d63cc lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 192.168.201.39@tcp remote: 0x375c01024903570c expref: 11 pid: 5748 timeout: 214 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869365.931298:0:5788:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff94c818d1fc00/0x3d2d1916761d63cc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 192.168.201.39@tcp remote: 0x375c01024903570c expref: 11 pid: 5748 timeout: 214 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788869365.931307:0:5740:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 19 00010000:00010000:1.0:1788869365.931320:0:5788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff94c818d1fc00/0x3d2d1916761d63cc lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 192.168.201.39@tcp remote: 0x375c01024903570c expref: 11 pid: 5748 timeout: 214 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788869365.931321:0:5740:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c82c840000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3cca3acf-4935-4d0d-9982-d5d931f1c86b+11:2347:x1875765413023872:12345-192.168.201.39@tcp:103: 00010000:00010000:3.0:1788869365.931334:0:5740:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788869365.931341:0:5740:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff94c80153aa00/0x3d2d1916761d63c5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 192.168.201.39@tcp remote: 0x375c010249035705 expref: 10 pid: 5748 timeout: 214 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869365.931343:0:5788:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788869365.931357:0:5740:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff94c80153aa00/0x3d2d1916761d63c5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.201.39@tcp remote: 0x375c010249035705 expref: 10 pid: 5748 timeout: 214 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869365.931371:0:5740:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff94c80153aa00/0x3d2d1916761d63c5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.201.39@tcp remote: 0x375c010249035705 expref: 10 pid: 5748 timeout: 214 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869365.931383:0:5740:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788869365.931409:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c810ef3450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3cca3acf-4935-4d0d-9982-d5d931f1c86b+9:2347:x1875765413023744:12345-192.168.201.39@tcp:103: Request processed in 185us (491us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869365.931411:0:5740:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c82c840000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3cca3acf-4935-4d0d-9982-d5d931f1c86b+9:2347:x1875765413023872:12345-192.168.201.39@tcp:103: Request processed in 94us (443us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869365.931426:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 18 00000100:00100000:3.0:1788869365.931476:0:5740:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 19 00000100:00100000:1.0:1788869365.933141:0:3283:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788869365.933180:0:3283:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94c82c843480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:121cd5bc-7f07-4cf7-8e2e-4356c89c0696:3283:1875765421433344:0@lo:103: 00000100:00100000:1.0:1788869365.933271:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869365.933399:0:5741:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765421433344 00000100:00100000:2.0:1788869365.933408:0:5741:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765421433344 00010000:00010000:2.0:1788869365.933445:0:5741:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff94c818d1e600/0x3d2d1916761d6301 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3d2d1916761d62fa expref: 13 pid: 5749 timeout: 264 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788869365.933488:0:5741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1788869365.933497:0:5741:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c81f1f3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:121cd5bc-7f07-4cf7-8e2e-4356c89c0696+13:3283:x1875765421433344:12345-0@lo:103: 00010000:00010000:2.0:1788869365.933512:0:5741:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788869365.933518:0:5741:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff94c818d1e600/0x3d2d1916761d6301 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3d2d1916761d62fa expref: 13 pid: 5749 timeout: 264 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869365.933532:0:5741:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff94c818d1e600/0x3d2d1916761d6301 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x3d2d1916761d62fa expref: 13 pid: 5749 timeout: 264 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788869365.933688:0:5748:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765413024000 00000100:00100000:0.0:1788869365.933694:0:5748:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765413024000 00000100:00100000:0.0:1788869365.933742:0:5748:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 126 00000100:00100000:0.0:1788869365.933751:0:5748:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c810e11050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3cca3acf-4935-4d0d-9982-d5d931f1c86b+8:5555:x1875765413024000:12345-192.168.201.39@tcp:101: 00010000:00010000:0.0:1788869365.933767:0:5748:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788869365.933786:0:5748:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff94c818d1e800/0x3d2d1916761d640b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x375c01024903576e expref: -99 pid: 5748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869365.933826:0:5748:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff94c80153be00/0x3d2d1916761d6404 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869365.933837:0:5748:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff94c818d1e800/0x3d2d1916761d640b lrc: 4/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.201.39@tcp remote: 0x375c01024903576e expref: 9 pid: 5748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869365.933858:0:5748:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: MGS lock: ffff94c80153be00/0x3d2d1916761d6404 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000020 nid: local remote: 0x0 expref: -99 pid: 8253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869365.933874:0:5748:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff94c818d1e800/0x3d2d1916761d640b lrc: 3/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.201.39@tcp remote: 0x375c01024903576e expref: 9 pid: 5748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869365.934291:0:5741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff94c818d1e600/0x3d2d1916761d6301 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x3d2d1916761d62fa expref: 13 pid: 5749 timeout: 264 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869365.934308:0:5741:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff94c80153be00/0x3d2d1916761d6404 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40290400000020 nid: local remote: 0x0 expref: -99 pid: 8253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869365.934316:0:5741:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff94c80153be00/0x3d2d1916761d6404 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40290400000020 nid: local remote: 0x0 expref: -99 pid: 8253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869365.934345:0:5741:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff94c80153be00/0x3d2d1916761d6404 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000020 nid: local remote: 0x0 expref: -99 pid: 8253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869365.934353:0:5741:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff94c80153be00/0x3d2d1916761d6404 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000020 nid: local remote: 0x0 expref: -99 pid: 8253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869365.934361:0:5741:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff94c80153be00/0x3d2d1916761d6404 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000020 nid: local remote: 0x0 expref: -99 pid: 8253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869365.934369:0:5741:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff94c80153be00/0x3d2d1916761d6404 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000020 nid: local remote: 0x0 expref: -99 pid: 8253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869365.934376:0:5741:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94c80153be00 already unused, calling callback (ffffffffc1703220) 00010000:00010000:2.0:1788869365.934379:0:5741:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff94c80153be00/0x3d2d1916761d6404 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000020 nid: local remote: 0x0 expref: -99 pid: 8253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869365.934387:0:5741:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff94c80153be00/0x3d2d1916761d6404 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000020 nid: local remote: 0x0 expref: -99 pid: 8253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869365.934416:0:5741:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff94c818d1e800/0x3d2d1916761d640b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40080000000000 nid: 192.168.201.39@tcp remote: 0x375c01024903576e expref: 9 pid: 5748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869365.934424:0:5741:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff94c818d1e800/0x3d2d1916761d640b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40080000000000 nid: 192.168.201.39@tcp remote: 0x375c01024903576e expref: 9 pid: 5748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869365.934455:0:5741:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: MGS lock: ffff94c818d1e800/0x3d2d1916761d640b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.201.39@tcp remote: 0x375c01024903576e expref: 9 pid: 5748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788869365.934469:0:5741:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94c82c840380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:MGS:5741:1875765421433472:192.168.201.39@tcp:105: 00000100:00100000:2.0:1788869365.934537:0:5741:0:(client.c:2702:ptlrpc_set_wait()) set ffff94c81828ac00 going to sleep for 11 seconds 00010000:00010000:3.0:1788869365.935272:0:8253:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff94c80153be00/0x3d2d1916761d6404 lrc: 5/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000020 nid: local remote: 0x0 expref: -99 pid: 8253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869365.935285:0:8253:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff94c80153be00/0x3d2d1916761d6404 lrc: 5/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000020 nid: local remote: 0x0 expref: -99 pid: 8253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869365.935436:0:5748:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94c818d1e800, rc 0) 00000100:00100000:0.0:1788869365.935488:0:5748:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c810e11050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3cca3acf-4935-4d0d-9982-d5d931f1c86b+9:5555:x1875765413024000:12345-192.168.201.39@tcp:101: Request processed in 1736us (4476us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869365.935497:0:5748:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 126 00000100:00100000:2.0:1788869365.940777:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1788869365.940994:0:5741:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94c82c840380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:MGS:5741:1875765421433472:192.168.201.39@tcp:105: 00010000:00010000:0.0:1788869365.941050:0:5741:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff94c80153be00/0x3d2d1916761d6404 lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000020 nid: local remote: 0x0 expref: -99 pid: 8253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869365.941068:0:5741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff94c80153be00/0x3d2d1916761d6404 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000020 nid: local remote: 0x0 expref: -99 pid: 8253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869365.941087:0:5741:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788869365.941165:0:5741:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c81f1f3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:121cd5bc-7f07-4cf7-8e2e-4356c89c0696+12:3283:x1875765421433344:12345-0@lo:103: Request processed in 7668us (7893us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869365.941188:0:5741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1788869365.941348:0:5749:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765413024128 00000100:00100000:1.0:1788869365.941358:0:5749:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765413024128 00000100:00100000:1.0:1788869365.941418:0:5749:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 127 00000100:00100000:1.0:1788869365.941429:0:5749:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c810e10450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3cca3acf-4935-4d0d-9982-d5d931f1c86b+9:5555:x1875765413024128:12345-192.168.201.39@tcp:501: 00000100:00100000:1.0:1788869365.941806:0:5749:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c810e10450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3cca3acf-4935-4d0d-9982-d5d931f1c86b+9:5555:x1875765413024128:12345-192.168.201.39@tcp:501: Request processed in 379us (1040us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869365.941816:0:5749:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 127 00000100:00100000:2.0:1788869365.941942:0:3283:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94c82c843480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:121cd5bc-7f07-4cf7-8e2e-4356c89c0696:3283:1875765421433344:0@lo:103: 00000100:00100000:1.0:1788869365.950387:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1788869365.950449:0:5748:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765413024256 00000100:00100000:1.0:1788869365.950461:0:5748:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765413024256 00000100:00100000:1.0:1788869365.950527:0:5748:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 128 00000100:00100000:1.0:1788869365.950539:0:5748:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c81f14e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3cca3acf-4935-4d0d-9982-d5d931f1c86b+9:5555:x1875765413024256:12345-192.168.201.39@tcp:503: 00000100:00100000:1.0:1788869365.950824:0:5748:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c81f14e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3cca3acf-4935-4d0d-9982-d5d931f1c86b+9:5555:x1875765413024256:12345-192.168.201.39@tcp:503: Request processed in 285us (450us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869365.950841:0:5748:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 128 00000100:00100000:3.0:1788869365.957970:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1788869365.958218:0:5750:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765413024384 00000100:00100000:2.0:1788869365.958231:0:5750:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765413024384 00000100:00100000:2.0:1788869365.958326:0:5750:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 129 00000100:00100000:2.0:1788869365.958339:0:5750:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c81f14ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3cca3acf-4935-4d0d-9982-d5d931f1c86b+9:6012:x1875765413024384:12345-192.168.201.39@tcp:502: 00000100:00100000:2.0:1788869365.958675:0:5750:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c81f14ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3cca3acf-4935-4d0d-9982-d5d931f1c86b+9:6012:x1875765413024384:12345-192.168.201.39@tcp:502: Request processed in 338us (718us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869365.958685:0:5750:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 129 00000100:00100000:1.0:1788869365.963236:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1788869365.963360:0:5749:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765413024512 00000100:00100000:3.0:1788869365.963374:0:5749:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765413024512 00000100:00100000:3.0:1788869365.963442:0:5749:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 130 00000100:00100000:3.0:1788869365.963454:0:5749:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c81f14f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3cca3acf-4935-4d0d-9982-d5d931f1c86b+9:6012:x1875765413024512:12345-192.168.201.39@tcp:502:llog_process_th.0 00000100:00100000:3.0:1788869365.963779:0:5749:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c81f14f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3cca3acf-4935-4d0d-9982-d5d931f1c86b+9:6012:x1875765413024512:12345-192.168.201.39@tcp:502:llog_process_th.0 Request processed in 327us (553us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869365.963788:0:5749:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 130 00000100:00100000:1.0:1788869365.974356:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1788869365.974477:0:5748:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765413024640 00000100:00100000:3.0:1788869365.974491:0:5748:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765413024640 00000100:00100000:3.0:1788869365.974555:0:5748:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 131 00000100:00100000:3.0:1788869365.974567:0:5748:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c81f14f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3cca3acf-4935-4d0d-9982-d5d931f1c86b+9:5555:x1875765413024640:12345-192.168.201.39@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788869365.974591:0:5748:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788869365.974616:0:5748:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff94c800031400/0x3d2d1916761d6412 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x375c010249035775 expref: -99 pid: 5748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869365.974652:0:5748:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff94c800031400/0x3d2d1916761d6412 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.201.39@tcp remote: 0x375c010249035775 expref: 10 pid: 5748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869365.974666:0:5748:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff94c800031400/0x3d2d1916761d6412 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.201.39@tcp remote: 0x375c010249035775 expref: 10 pid: 5748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869365.974677:0:5748:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94c800031400, rc 0) 00000100:00100000:3.0:1788869365.974761:0:5748:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c81f14f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3cca3acf-4935-4d0d-9982-d5d931f1c86b+10:5555:x1875765413024640:12345-192.168.201.39@tcp:101:ll_cfg_requeue.0 Request processed in 196us (418us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869365.974769:0:5748:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 131 00000100:00100000:3.0:1788869365.976995:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1788869365.977034:0:5750:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765413024768 00000100:00100000:3.0:1788869365.977044:0:5750:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765413024768 00000100:00100000:3.0:1788869365.977097:0:5750:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 132 00000100:00100000:3.0:1788869365.977108:0:5750:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c81f14dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3cca3acf-4935-4d0d-9982-d5d931f1c86b+10:5555:x1875765413024768:12345-192.168.201.39@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788869365.977468:0:5750:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c81f14dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3cca3acf-4935-4d0d-9982-d5d931f1c86b+10:5555:x1875765413024768:12345-192.168.201.39@tcp:501:ll_cfg_requeue.0 Request processed in 361us (480us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788869365.977477:0:5750:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 132 00010000:00010000:3.0:1788869366.179281:0:5743:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788869366.877872:0:3286:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788869366.877907:0:3286:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94c81f1f0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3286:1875765421433600:0@lo:13: 00000100:00100000:1.0:1788869366.878005:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869366.878087:0:6548:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765421433600 00000100:00100000:1.0:1788869366.878098:0:6548:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765421433600 00000100:00100000:1.0:1788869366.878174:0:6548:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788869366.878184:0:6548:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c81f1f0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3286:x1875765421433600:12345-0@lo:13: 00002000:00000024:1.0:1788869366.878229:0:6548:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788869366.878296:0:6548:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c81f1f0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3286:x1875765421433600:12345-0@lo:13: Request processed in 113us (301us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869366.878304:0:6548:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00080000:1.0:1788869366.878325:0:5751:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1788869366.878359:0:3286:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff94c81f1f0380 x1875765421433600/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788869382 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788869366.878379:0:3286:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94c81f1f0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3286:1875765421433600:0@lo:13: 00000020:00000080:0.0:1788869366.927488:0:8305:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007fff675a75a0 20000000:00000080:0.0:1788869366.927513:0:8305:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff94c835562c00 uarg=0000000000000000 20000000:01000000:0.0:1788869366.927615:0:8305:0:(mgs_llog.c:6188:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:0.0:1788869366.927622:0:8305:0:(mgs_llog.c:4643:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:0.0:1788869366.927628:0:8305:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:0.0:1788869366.928468:0:8306:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 20000000:02000000:1.0:1788869366.928693:0:8305:0:(mgs_llog.c:4116:mgs_wlp_lcfg()) Setting parameter general.lod.*.mdt_hash=crush in log params 00000040:00080000:1.0:1788869366.935968:0:8305:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8976 00000040:00080000:1.0:1788869366.936043:0:8305:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 112 off9088 00000040:00080000:1.0:1788869366.936093:0:8305:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 224 off9312 10000000:01000000:1.0:1788869366.936112:0:8305:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:1.0:1788869366.936139:0:8305:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff94c8421f3800/0x3d2d1916761d6419 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869366.936176:0:8305:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff94c81a582000/0x3d2d1916761d61f0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3d2d1916761d61e9 expref: 11 pid: 5748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869366.936193:0:8305:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff94c81a583a00/0x3d2d1916761d6252 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3d2d1916761d624b expref: 11 pid: 5749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869366.936201:0:8305:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff94c8421f2a00/0x3d2d1916761d631d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3d2d1916761d6316 expref: 11 pid: 5748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869366.936212:0:8305:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff94c818d1f000/0x3d2d1916761d63da lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.201.39@tcp remote: 0x375c01024903573d expref: 9 pid: 5748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869366.936220:0:8305:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff94c8421f3800/0x3d2d1916761d6419 lrc: 7/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 8305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869366.936306:0:8305:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff94c818d1f000/0x3d2d1916761d63da lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 192.168.201.39@tcp remote: 0x375c01024903573d expref: 9 pid: 5748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869366.936324:0:8305:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff94c818d1f000/0x3d2d1916761d63da lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 192.168.201.39@tcp remote: 0x375c01024903573d expref: 9 pid: 5748 timeout: 215 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788869366.936342:0:8305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94c81f1f0380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8305:1875765421433728:192.168.201.39@tcp:104: 00010000:00010000:1.0:1788869366.936476:0:8305:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff94c8421f2a00/0x3d2d1916761d631d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x3d2d1916761d6316 expref: 11 pid: 5748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869366.936486:0:8305:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff94c8421f2a00/0x3d2d1916761d631d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x3d2d1916761d6316 expref: 11 pid: 5748 timeout: 265 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788869366.936496:0:8305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94c81f1f3480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8305:1875765421433856:0@lo:104: 00000100:00100000:1.0:1788869366.936542:0:8305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788869366.936582:0:8305:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff94c81a583a00/0x3d2d1916761d6252 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x3d2d1916761d624b expref: 11 pid: 5749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869366.936596:0:8305:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff94c81a583a00/0x3d2d1916761d6252 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x3d2d1916761d624b expref: 11 pid: 5749 timeout: 265 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788869366.936606:0:8305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94c803fb8700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8305:1875765421433984:0@lo:104: 00000100:00100000:1.0:1788869366.936635:0:8305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869366.936676:0:5737:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:1.0:1788869366.936689:0:5737:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765421433856 00000100:00100000:1.0:1788869366.936697:0:5737:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765421433856 00000100:00100000:1.0:1788869366.936747:0:5737:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765421433984 00000100:00100000:1.0:1788869366.936750:0:5737:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765421433984 00000100:00100000:1.0:1788869366.936764:0:5737:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1788869366.936774:0:5737:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c81f1f0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:121cd5bc-7f07-4cf7-8e2e-4356c89c0696+4:8305:x1875765421433856:12345-0@lo:104: 00010000:00010000:1.0:1788869366.936791:0:5737:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.139@tcp lock: ffff94c818d1fa00/0x3d2d1916761d6316 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x3d2d1916761d631d expref: -99 pid: 7440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869366.936848:0:5737:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788869366.936854:0:5737:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c81f1f0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:121cd5bc-7f07-4cf7-8e2e-4356c89c0696+4:8305:x1875765421433856:12345-0@lo:104: Request processed in 82us (312us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869366.936862:0:5737:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1788869366.936881:0:5737:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1788869366.936887:0:5737:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c83c6ca850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:121cd5bc-7f07-4cf7-8e2e-4356c89c0696+3:8305:x1875765421433984:12345-0@lo:104: 00010000:00010000:1.0:1788869366.936895:0:5737:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.139@tcp lock: ffff94c81a582600/0x3d2d1916761d624b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x3d2d1916761d6252 expref: -99 pid: 6543 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869366.936924:0:5737:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1788869366.936929:0:5737:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c83c6ca850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:121cd5bc-7f07-4cf7-8e2e-4356c89c0696+3:8305:x1875765421433984:12345-0@lo:104: Request processed in 42us (293us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869366.936944:0:5737:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00010000:00010000:1.0:1788869366.936995:0:8305:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff94c81a582000/0x3d2d1916761d61f0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x3d2d1916761d61e9 expref: 11 pid: 5748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869366.937004:0:8305:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff94c81a582000/0x3d2d1916761d61f0 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x3d2d1916761d61e9 expref: 11 pid: 5748 timeout: 265 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788869366.937013:0:8305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94c803fb8a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8305:1875765421434112:0@lo:104: 00000100:00100000:1.0:1788869366.937034:0:8305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869366.937050:0:5737:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765421434112 00000100:00100000:1.0:1788869366.937054:0:5737:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765421434112 00000100:00100000:1.0:1788869366.937067:0:5737:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1788869366.937073:0:5737:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c803fba300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:121cd5bc-7f07-4cf7-8e2e-4356c89c0696+3:8305:x1875765421434112:12345-0@lo:104: 00010000:00010000:1.0:1788869366.937080:0:5737:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.139@tcp lock: ffff94c8421f3c00/0x3d2d1916761d61e9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x3d2d1916761d61f0 expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869366.937107:0:5737:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:1.0:1788869366.937112:0:5737:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c803fba300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:121cd5bc-7f07-4cf7-8e2e-4356c89c0696+3:8305:x1875765421434112:12345-0@lo:104: Request processed in 40us (78us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869366.937118:0:5737:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1788869366.937133:0:8305:0:(client.c:2702:ptlrpc_set_wait()) set ffff94c8033c40c0 going to sleep for 11 seconds 00010000:00010000:3.0:1788869366.938276:0:5743:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1788869366.938289:0:5743:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.139@tcp lock: ffff94c818d1fa00/0x3d2d1916761d6316 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x3d2d1916761d631d expref: -99 pid: 7440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869366.938300:0:5743:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94c818d1fa00 already unused, calling callback (ffffffffc1ce9c20) 10000000:00010000:3.0:1788869366.938304:0:5743:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.139@tcp lock: ffff94c818d1fa00/0x3d2d1916761d6316 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x3d2d1916761d631d expref: -99 pid: 7440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869366.938315:0:5743:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.139@tcp lock: ffff94c818d1fa00/0x3d2d1916761d6316 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x3d2d1916761d631d expref: -99 pid: 7440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788869366.938323:0:5743:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.139@tcp lock: ffff94c818d1fa00/0x3d2d1916761d6316 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x3d2d1916761d631d expref: -99 pid: 7440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788869366.938330:0:5743:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1788869366.938377:0:5743:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.139@tcp lock: ffff94c818d1fa00/0x3d2d1916761d6316 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3d2d1916761d631d expref: -99 pid: 7440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869366.938394:0:5743:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788869366.938417:0:5743:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.139@tcp lock: ffff94c818d1fa00/0x3d2d1916761d6316 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3d2d1916761d631d expref: -99 pid: 7440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869366.938424:0:5743:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.139@tcp lock: ffff94c818d1fa00/0x3d2d1916761d6316 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3d2d1916761d631d expref: -99 pid: 7440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869366.938447:0:5743:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788869366.938451:0:5743:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.139@tcp lock: ffff94c81a582600/0x3d2d1916761d624b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x3d2d1916761d6252 expref: -99 pid: 6543 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869366.938456:0:5743:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94c81a582600 already unused, calling callback (ffffffffc1ce9c20) 10000000:00010000:3.0:1788869366.938459:0:5743:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.139@tcp lock: ffff94c81a582600/0x3d2d1916761d624b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x3d2d1916761d6252 expref: -99 pid: 6543 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869366.938466:0:5743:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.139@tcp lock: ffff94c81a582600/0x3d2d1916761d624b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x3d2d1916761d6252 expref: -99 pid: 6543 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788869366.938472:0:5743:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.139@tcp lock: ffff94c81a582600/0x3d2d1916761d624b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x3d2d1916761d6252 expref: -99 pid: 6543 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788869366.938478:0:5743:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1788869366.938490:0:5743:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.139@tcp lock: ffff94c81a582600/0x3d2d1916761d624b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3d2d1916761d6252 expref: -99 pid: 6543 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869366.938495:0:5743:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788869366.938511:0:5743:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.139@tcp lock: ffff94c81a582600/0x3d2d1916761d624b lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3d2d1916761d6252 expref: -99 pid: 6543 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869366.938518:0:5743:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.139@tcp lock: ffff94c81a582600/0x3d2d1916761d624b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3d2d1916761d6252 expref: -99 pid: 6543 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869366.938533:0:5743:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788869366.938536:0:5743:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.139@tcp lock: ffff94c8421f3c00/0x3d2d1916761d61e9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x3d2d1916761d61f0 expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869366.938542:0:5743:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94c8421f3c00 already unused, calling callback (ffffffffc1ce9c20) 10000000:00010000:3.0:1788869366.938545:0:5743:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.139@tcp lock: ffff94c8421f3c00/0x3d2d1916761d61e9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x3d2d1916761d61f0 expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869366.938552:0:5743:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.139@tcp lock: ffff94c8421f3c00/0x3d2d1916761d61e9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x3d2d1916761d61f0 expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788869366.938559:0:5743:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.139@tcp lock: ffff94c8421f3c00/0x3d2d1916761d61e9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x3d2d1916761d61f0 expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788869366.938564:0:5743:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1788869366.938577:0:5743:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.139@tcp lock: ffff94c8421f3c00/0x3d2d1916761d61e9 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3d2d1916761d61f0 expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869366.938582:0:5743:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788869366.938587:0:5743:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.139@tcp lock: ffff94c8421f3c00/0x3d2d1916761d61e9 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3d2d1916761d61f0 expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869366.938594:0:5743:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.139@tcp lock: ffff94c8421f3c00/0x3d2d1916761d61e9 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3d2d1916761d61f0 expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869366.938608:0:5743:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788869366.938610:0:5743:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788869366.938611:0:5743:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788869366.938629:0:3286:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94c82065e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:121cd5bc-7f07-4cf7-8e2e-4356c89c0696:3286:1875765421434240:0@lo:103: 00000100:00100000:3.0:1788869366.938682:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869366.938727:0:3284:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94c82065fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:121cd5bc-7f07-4cf7-8e2e-4356c89c0696:3284:1875765421434496:0@lo:103: 00000100:00100000:3.0:1788869366.938747:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869366.938765:0:3284:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788869366.938770:0:3284:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94c82065d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:121cd5bc-7f07-4cf7-8e2e-4356c89c0696:3284:1875765421434368:0@lo:103: 00000100:00100000:3.0:1788869366.938786:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869366.938815:0:5740:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765421434240 00000100:00100000:3.0:1788869366.938821:0:5740:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765421434240 00010000:00010000:3.0:1788869366.938850:0:5740:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff94c8421f2a00/0x3d2d1916761d631d lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3d2d1916761d6316 expref: 12 pid: 5748 timeout: 265 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788869366.938882:0:5740:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765421434496 00010000:00010000:2.0:1788869366.939014:0:7447:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788869366.939050:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765421434368 00000100:00100000:2.0:1788869366.939053:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765421434368 00010000:00010000:2.0:1788869366.939073:0:5788:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff94c81a583a00/0x3d2d1916761d6252 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3d2d1916761d624b expref: 13 pid: 5749 timeout: 265 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788869366.939096:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1788869366.939103:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c82065c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:121cd5bc-7f07-4cf7-8e2e-4356c89c0696+13:3286:x1875765421434240:12345-0@lo:103: 00010000:00010000:2.0:1788869366.939118:0:5788:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788869366.939123:0:5788:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff94c8421f2a00/0x3d2d1916761d631d lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3d2d1916761d6316 expref: 13 pid: 5748 timeout: 265 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869366.939134:0:5788:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff94c8421f2a00/0x3d2d1916761d631d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x3d2d1916761d6316 expref: 13 pid: 5748 timeout: 265 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869366.939165:0:5788:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788869366.939204:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c82065c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:121cd5bc-7f07-4cf7-8e2e-4356c89c0696+13:3286:x1875765421434240:12345-0@lo:103: Request processed in 101us (522us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869366.939212:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1788869366.939235:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1788869366.939241:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c82065f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:121cd5bc-7f07-4cf7-8e2e-4356c89c0696+12:3284:x1875765421434368:12345-0@lo:103: 00010000:00010000:2.0:1788869366.939276:0:5788:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788869366.939281:0:5788:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff94c81a583a00/0x3d2d1916761d6252 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3d2d1916761d624b expref: 12 pid: 5749 timeout: 265 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869366.939290:0:5788:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff94c81a583a00/0x3d2d1916761d6252 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x3d2d1916761d624b expref: 12 pid: 5749 timeout: 265 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869366.939299:0:5788:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788869366.939327:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c82065f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:121cd5bc-7f07-4cf7-8e2e-4356c89c0696+12:3284:x1875765421434368:12345-0@lo:103: Request processed in 86us (540us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869366.939333:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1788869366.939369:0:3284:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94c82065d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:121cd5bc-7f07-4cf7-8e2e-4356c89c0696:3284:1875765421434368:0@lo:103: 00000100:00100000:2.0:1788869366.939391:0:3286:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94c82065e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:121cd5bc-7f07-4cf7-8e2e-4356c89c0696:3286:1875765421434240:0@lo:103: 00000100:00100000:3.0:1788869366.939597:0:5740:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765421434496 00010000:00010000:3.0:1788869366.939615:0:5740:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff94c81a582000/0x3d2d1916761d61f0 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3d2d1916761d61e9 expref: 12 pid: 5748 timeout: 265 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788869366.939631:0:5740:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1788869366.939637:0:5740:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c82065c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:121cd5bc-7f07-4cf7-8e2e-4356c89c0696+12:3284:x1875765421434496:12345-0@lo:103: 00010000:00010000:3.0:1788869366.939643:0:5740:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788869366.939647:0:5740:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff94c81a582000/0x3d2d1916761d61f0 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3d2d1916761d61e9 expref: 12 pid: 5748 timeout: 265 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869366.939655:0:5740:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff94c81a582000/0x3d2d1916761d61f0 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x3d2d1916761d61e9 expref: 12 pid: 5748 timeout: 265 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869366.939665:0:5740:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788869366.939691:0:5740:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c82065c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:121cd5bc-7f07-4cf7-8e2e-4356c89c0696+12:3284:x1875765421434496:12345-0@lo:103: Request processed in 54us (943us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869366.939697:0:5740:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00010000:00010000:0.0:1788869366.940867:0:5742:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788869366.941240:0:8305:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff94c8421f2a00/0x3d2d1916761d631d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x3d2d1916761d6316 expref: 11 pid: 5748 timeout: 265 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788869366.941281:0:8305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94c81f1f3480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8305:1875765421433856:0@lo:104: 00010000:00010000:1.0:1788869366.941329:0:8305:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff94c81a583a00/0x3d2d1916761d6252 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x3d2d1916761d624b expref: 10 pid: 5749 timeout: 265 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788869366.941340:0:8305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94c803fb8700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8305:1875765421433984:0@lo:104: 00010000:00010000:1.0:1788869366.941366:0:8305:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff94c81a582000/0x3d2d1916761d61f0 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x3d2d1916761d61e9 expref: 9 pid: 5748 timeout: 265 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788869366.941375:0:8305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94c803fb8a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8305:1875765421434112:0@lo:104: 00000100:00100000:2.0:1788869366.941643:0:3284:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94c82065fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:121cd5bc-7f07-4cf7-8e2e-4356c89c0696:3284:1875765421434496:0@lo:103: 00000100:00100000:0.0:1788869366.942316:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1788869366.942358:0:8305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94c81f1f0380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8305:1875765421433728:192.168.201.39@tcp:104: 00010000:00010000:1.0:1788869366.942392:0:8305:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff94c8421f3800/0x3d2d1916761d6419 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788869366.942415:0:5741:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765413024896 00000100:00100000:2.0:1788869366.942422:0:5741:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765413024896 00010000:00010000:2.0:1788869366.942457:0:5741:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff94c818d1f000/0x3d2d1916761d63da lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.201.39@tcp remote: 0x375c01024903573d expref: 10 pid: 5748 timeout: 215 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788869366.942509:0:5741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 24 00000100:00100000:2.0:1788869366.942516:0:5741:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c82cdc6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3cca3acf-4935-4d0d-9982-d5d931f1c86b+10:2347:x1875765413024896:12345-192.168.201.39@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788869366.942535:0:5741:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788869366.942540:0:5741:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff94c818d1f000/0x3d2d1916761d63da lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.201.39@tcp remote: 0x375c01024903573d expref: 10 pid: 5748 timeout: 215 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869366.942557:0:5741:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff94c818d1f000/0x3d2d1916761d63da lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.201.39@tcp remote: 0x375c01024903573d expref: 10 pid: 5748 timeout: 215 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869366.942572:0:5741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff94c818d1f000/0x3d2d1916761d63da lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.201.39@tcp remote: 0x375c01024903573d expref: 10 pid: 5748 timeout: 215 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869366.942584:0:5741:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff94c8421f3800/0x3d2d1916761d6419 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869366.942591:0:5741:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff94c8421f3800/0x3d2d1916761d6419 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869366.942604:0:5741:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff94c8421f3800/0x3d2d1916761d6419 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869366.942608:0:5741:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff94c8421f3800/0x3d2d1916761d6419 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869366.942613:0:5741:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff94c8421f3800/0x3d2d1916761d6419 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869366.942618:0:5741:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff94c8421f3800/0x3d2d1916761d6419 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869366.942622:0:5741:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94c8421f3800 already unused, calling callback (ffffffffc1703220) 00010000:00010000:2.0:1788869366.942625:0:5741:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff94c8421f3800/0x3d2d1916761d6419 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869366.942631:0:5741:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff94c8421f3800/0x3d2d1916761d6419 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 8305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869366.942650:0:5741:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff94c8421f3800/0x3d2d1916761d6419 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869366.942660:0:5741:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788869366.942672:0:8305:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff94c8421f3800/0x3d2d1916761d6419 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869366.942679:0:8305:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff94c8421f3800/0x3d2d1916761d6419 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869366.942685:0:8305:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff94c8421f3800/0x3d2d1916761d6419 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788869366.942719:0:5741:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c82cdc6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3cca3acf-4935-4d0d-9982-d5d931f1c86b+9:2347:x1875765413024896:12345-192.168.201.39@tcp:103:ldlm_bl.0 Request processed in 202us (407us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869366.942726:0:5741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 24 00010000:00010000:3.0:1788869367.200603:0:5743:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788869367.413963:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1788869367.415109:0:5749:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765413025024 00000100:00100000:2.0:1788869367.415125:0:5749:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765413025024 00000100:00100000:2.0:1788869367.415208:0:5749:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 133 00000100:00100000:2.0:1788869367.415220:0:5749:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c81f14e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3cca3acf-4935-4d0d-9982-d5d931f1c86b+9:5555:x1875765413025024:12345-192.168.201.39@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788869367.415243:0:5749:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788869367.415292:0:5749:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff94c80153b000/0x3d2d1916761d6420 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x375c01024903577c expref: -99 pid: 5749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869367.415335:0:5749:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff94c80153b000/0x3d2d1916761d6420 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.201.39@tcp remote: 0x375c01024903577c expref: 10 pid: 5749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869367.415350:0:5749:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff94c80153b000/0x3d2d1916761d6420 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.201.39@tcp remote: 0x375c01024903577c expref: 10 pid: 5749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869367.415362:0:5749:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94c80153b000, rc 0) 00000100:00100000:2.0:1788869367.415444:0:5749:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c81f14e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3cca3acf-4935-4d0d-9982-d5d931f1c86b+10:5555:x1875765413025024:12345-192.168.201.39@tcp:101:ll_cfg_requeue.0 Request processed in 226us (1496us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869367.415453:0:5749:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 133 00000100:00100000:3.0:1788869367.424625:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1788869367.424808:0:5748:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765413025152 00000100:00100000:1.0:1788869367.424824:0:5748:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765413025152 00000100:00100000:1.0:1788869367.424897:0:5748:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 134 00000100:00100000:1.0:1788869367.424909:0:5748:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c81f14cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3cca3acf-4935-4d0d-9982-d5d931f1c86b+10:5555:x1875765413025152:12345-192.168.201.39@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788869367.425342:0:5748:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c81f14cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3cca3acf-4935-4d0d-9982-d5d931f1c86b+10:5555:x1875765413025152:12345-192.168.201.39@tcp:501:ll_cfg_requeue.0 Request processed in 433us (732us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869367.425352:0:5748:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 134 00000100:00100000:2.0:1788869367.430380:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1788869367.430470:0:5750:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765413025280 00000100:00100000:3.0:1788869367.430483:0:5750:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765413025280 00000100:00100000:3.0:1788869367.430560:0:5750:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 135 00000100:00100000:3.0:1788869367.430571:0:5750:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c81f14f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3cca3acf-4935-4d0d-9982-d5d931f1c86b+10:5555:x1875765413025280:12345-192.168.201.39@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788869367.430834:0:5750:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c81f14f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3cca3acf-4935-4d0d-9982-d5d931f1c86b+10:5555:x1875765413025280:12345-192.168.201.39@tcp:503:ll_cfg_requeue.0 Request processed in 264us (467us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869367.430842:0:5750:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 135 00000100:00100000:3.0:1788869367.434845:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1788869367.435409:0:5749:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765413025408 00000100:00100000:2.0:1788869367.435434:0:5749:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765413025408 00000100:00100000:2.0:1788869367.435493:0:5749:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 136 00000100:00100000:2.0:1788869367.435503:0:5749:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c81f14c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3cca3acf-4935-4d0d-9982-d5d931f1c86b+10:6072:x1875765413025408:12345-192.168.201.39@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788869367.435747:0:5749:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c81f14c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3cca3acf-4935-4d0d-9982-d5d931f1c86b+10:6072:x1875765413025408:12345-192.168.201.39@tcp:502:llog_process_th.0 Request processed in 245us (910us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869367.435756:0:5749:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 136 00000100:00100000:0.0:1788869367.438751:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1788869367.438965:0:5748:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765413025536 00000100:00100000:2.0:1788869367.438980:0:5748:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765413025536 00000100:00100000:2.0:1788869367.439049:0:5748:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 137 00000100:00100000:2.0:1788869367.439058:0:5748:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c81f14d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3cca3acf-4935-4d0d-9982-d5d931f1c86b+10:6072:x1875765413025536:12345-192.168.201.39@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788869367.439571:0:5748:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c81f14d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3cca3acf-4935-4d0d-9982-d5d931f1c86b+10:6072:x1875765413025536:12345-192.168.201.39@tcp:502:llog_process_th.0 Request processed in 513us (845us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869367.439581:0:5748:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 137 10000000:01000000:1.0:1788869367.579393:0:5752:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1788869367.579404:0:5752:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff94c83f970800 from 39 10000000:01000000:1.0:1788869367.579411:0:5752:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1788869367.580203:0:5752:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.139@tcp lock: ffff94c8421f3800/0x3d2d1916761d6427 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869367.580240:0:5752:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.139@tcp lock: ffff94c8421f3800/0x3d2d1916761d6427 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869367.580300:0:5752:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.139@tcp lock: ffff94c8421f3800/0x3d2d1916761d6427 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788869367.580332:0:5752:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94c803fb8a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:121cd5bc-7f07-4cf7-8e2e-4356c89c0696:5752:1875765421434624:0@lo:101: 00000100:00100000:1.0:1788869367.580441:0:5752:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869367.580504:0:5752:0:(client.c:2702:ptlrpc_set_wait()) set ffff94c8033c4600 going to sleep for 11 seconds 00000100:00100000:2.0:1788869367.580724:0:5749:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765421434624 00000100:00100000:2.0:1788869367.580736:0:5749:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765421434624 00000100:00100000:2.0:1788869367.580810:0:5749:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:2.0:1788869367.580820:0:5749:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c81f14c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:121cd5bc-7f07-4cf7-8e2e-4356c89c0696+9:5752:x1875765421434624:12345-0@lo:101: 00010000:00010000:2.0:1788869367.580840:0:5749:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788869367.580857:0:5749:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff94c80153ac00/0x3d2d1916761d642e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x3d2d1916761d6427 expref: -99 pid: 5749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869367.580886:0:5749:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff94c80153ac00/0x3d2d1916761d642e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3d2d1916761d6427 expref: 10 pid: 5749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869367.580898:0:5749:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff94c80153ac00/0x3d2d1916761d642e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3d2d1916761d6427 expref: 10 pid: 5749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869367.580922:0:5749:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94c80153ac00, rc 0) 00000100:00100000:2.0:1788869367.580962:0:5749:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c81f14c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:121cd5bc-7f07-4cf7-8e2e-4356c89c0696+10:5752:x1875765421434624:12345-0@lo:101: Request processed in 144us (522us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869367.580969:0:5749:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:1.0:1788869367.581191:0:5752:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94c803fb8a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:121cd5bc-7f07-4cf7-8e2e-4356c89c0696:5752:1875765421434624:0@lo:101: 00010000:00010000:1.0:1788869367.581208:0:5752:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.139@tcp lock: ffff94c8421f3800/0x3d2d1916761d6427 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3d2d1916761d642e expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869367.581217:0:5752:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.139@tcp lock: ffff94c8421f3800/0x3d2d1916761d6427 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x3d2d1916761d642e expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788869367.581313:0:5752:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94c803fb8a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:121cd5bc-7f07-4cf7-8e2e-4356c89c0696:5752:1875765421434752:0@lo:501: 00000100:00100000:1.0:1788869367.581342:0:5752:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869367.581367:0:5752:0:(client.c:2702:ptlrpc_set_wait()) set ffff94c8033c4600 going to sleep for 11 seconds 00000100:00100000:2.0:1788869367.581423:0:5748:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765421434752 00000100:00100000:2.0:1788869367.581435:0:5748:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765421434752 00000100:00100000:2.0:1788869367.581460:0:5748:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:2.0:1788869367.581466:0:5748:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c81f149c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:121cd5bc-7f07-4cf7-8e2e-4356c89c0696+10:5752:x1875765421434752:12345-0@lo:501: 00000100:00100000:2.0:1788869367.582160:0:5748:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c81f149c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:121cd5bc-7f07-4cf7-8e2e-4356c89c0696+10:5752:x1875765421434752:12345-0@lo:501: Request processed in 691us (814us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869367.582169:0:5748:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:1.0:1788869367.582239:0:5752:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94c803fb8a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:121cd5bc-7f07-4cf7-8e2e-4356c89c0696:5752:1875765421434752:0@lo:501: 00000100:00100000:1.0:1788869367.582306:0:5752:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94c803fb8a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:121cd5bc-7f07-4cf7-8e2e-4356c89c0696:5752:1875765421434880:0@lo:503: 00000100:00100000:1.0:1788869367.582347:0:5752:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869367.582374:0:5752:0:(client.c:2702:ptlrpc_set_wait()) set ffff94c8033c4600 going to sleep for 11 seconds 00000100:00100000:2.0:1788869367.582591:0:5749:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765421434880 00000100:00100000:2.0:1788869367.582597:0:5749:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765421434880 00000100:00100000:2.0:1788869367.582635:0:5749:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:2.0:1788869367.582644:0:5749:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c81f14a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:121cd5bc-7f07-4cf7-8e2e-4356c89c0696+10:5752:x1875765421434880:12345-0@lo:503: 00000100:00100000:2.0:1788869367.582953:0:5749:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c81f14a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:121cd5bc-7f07-4cf7-8e2e-4356c89c0696+10:5752:x1875765421434880:12345-0@lo:503: Request processed in 310us (605us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869367.582961:0:5749:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:3.0:1788869367.592173:0:5752:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94c803fb8a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:121cd5bc-7f07-4cf7-8e2e-4356c89c0696:5752:1875765421434880:0@lo:503: 00000100:00100000:3.0:1788869367.594221:0:8330:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94c82065dc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:121cd5bc-7f07-4cf7-8e2e-4356c89c0696:8330:1875765421435008:0@lo:502: 00000100:00100000:3.0:1788869367.594367:0:8330:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869367.594419:0:8330:0:(client.c:2702:ptlrpc_set_wait()) set ffff94c808e29300 going to sleep for 11 seconds 00000100:00100000:2.0:1788869367.595881:0:5750:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765421435008 00000100:00100000:2.0:1788869367.596188:0:5750:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765421435008 00000100:00100000:2.0:1788869367.596290:0:5750:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:2.0:1788869367.596304:0:5750:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c81f148c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:121cd5bc-7f07-4cf7-8e2e-4356c89c0696+10:8330:x1875765421435008:12345-0@lo:502: 00000100:00100000:2.0:1788869367.596796:0:5750:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c81f148c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:121cd5bc-7f07-4cf7-8e2e-4356c89c0696+10:8330:x1875765421435008:12345-0@lo:502: Request processed in 494us (2428us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869367.596806:0:5750:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:3.0:1788869367.597178:0:8330:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94c82065dc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:121cd5bc-7f07-4cf7-8e2e-4356c89c0696:8330:1875765421435008:0@lo:502: 00000100:00100000:3.0:1788869367.597283:0:8330:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94c82065dc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:121cd5bc-7f07-4cf7-8e2e-4356c89c0696:8330:1875765421435136:0@lo:502: 00000100:00100000:3.0:1788869367.597340:0:8330:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869367.597380:0:8330:0:(client.c:2702:ptlrpc_set_wait()) set ffff94c808e29300 going to sleep for 11 seconds 00000100:00100000:2.0:1788869367.598152:0:5749:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765421435136 00000100:00100000:2.0:1788869367.598162:0:5749:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765421435136 00000100:00100000:2.0:1788869367.598218:0:5749:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:2.0:1788869367.598228:0:5749:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c81f14b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:121cd5bc-7f07-4cf7-8e2e-4356c89c0696+10:8330:x1875765421435136:12345-0@lo:502: 00000100:00100000:2.0:1788869367.599701:0:5749:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c81f14b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:121cd5bc-7f07-4cf7-8e2e-4356c89c0696+10:8330:x1875765421435136:12345-0@lo:502: Request processed in 1466us (2352us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869367.599716:0:5749:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:3.0:1788869367.600895:0:8330:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94c82065dc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:121cd5bc-7f07-4cf7-8e2e-4356c89c0696:8330:1875765421435136:0@lo:502: 00000040:00080000:3.0:1788869367.600945:0:8330:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:2.0:1788869367.606237:0:5752:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:2.0:1788869367.606300:0:5752:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.139@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1788869367.606315:0:5752:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.139@tcp lock: ffff94c8421f3800/0x3d2d1916761d6427 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3d2d1916761d642e expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869367.606331:0:5752:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.139@tcp lock: ffff94c8421f3800/0x3d2d1916761d6427 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3d2d1916761d642e expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788869367.606345:0:5752:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0001 10000000:01000000:2.0:1788869367.606348:0:5752:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 8 10000000:01000000:2.0:1788869367.606352:0:5752:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:2.0:1788869367.606403:0:5752:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.139@tcp lock: ffff94c80153b200/0x3d2d1916761d6435 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869367.606412:0:5752:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.139@tcp lock: ffff94c80153b200/0x3d2d1916761d6435 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869367.606425:0:5752:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.139@tcp lock: ffff94c80153b200/0x3d2d1916761d6435 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788869367.606455:0:5752:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94c82c843480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:121cd5bc-7f07-4cf7-8e2e-4356c89c0696:5752:1875765421435264:0@lo:101: 00000100:00100000:2.0:1788869367.606551:0:5752:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869367.606607:0:5752:0:(client.c:2702:ptlrpc_set_wait()) set ffff94c835537180 going to sleep for 11 seconds 00000100:00100000:2.0:1788869367.606643:0:5748:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765421435264 00000100:00100000:2.0:1788869367.606652:0:5748:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765421435264 00000100:00100000:2.0:1788869367.606709:0:5748:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:2.0:1788869367.606720:0:5748:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c81f148050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:121cd5bc-7f07-4cf7-8e2e-4356c89c0696+10:5752:x1875765421435264:12345-0@lo:101: 00010000:00010000:2.0:1788869367.606736:0:5748:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788869367.606753:0:5748:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff94c80153ba00/0x3d2d1916761d643c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x3d2d1916761d6435 expref: -99 pid: 5748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869367.606781:0:5748:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff94c80153ba00/0x3d2d1916761d643c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3d2d1916761d6435 expref: 11 pid: 5748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869367.606793:0:5748:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff94c80153ba00/0x3d2d1916761d643c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3d2d1916761d6435 expref: 11 pid: 5748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869367.606805:0:5748:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94c80153ba00, rc 0) 00000100:00100000:2.0:1788869367.606847:0:5748:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c81f148050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:121cd5bc-7f07-4cf7-8e2e-4356c89c0696+11:5752:x1875765421435264:12345-0@lo:101: Request processed in 129us (296us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869367.606855:0:5748:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:2.0:1788869367.606911:0:5752:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94c82c843480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:121cd5bc-7f07-4cf7-8e2e-4356c89c0696:5752:1875765421435264:0@lo:101: 00010000:00010000:2.0:1788869367.606926:0:5752:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.139@tcp lock: ffff94c80153b200/0x3d2d1916761d6435 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x3d2d1916761d643c expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869367.606937:0:5752:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.139@tcp lock: ffff94c80153b200/0x3d2d1916761d6435 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x3d2d1916761d643c expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788869367.606991:0:5752:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94c82c843480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:121cd5bc-7f07-4cf7-8e2e-4356c89c0696:5752:1875765421435392:0@lo:501: 00000100:00100000:2.0:1788869367.607020:0:5752:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869367.607035:0:5752:0:(client.c:2702:ptlrpc_set_wait()) set ffff94c835537180 going to sleep for 11 seconds 00000100:00100000:2.0:1788869367.609168:0:5749:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765421435392 00000100:00100000:2.0:1788869367.609198:0:5749:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765421435392 00000100:00100000:2.0:1788869367.609268:0:5749:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:2.0:1788869367.609278:0:5749:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c81f149050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:121cd5bc-7f07-4cf7-8e2e-4356c89c0696+11:5752:x1875765421435392:12345-0@lo:501: 00000100:00100000:2.0:1788869367.609794:0:5749:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c81f149050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:121cd5bc-7f07-4cf7-8e2e-4356c89c0696+11:5752:x1875765421435392:12345-0@lo:501: Request processed in 516us (2770us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869367.609803:0:5749:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:2.0:1788869367.609871:0:5752:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94c82c843480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:121cd5bc-7f07-4cf7-8e2e-4356c89c0696:5752:1875765421435392:0@lo:501: 00000100:00100000:2.0:1788869367.609933:0:5752:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94c82c843480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:121cd5bc-7f07-4cf7-8e2e-4356c89c0696:5752:1875765421435520:0@lo:503: 00000100:00100000:2.0:1788869367.610830:0:5752:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869367.610904:0:5752:0:(client.c:2702:ptlrpc_set_wait()) set ffff94c835537180 going to sleep for 11 seconds 00000100:00100000:0.0:1788869367.614680:0:5750:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765421435520 00000100:00100000:0.0:1788869367.614702:0:5750:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765421435520 00000100:00100000:0.0:1788869367.615550:0:5750:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:0.0:1788869367.615567:0:5750:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c81f148450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:121cd5bc-7f07-4cf7-8e2e-4356c89c0696+11:5752:x1875765421435520:12345-0@lo:503: 00000100:00100000:0.0:1788869367.615878:0:5750:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c81f148450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:121cd5bc-7f07-4cf7-8e2e-4356c89c0696+11:5752:x1875765421435520:12345-0@lo:503: Request processed in 315us (5893us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869367.615886:0:5750:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:1.0:1788869367.616216:0:5752:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94c82c843480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:121cd5bc-7f07-4cf7-8e2e-4356c89c0696:5752:1875765421435520:0@lo:503: 00000100:00100000:1.0:1788869367.616530:0:8332:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94c803fb8700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:121cd5bc-7f07-4cf7-8e2e-4356c89c0696:8332:1875765421435648:0@lo:502: 00000100:00100000:1.0:1788869367.616585:0:8332:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869367.619457:0:8332:0:(client.c:2702:ptlrpc_set_wait()) set ffff94c8033c4840 going to sleep for 11 seconds 00000100:00100000:2.0:1788869367.619917:0:5749:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765421435648 00000100:00100000:2.0:1788869367.619929:0:5749:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765421435648 00000100:00100000:2.0:1788869367.620009:0:5748:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:2.0:1788869367.620021:0:5748:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c81f149450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:121cd5bc-7f07-4cf7-8e2e-4356c89c0696+11:8332:x1875765421435648:12345-0@lo:502: 00000100:00100000:2.0:1788869367.620379:0:5748:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c81f149450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:121cd5bc-7f07-4cf7-8e2e-4356c89c0696+11:8332:x1875765421435648:12345-0@lo:502: Request processed in 360us (3792us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869367.620388:0:5748:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:1.0:1788869367.620399:0:8332:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94c803fb8700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:121cd5bc-7f07-4cf7-8e2e-4356c89c0696:8332:1875765421435648:0@lo:502: 00000020:01000000:1.0:1788869367.620436:0:8332:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788869367.620448:0:8332:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788869367.620451:0:8332:0:(obd_config.c:1561:class_process_config()) marker 26 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1788869367.620461:0:8332:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000100:00100000:1.0:1788869367.620504:0:8332:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94c803fb8700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:121cd5bc-7f07-4cf7-8e2e-4356c89c0696:8332:1875765421435776:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788869367.620550:0:8332:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869367.620571:0:8332:0:(client.c:2702:ptlrpc_set_wait()) set ffff94c8033c4840 going to sleep for 11 seconds 00000100:00100000:2.0:1788869367.620627:0:5748:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765421435776 00000100:00100000:2.0:1788869367.620632:0:5748:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765421435776 00000100:00100000:2.0:1788869367.620652:0:5748:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:2.0:1788869367.620657:0:5748:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c81f148850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:121cd5bc-7f07-4cf7-8e2e-4356c89c0696+11:8332:x1875765421435776:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788869367.620770:0:5748:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c81f148850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:121cd5bc-7f07-4cf7-8e2e-4356c89c0696+11:8332:x1875765421435776:12345-0@lo:502:llog_process_th.0 Request processed in 112us (219us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869367.620778:0:5748:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:1.0:1788869367.621180:0:8332:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94c803fb8700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:121cd5bc-7f07-4cf7-8e2e-4356c89c0696:8332:1875765421435776:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788869367.621197:0:8332:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788869367.621201:0:8332:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788869367.621202:0:8332:0:(obd_config.c:1561:class_process_config()) marker 26 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1788869367.621206:0:8332:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 11 count 11 00000020:01000000:3.0:1788869367.621305:0:5752:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 8-10 (rc=0) 10000000:01000000:3.0:1788869367.621327:0:5752:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.139@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:3.0:1788869367.621339:0:5752:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.139@tcp lock: ffff94c80153b200/0x3d2d1916761d6435 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x3d2d1916761d643c expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869367.621351:0:5752:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.139@tcp lock: ffff94c80153b200/0x3d2d1916761d6435 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x3d2d1916761d643c expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788869367.621369:0:5752:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1788869367.621371:0:5752:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff94c83f970800 from 4 10000000:01000000:3.0:1788869367.621374:0:5752:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788869367.621406:0:5752:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.139@tcp lock: ffff94c800030c00/0x3d2d1916761d6443 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869367.621415:0:5752:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.139@tcp lock: ffff94c800030c00/0x3d2d1916761d6443 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869367.621488:0:5752:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.139@tcp lock: ffff94c800030c00/0x3d2d1916761d6443 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788869367.621506:0:5752:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94c82065dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:121cd5bc-7f07-4cf7-8e2e-4356c89c0696:5752:1875765421435904:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788869367.621600:0:5752:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869367.621635:0:5752:0:(client.c:2702:ptlrpc_set_wait()) set ffff94c808e29300 going to sleep for 11 seconds 00000100:00100000:0.0:1788869367.621678:0:5750:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765421435904 00000100:00100000:0.0:1788869367.621683:0:5750:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765421435904 00000100:00100000:0.0:1788869367.621811:0:5750:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:0.0:1788869367.621820:0:5750:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c81f149850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:121cd5bc-7f07-4cf7-8e2e-4356c89c0696+11:5752:x1875765421435904:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788869367.621831:0:5750:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788869367.621848:0:5750:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff94c818d1f600/0x3d2d1916761d644a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x3d2d1916761d6443 expref: -99 pid: 5750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869367.621872:0:5750:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff94c818d1f600/0x3d2d1916761d644a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3d2d1916761d6443 expref: 12 pid: 5750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869367.621884:0:5750:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff94c818d1f600/0x3d2d1916761d644a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3d2d1916761d6443 expref: 12 pid: 5750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869367.621904:0:5750:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94c818d1f600, rc 0) 00000100:00100000:0.0:1788869367.621947:0:5750:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c81f149850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:121cd5bc-7f07-4cf7-8e2e-4356c89c0696+12:5752:x1875765421435904:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 129us (347us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869367.621954:0:5750:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:2.0:1788869367.622011:0:5752:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94c82065dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:121cd5bc-7f07-4cf7-8e2e-4356c89c0696:5752:1875765421435904:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788869367.622024:0:5752:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.139@tcp lock: ffff94c800030c00/0x3d2d1916761d6443 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3d2d1916761d644a expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869367.622040:0:5752:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.139@tcp lock: ffff94c800030c00/0x3d2d1916761d6443 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x3d2d1916761d644a expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788869367.622091:0:5752:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94c82c841c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:121cd5bc-7f07-4cf7-8e2e-4356c89c0696:5752:1875765421436032:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788869367.622120:0:5752:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869367.622334:0:5752:0:(client.c:2702:ptlrpc_set_wait()) set ffff94c835537300 going to sleep for 11 seconds 00000100:00100000:1.0:1788869367.624394:0:5748:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765421436032 00000100:00100000:1.0:1788869367.624410:0:5748:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765421436032 00000100:00100000:1.0:1788869367.624603:0:5748:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:1.0:1788869367.624616:0:5748:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c81f14a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:121cd5bc-7f07-4cf7-8e2e-4356c89c0696+12:5752:x1875765421436032:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788869367.625695:0:5748:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c81f14a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:121cd5bc-7f07-4cf7-8e2e-4356c89c0696+12:5752:x1875765421436032:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 1077us (3569us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869367.625707:0:5748:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:2.0:1788869367.629342:0:5752:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94c82c841c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:121cd5bc-7f07-4cf7-8e2e-4356c89c0696:5752:1875765421436032:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788869367.629505:0:5752:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94c82c841c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:121cd5bc-7f07-4cf7-8e2e-4356c89c0696:5752:1875765421436160:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788869367.629661:0:5752:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869367.629771:0:5752:0:(client.c:2702:ptlrpc_set_wait()) set ffff94c835537300 going to sleep for 11 seconds 00000100:00100000:0.0:1788869367.632216:0:5749:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765421436160 00000100:00100000:0.0:1788869367.632237:0:5749:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765421436160 00000100:00100000:0.0:1788869367.632791:0:5749:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:0.0:1788869367.632805:0:5749:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c81f14bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:121cd5bc-7f07-4cf7-8e2e-4356c89c0696+12:5752:x1875765421436160:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788869367.633114:0:5749:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c81f14bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:121cd5bc-7f07-4cf7-8e2e-4356c89c0696+12:5752:x1875765421436160:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 312us (3452us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869367.633123:0:5749:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:3.0:1788869367.633234:0:5752:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94c82c841c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:121cd5bc-7f07-4cf7-8e2e-4356c89c0696:5752:1875765421436160:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788869367.639709:0:8335:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94c82065ed80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:121cd5bc-7f07-4cf7-8e2e-4356c89c0696:8335:1875765421436288:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788869367.639820:0:8335:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869367.640718:0:8335:0:(client.c:2702:ptlrpc_set_wait()) set ffff94c808e29cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788869367.643053:0:5748:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765421436288 00000100:00100000:0.0:1788869367.643070:0:5748:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765421436288 00000100:00100000:2.0:1788869367.643234:0:5748:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:2.0:1788869367.643246:0:5748:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c81f14a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:121cd5bc-7f07-4cf7-8e2e-4356c89c0696+12:8335:x1875765421436288:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788869367.643774:0:5748:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c81f14a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:121cd5bc-7f07-4cf7-8e2e-4356c89c0696+12:8335:x1875765421436288:12345-0@lo:502:llog_process_th.0 Request processed in 526us (3950us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869367.643783:0:5748:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:1.0:1788869367.643902:0:8335:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94c82065ed80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:121cd5bc-7f07-4cf7-8e2e-4356c89c0696:8335:1875765421436288:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788869367.643944:0:8335:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788869367.643957:0:8335:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788869367.643960:0:8335:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1788869367.643971:0:8335:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff94c83f970800 00000020:00000080:1.0:1788869367.643981:0:8335:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1788869367.644114:0:8335:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94c803fb8700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:121cd5bc-7f07-4cf7-8e2e-4356c89c0696:8335:1875765421436416:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788869367.644178:0:8335:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869367.644215:0:8335:0:(client.c:2702:ptlrpc_set_wait()) set ffff94c8033c4900 going to sleep for 11 seconds 00000100:00100000:0.0:1788869367.644298:0:5749:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765421436416 00000100:00100000:0.0:1788869367.644304:0:5749:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765421436416 00000100:00100000:0.0:1788869367.644346:0:5749:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:0.0:1788869367.644356:0:5749:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c81f14ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:121cd5bc-7f07-4cf7-8e2e-4356c89c0696+12:8335:x1875765421436416:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788869367.644649:0:5749:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c81f14ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:121cd5bc-7f07-4cf7-8e2e-4356c89c0696+12:8335:x1875765421436416:12345-0@lo:502:llog_process_th.0 Request processed in 295us (470us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869367.644657:0:5749:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:1.0:1788869367.644780:0:8335:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94c803fb8700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:121cd5bc-7f07-4cf7-8e2e-4356c89c0696:8335:1875765421436416:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788869367.644803:0:8335:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788869367.644808:0:8335:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788869367.644810:0:8335:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:1.0:1788869367.644814:0:8335:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:0.0:1788869367.644994:0:5752:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:0.0:1788869367.645019:0:5752:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.139@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788869367.645031:0:5752:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.139@tcp lock: ffff94c800030c00/0x3d2d1916761d6443 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3d2d1916761d644a expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869367.645044:0:5752:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.139@tcp lock: ffff94c800030c00/0x3d2d1916761d6443 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3d2d1916761d644a expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788869367.645062:0:5752:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1788869367.645065:0:5752:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff94c839dd4000 from 39 10000000:01000000:0.0:1788869367.645068:0:5752:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1788869367.645100:0:5752:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.139@tcp lock: ffff94c818d1f400/0x3d2d1916761d6451 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869367.645108:0:5752:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.139@tcp lock: ffff94c818d1f400/0x3d2d1916761d6451 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869367.645117:0:5752:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.139@tcp lock: ffff94c818d1f400/0x3d2d1916761d6451 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788869367.645135:0:5752:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94c82cdc5180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:121cd5bc-7f07-4cf7-8e2e-4356c89c0696:5752:1875765421436544:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788869367.645180:0:5752:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869367.645211:0:5752:0:(client.c:2702:ptlrpc_set_wait()) set ffff94c8050683c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788869367.646644:0:5749:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765421436544 00000100:00100000:1.0:1788869367.646658:0:5749:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765421436544 00000100:00100000:1.0:1788869367.646716:0:5749:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:1.0:1788869367.646727:0:5749:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c81f14b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:121cd5bc-7f07-4cf7-8e2e-4356c89c0696+12:5752:x1875765421436544:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788869367.646747:0:5749:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788869367.646768:0:5749:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff94c8421f2a00/0x3d2d1916761d6458 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x3d2d1916761d6451 expref: -99 pid: 5749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869367.646800:0:5749:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff94c8421f2a00/0x3d2d1916761d6458 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3d2d1916761d6451 expref: 13 pid: 5749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869367.646813:0:5749:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff94c8421f2a00/0x3d2d1916761d6458 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3d2d1916761d6451 expref: 13 pid: 5749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869367.646823:0:5749:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94c8421f2a00, rc 0) 00000100:00100000:1.0:1788869367.646902:0:5749:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c81f14b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:121cd5bc-7f07-4cf7-8e2e-4356c89c0696+13:5752:x1875765421436544:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 178us (1722us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869367.646910:0:5749:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:0.0:1788869367.647032:0:5752:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94c82cdc5180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:121cd5bc-7f07-4cf7-8e2e-4356c89c0696:5752:1875765421436544:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788869367.647053:0:5752:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.139@tcp lock: ffff94c818d1f400/0x3d2d1916761d6451 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x3d2d1916761d6458 expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869367.647063:0:5752:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.139@tcp lock: ffff94c818d1f400/0x3d2d1916761d6451 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x3d2d1916761d6458 expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788869367.647152:0:5752:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94c82cdc5180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:121cd5bc-7f07-4cf7-8e2e-4356c89c0696:5752:1875765421436672:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788869367.647191:0:5752:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869367.647235:0:5752:0:(client.c:2702:ptlrpc_set_wait()) set ffff94c8050683c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788869367.647283:0:5750:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765421436672 00000100:00100000:0.0:1788869367.647287:0:5750:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765421436672 00000100:00100000:0.0:1788869367.647325:0:5750:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:0.0:1788869367.647332:0:5750:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c81f14b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:121cd5bc-7f07-4cf7-8e2e-4356c89c0696+13:5752:x1875765421436672:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788869367.647709:0:5750:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c81f14b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:121cd5bc-7f07-4cf7-8e2e-4356c89c0696+13:5752:x1875765421436672:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 376us (518us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869367.647718:0:5750:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:0.0:1788869367.647750:0:5752:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94c82cdc5180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:121cd5bc-7f07-4cf7-8e2e-4356c89c0696:5752:1875765421436672:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788869367.647782:0:5752:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94c82cdc5180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:121cd5bc-7f07-4cf7-8e2e-4356c89c0696:5752:1875765421436800:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788869367.647819:0:5752:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869367.647834:0:5752:0:(client.c:2702:ptlrpc_set_wait()) set ffff94c8050683c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788869367.647846:0:5749:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765421436800 00000100:00100000:0.0:1788869367.647850:0:5749:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765421436800 00000100:00100000:0.0:1788869367.647867:0:5749:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:0.0:1788869367.647873:0:5749:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c81f0fd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:121cd5bc-7f07-4cf7-8e2e-4356c89c0696+13:5752:x1875765421436800:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788869367.648024:0:5749:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c81f0fd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:121cd5bc-7f07-4cf7-8e2e-4356c89c0696+13:5752:x1875765421436800:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 150us (204us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869367.648031:0:5749:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:0.0:1788869367.648064:0:5752:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94c82cdc5180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:121cd5bc-7f07-4cf7-8e2e-4356c89c0696:5752:1875765421436800:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788869367.652960:0:8337:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94c82c842d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:121cd5bc-7f07-4cf7-8e2e-4356c89c0696:8337:1875765421436928:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788869367.653066:0:8337:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869367.653227:0:8337:0:(client.c:2702:ptlrpc_set_wait()) set ffff94c835537180 going to sleep for 11 seconds 00000100:00100000:3.0:1788869367.660613:0:5749:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765421436928 00000100:00100000:3.0:1788869367.660637:0:5749:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765421436928 00000100:00100000:3.0:1788869367.660708:0:5749:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:3.0:1788869367.660721:0:5749:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c81f0fc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:121cd5bc-7f07-4cf7-8e2e-4356c89c0696+13:8337:x1875765421436928:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788869367.661102:0:5749:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c81f0fc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:121cd5bc-7f07-4cf7-8e2e-4356c89c0696+13:8337:x1875765421436928:12345-0@lo:502:llog_process_th.0 Request processed in 384us (8036us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869367.661112:0:5749:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:3.0:1788869367.661237:0:8337:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94c82c842d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:121cd5bc-7f07-4cf7-8e2e-4356c89c0696:8337:1875765421436928:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788869367.661347:0:8337:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94c82065d500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:121cd5bc-7f07-4cf7-8e2e-4356c89c0696:8337:1875765421437056:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788869367.661393:0:8337:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869367.661441:0:8337:0:(client.c:2702:ptlrpc_set_wait()) set ffff94c808e29780 going to sleep for 11 seconds 00000100:00100000:3.0:1788869367.661457:0:5748:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765421437056 00000100:00100000:3.0:1788869367.661461:0:5748:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765421437056 00000100:00100000:3.0:1788869367.661489:0:5748:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:3.0:1788869367.661496:0:5748:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c81f0fd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:121cd5bc-7f07-4cf7-8e2e-4356c89c0696+13:8337:x1875765421437056:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788869367.661632:0:5748:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c81f0fd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:121cd5bc-7f07-4cf7-8e2e-4356c89c0696+13:8337:x1875765421437056:12345-0@lo:502:llog_process_th.0 Request processed in 136us (239us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869367.661640:0:5748:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:3.0:1788869367.661670:0:8337:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94c82065d500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:121cd5bc-7f07-4cf7-8e2e-4356c89c0696:8337:1875765421437056:0@lo:502:llog_process_th.0 00000040:00080000:3.0:1788869367.661687:0:8337:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:1.0:1788869367.662668:0:5752:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:1.0:1788869367.662701:0:5752:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.139@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1788869367.662722:0:5752:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.139@tcp lock: ffff94c818d1f400/0x3d2d1916761d6451 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x3d2d1916761d6458 expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869367.662736:0:5752:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.139@tcp lock: ffff94c818d1f400/0x3d2d1916761d6451 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x3d2d1916761d6458 expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788869367.662747:0:5752:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:1.0:1788869367.662750:0:5752:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 11 10000000:01000000:1.0:1788869367.662753:0:5752:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:1.0:1788869367.662787:0:5752:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.139@tcp lock: ffff94c8421f2200/0x3d2d1916761d645f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869367.662797:0:5752:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.139@tcp lock: ffff94c8421f2200/0x3d2d1916761d645f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869367.662810:0:5752:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.139@tcp lock: ffff94c8421f2200/0x3d2d1916761d645f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788869367.662831:0:5752:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94c803fb8700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:121cd5bc-7f07-4cf7-8e2e-4356c89c0696:5752:1875765421437184:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788869367.662874:0:5752:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869367.662903:0:5752:0:(client.c:2702:ptlrpc_set_wait()) set ffff94c8033c4180 going to sleep for 11 seconds 00000100:00100000:3.0:1788869367.663585:0:5750:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765421437184 00000100:00100000:3.0:1788869367.663596:0:5750:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765421437184 00000100:00100000:3.0:1788869367.663640:0:5750:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:3.0:1788869367.663649:0:5750:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c81f0fe050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:121cd5bc-7f07-4cf7-8e2e-4356c89c0696+13:5752:x1875765421437184:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788869367.663665:0:5750:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788869367.663681:0:5750:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff94c800030200/0x3d2d1916761d6466 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x3d2d1916761d645f expref: -99 pid: 5750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869367.663711:0:5750:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff94c800030200/0x3d2d1916761d6466 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3d2d1916761d645f expref: 14 pid: 5750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869367.663724:0:5750:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff94c800030200/0x3d2d1916761d6466 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3d2d1916761d645f expref: 14 pid: 5750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869367.663745:0:5750:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94c800030200, rc 0) 00000100:00100000:3.0:1788869367.663794:0:5750:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c81f0fe050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:121cd5bc-7f07-4cf7-8e2e-4356c89c0696+14:5752:x1875765421437184:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 146us (919us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869367.663802:0:5750:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:3.0:1788869367.663849:0:5752:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94c803fb8700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:121cd5bc-7f07-4cf7-8e2e-4356c89c0696:5752:1875765421437184:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788869367.663865:0:5752:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.139@tcp lock: ffff94c8421f2200/0x3d2d1916761d645f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x3d2d1916761d6466 expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869367.663875:0:5752:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.139@tcp lock: ffff94c8421f2200/0x3d2d1916761d645f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x3d2d1916761d6466 expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788869367.663934:0:5752:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94c82065d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:121cd5bc-7f07-4cf7-8e2e-4356c89c0696:5752:1875765421437312:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788869367.663959:0:5752:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869367.663975:0:5752:0:(client.c:2702:ptlrpc_set_wait()) set ffff94c808e29900 going to sleep for 11 seconds 00000100:00100000:3.0:1788869367.664005:0:5749:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765421437312 00000100:00100000:3.0:1788869367.664008:0:5749:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765421437312 00000100:00100000:3.0:1788869367.665622:0:5749:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:3.0:1788869367.665651:0:5749:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c81f0ffc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:121cd5bc-7f07-4cf7-8e2e-4356c89c0696+14:5752:x1875765421437312:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788869367.666015:0:5749:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c81f0ffc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:121cd5bc-7f07-4cf7-8e2e-4356c89c0696+14:5752:x1875765421437312:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 373us (2054us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869367.666024:0:5749:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:3.0:1788869367.668131:0:5752:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94c82065d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:121cd5bc-7f07-4cf7-8e2e-4356c89c0696:5752:1875765421437312:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788869367.668226:0:5752:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94c82065d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:121cd5bc-7f07-4cf7-8e2e-4356c89c0696:5752:1875765421437440:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788869367.668335:0:5752:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869367.668388:0:5752:0:(client.c:2702:ptlrpc_set_wait()) set ffff94c808e29900 going to sleep for 11 seconds 00000100:00100000:3.0:1788869367.668413:0:5750:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765421437440 00000100:00100000:3.0:1788869367.668420:0:5750:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765421437440 00000100:00100000:3.0:1788869367.670219:0:5750:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:3.0:1788869367.670235:0:5750:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c81f0fe450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:121cd5bc-7f07-4cf7-8e2e-4356c89c0696+14:5752:x1875765421437440:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788869367.670667:0:5750:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c81f0fe450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:121cd5bc-7f07-4cf7-8e2e-4356c89c0696+14:5752:x1875765421437440:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 434us (2331us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869367.670676:0:5750:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:3.0:1788869367.670754:0:5752:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94c82065d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:121cd5bc-7f07-4cf7-8e2e-4356c89c0696:5752:1875765421437440:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788869367.673794:0:8341:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94c82065d500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:121cd5bc-7f07-4cf7-8e2e-4356c89c0696:8341:1875765421437568:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788869367.673898:0:8341:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869367.673944:0:5749:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765421437568 00000100:00100000:3.0:1788869367.673953:0:5749:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765421437568 00000100:00100000:3.0:1788869367.674002:0:5749:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:3.0:1788869367.674010:0:5749:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c81f0fec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:121cd5bc-7f07-4cf7-8e2e-4356c89c0696+14:8341:x1875765421437568:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788869367.677712:0:5749:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c81f0fec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:121cd5bc-7f07-4cf7-8e2e-4356c89c0696+14:8341:x1875765421437568:12345-0@lo:502:llog_process_th.0 Request processed in 3687us (3800us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869367.677732:0:5749:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:3.0:1788869367.677846:0:8341:0:(client.c:2702:ptlrpc_set_wait()) set ffff94c808e290c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788869367.677878:0:8341:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94c82065d500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:121cd5bc-7f07-4cf7-8e2e-4356c89c0696:8341:1875765421437568:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788869367.677923:0:8341:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788869367.677935:0:8341:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788869367.677938:0:8341:0:(obd_config.c:1561:class_process_config()) marker 27 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1788869367.677946:0:8341:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000100:00100000:3.0:1788869367.677992:0:8341:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94c82065d500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:121cd5bc-7f07-4cf7-8e2e-4356c89c0696:8341:1875765421437696:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788869367.681301:0:8341:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869367.681372:0:8341:0:(client.c:2702:ptlrpc_set_wait()) set ffff94c808e290c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788869367.681611:0:5748:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765421437696 00000100:00100000:0.0:1788869367.681624:0:5748:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765421437696 00000100:00100000:0.0:1788869367.681694:0:5748:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:0.0:1788869367.681705:0:5748:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c81f0ff450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:121cd5bc-7f07-4cf7-8e2e-4356c89c0696+14:8341:x1875765421437696:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788869367.682015:0:5748:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c81f0ff450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:121cd5bc-7f07-4cf7-8e2e-4356c89c0696+14:8341:x1875765421437696:12345-0@lo:502:llog_process_th.0 Request processed in 310us (723us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869367.682025:0:5748:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:3.0:1788869367.683179:0:8341:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94c82065d500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:121cd5bc-7f07-4cf7-8e2e-4356c89c0696:8341:1875765421437696:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788869367.683225:0:8341:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788869367.683234:0:8341:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788869367.683237:0:8341:0:(obd_config.c:1561:class_process_config()) marker 27 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1788869367.683244:0:8341:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 14 count 14 00000020:01000000:3.0:1788869367.683345:0:5752:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 11-13 (rc=0) 10000000:01000000:3.0:1788869367.683366:0:5752:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.139@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:3.0:1788869367.683380:0:5752:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.139@tcp lock: ffff94c8421f2200/0x3d2d1916761d645f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x3d2d1916761d6466 expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869367.683392:0:5752:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.139@tcp lock: ffff94c8421f2200/0x3d2d1916761d645f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x3d2d1916761d6466 expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788869367.683404:0:5752:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1788869367.683407:0:5752:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff94c839dd4000 from 4 10000000:01000000:3.0:1788869367.683410:0:5752:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788869367.683607:0:5752:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.139@tcp lock: ffff94c800030400/0x3d2d1916761d646d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869367.683617:0:5752:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.139@tcp lock: ffff94c800030400/0x3d2d1916761d646d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869367.683629:0:5752:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.139@tcp lock: ffff94c800030400/0x3d2d1916761d646d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788869367.683655:0:5752:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94c82065d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:121cd5bc-7f07-4cf7-8e2e-4356c89c0696:5752:1875765421437824:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788869367.683720:0:5752:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869367.683755:0:5752:0:(client.c:2702:ptlrpc_set_wait()) set ffff94c808e290c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788869367.683774:0:5750:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765421437824 00000100:00100000:3.0:1788869367.683786:0:5750:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765421437824 00000100:00100000:3.0:1788869367.683824:0:5750:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:3.0:1788869367.683832:0:5750:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c81f0ff850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:121cd5bc-7f07-4cf7-8e2e-4356c89c0696+15:5752:x1875765421437824:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788869367.683847:0:5750:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788869367.683863:0:5750:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff94c800030e00/0x3d2d1916761d6474 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x3d2d1916761d646d expref: -99 pid: 5750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869367.683889:0:5750:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff94c800030e00/0x3d2d1916761d6474 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3d2d1916761d646d expref: 16 pid: 5750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869367.683901:0:5750:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff94c800030e00/0x3d2d1916761d6474 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3d2d1916761d646d expref: 16 pid: 5750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869367.683912:0:5750:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94c800030e00, rc 0) 00000100:00100000:3.0:1788869367.683949:0:5750:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c81f0ff850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:121cd5bc-7f07-4cf7-8e2e-4356c89c0696+16:5752:x1875765421437824:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 117us (228us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869367.683956:0:5750:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:3.0:1788869367.683993:0:5752:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94c82065d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:121cd5bc-7f07-4cf7-8e2e-4356c89c0696:5752:1875765421437824:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788869367.684006:0:5752:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.139@tcp lock: ffff94c800030400/0x3d2d1916761d646d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x3d2d1916761d6474 expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869367.684015:0:5752:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.139@tcp lock: ffff94c800030400/0x3d2d1916761d646d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x3d2d1916761d6474 expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788869367.685187:0:5752:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94c82065d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:121cd5bc-7f07-4cf7-8e2e-4356c89c0696:5752:1875765421437952:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788869367.685237:0:5752:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869367.685285:0:5752:0:(client.c:2702:ptlrpc_set_wait()) set ffff94c808e290c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788869367.685309:0:5749:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765421437952 00000100:00100000:3.0:1788869367.685321:0:5749:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765421437952 00000100:00100000:3.0:1788869367.685362:0:5749:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:3.0:1788869367.685370:0:5749:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c81f0fdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:121cd5bc-7f07-4cf7-8e2e-4356c89c0696+15:5752:x1875765421437952:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788869367.688610:0:5749:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c81f0fdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:121cd5bc-7f07-4cf7-8e2e-4356c89c0696+15:5752:x1875765421437952:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 3227us (3360us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869367.688631:0:5749:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:3.0:1788869367.688723:0:5752:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94c82065d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:121cd5bc-7f07-4cf7-8e2e-4356c89c0696:5752:1875765421437952:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788869367.688793:0:5752:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94c82065d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:121cd5bc-7f07-4cf7-8e2e-4356c89c0696:5752:1875765421438080:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788869367.688857:0:5752:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869367.688900:0:5752:0:(client.c:2702:ptlrpc_set_wait()) set ffff94c808e290c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788869367.688920:0:5750:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765421438080 00000100:00100000:3.0:1788869367.688928:0:5750:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765421438080 00000100:00100000:3.0:1788869367.688968:0:5750:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:3.0:1788869367.688978:0:5750:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c81f0fe850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:121cd5bc-7f07-4cf7-8e2e-4356c89c0696+15:5752:x1875765421438080:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788869367.691839:0:5750:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c81f0fe850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:121cd5bc-7f07-4cf7-8e2e-4356c89c0696+15:5752:x1875765421438080:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 2851us (2970us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869367.691858:0:5750:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:2.0:1788869367.692619:0:5752:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94c82065d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:121cd5bc-7f07-4cf7-8e2e-4356c89c0696:5752:1875765421438080:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788869367.703458:0:8343:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94c82c841500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:121cd5bc-7f07-4cf7-8e2e-4356c89c0696:8343:1875765421438208:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788869367.704230:0:8343:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869367.704309:0:5750:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765421438208 00000100:00100000:2.0:1788869367.704318:0:5750:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765421438208 00000100:00100000:2.0:1788869367.704380:0:5750:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:2.0:1788869367.704390:0:5750:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c81f0fcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:121cd5bc-7f07-4cf7-8e2e-4356c89c0696+15:8343:x1875765421438208:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788869367.705830:0:5750:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c81f0fcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:121cd5bc-7f07-4cf7-8e2e-4356c89c0696+15:8343:x1875765421438208:12345-0@lo:502:llog_process_th.0 Request processed in 1428us (1590us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869367.705848:0:5750:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00100000:2.0:1788869367.706061:0:8343:0:(client.c:2702:ptlrpc_set_wait()) set ffff94c803170000 going to sleep for 11 seconds 00000100:00100000:2.0:1788869367.706094:0:8343:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94c82c841500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:121cd5bc-7f07-4cf7-8e2e-4356c89c0696:8343:1875765421438208:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788869367.706132:0:8343:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788869367.706155:0:8343:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788869367.706158:0:8343:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1788869367.706165:0:8343:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff94c839dd4000 00000020:00000080:2.0:1788869367.706167:0:8343:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1788869367.706312:0:8343:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94c82c841500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:121cd5bc-7f07-4cf7-8e2e-4356c89c0696:8343:1875765421438336:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788869367.706370:0:8343:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869367.706388:0:8343:0:(client.c:2702:ptlrpc_set_wait()) set ffff94c803170000 going to sleep for 11 seconds 00000100:00100000:3.0:1788869367.707780:0:5749:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765421438336 00000100:00100000:3.0:1788869367.707798:0:5749:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765421438336 00000100:00100000:3.0:1788869367.709079:0:5749:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:3.0:1788869367.709099:0:5749:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c81f0ff050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:121cd5bc-7f07-4cf7-8e2e-4356c89c0696+15:8343:x1875765421438336:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788869367.711614:0:5749:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c81f0ff050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:121cd5bc-7f07-4cf7-8e2e-4356c89c0696+15:8343:x1875765421438336:12345-0@lo:502:llog_process_th.0 Request processed in 2510us (5231us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869367.711633:0:5749:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000100:00100000:3.0:1788869367.714415:0:8343:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94c82c841500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:121cd5bc-7f07-4cf7-8e2e-4356c89c0696:8343:1875765421438336:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788869367.714479:0:8343:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788869367.714489:0:8343:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788869367.714492:0:8343:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:3.0:1788869367.714499:0:8343:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:3.0:1788869367.714593:0:5752:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:3.0:1788869367.714616:0:5752:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.139@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788869367.714629:0:5752:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.139@tcp lock: ffff94c800030400/0x3d2d1916761d646d lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x3d2d1916761d6474 expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869367.714643:0:5752:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.139@tcp lock: ffff94c800030400/0x3d2d1916761d646d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x3d2d1916761d6474 expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788869367.714654:0:5752:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1788869367.714656:0:5752:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff94c805125000 from 39 10000000:01000000:3.0:1788869367.714659:0:5752:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1788869367.714704:0:5752:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.139@tcp lock: ffff94c83504da00/0x3d2d1916761d647b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869367.714713:0:5752:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.139@tcp lock: ffff94c83504da00/0x3d2d1916761d647b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869367.714724:0:5752:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.139@tcp lock: ffff94c83504da00/0x3d2d1916761d647b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788869367.714751:0:5752:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94c82065f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:121cd5bc-7f07-4cf7-8e2e-4356c89c0696:5752:1875765421438464:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788869367.714834:0:5752:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869367.714886:0:5752:0:(client.c:2702:ptlrpc_set_wait()) set ffff94c835537c00 going to sleep for 11 seconds 00000100:00100000:2.0:1788869367.718222:0:5748:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765421438464 00000100:00100000:2.0:1788869367.718244:0:5748:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765421438464 00000100:00100000:2.0:1788869367.718492:0:5748:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:2.0:1788869367.718504:0:5748:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c81f0fc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:121cd5bc-7f07-4cf7-8e2e-4356c89c0696+15:5752:x1875765421438464:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788869367.718528:0:5748:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788869367.718563:0:5748:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff94c80153a800/0x3d2d1916761d6482 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x3d2d1916761d647b expref: -99 pid: 5748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869367.718601:0:5748:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff94c80153a800/0x3d2d1916761d6482 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3d2d1916761d647b expref: 16 pid: 5748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869367.718614:0:5748:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff94c80153a800/0x3d2d1916761d6482 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3d2d1916761d647b expref: 16 pid: 5748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869367.718641:0:5748:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94c80153a800, rc 0) 00000100:00100000:2.0:1788869367.718789:0:5748:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c81f0fc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:121cd5bc-7f07-4cf7-8e2e-4356c89c0696+16:5752:x1875765421438464:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 287us (3954us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869367.718798:0:5748:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000100:00100000:0.0:1788869367.722603:0:5752:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94c82065f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:121cd5bc-7f07-4cf7-8e2e-4356c89c0696:5752:1875765421438464:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788869367.722653:0:5752:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.139@tcp lock: ffff94c83504da00/0x3d2d1916761d647b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x3d2d1916761d6482 expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869367.722670:0:5752:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.139@tcp lock: ffff94c83504da00/0x3d2d1916761d647b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x3d2d1916761d6482 expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788869367.722774:0:5752:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94c82cdc5180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:121cd5bc-7f07-4cf7-8e2e-4356c89c0696:5752:1875765421438592:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788869367.722854:0:5752:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869367.722910:0:5752:0:(client.c:2702:ptlrpc_set_wait()) set ffff94c805068000 going to sleep for 11 seconds 00000100:00100000:3.0:1788869367.723079:0:5749:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765421438592 00000100:00100000:3.0:1788869367.723087:0:5749:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765421438592 00000100:00100000:3.0:1788869367.723155:0:5749:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 169 00000100:00100000:3.0:1788869367.723175:0:5749:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c81f0fd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:121cd5bc-7f07-4cf7-8e2e-4356c89c0696+16:5752:x1875765421438592:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788869367.723517:0:5749:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c81f0fd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:121cd5bc-7f07-4cf7-8e2e-4356c89c0696+16:5752:x1875765421438592:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 344us (662us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869367.723527:0:5749:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 169 00000100:00100000:0.0:1788869367.723682:0:5752:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94c82cdc5180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:121cd5bc-7f07-4cf7-8e2e-4356c89c0696:5752:1875765421438592:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788869367.723717:0:5752:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94c82cdc5180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:121cd5bc-7f07-4cf7-8e2e-4356c89c0696:5752:1875765421438720:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788869367.723761:0:5752:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869367.723785:0:5752:0:(client.c:2702:ptlrpc_set_wait()) set ffff94c805068000 going to sleep for 11 seconds 00000100:00100000:3.0:1788869367.723841:0:5749:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765421438720 00000100:00100000:3.0:1788869367.723845:0:5749:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765421438720 00000100:00100000:3.0:1788869367.723874:0:5749:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 170 00000100:00100000:3.0:1788869367.723882:0:5749:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c81f0fc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:121cd5bc-7f07-4cf7-8e2e-4356c89c0696+16:5752:x1875765421438720:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788869367.724031:0:5749:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c81f0fc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:121cd5bc-7f07-4cf7-8e2e-4356c89c0696+16:5752:x1875765421438720:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 150us (270us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869367.724038:0:5749:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 170 00000100:00100000:0.0:1788869367.724121:0:5752:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94c82cdc5180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:121cd5bc-7f07-4cf7-8e2e-4356c89c0696:5752:1875765421438720:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788869367.724468:0:8346:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94c82065c700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:121cd5bc-7f07-4cf7-8e2e-4356c89c0696:8346:1875765421438848:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788869367.724508:0:8346:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869367.724594:0:8346:0:(client.c:2702:ptlrpc_set_wait()) set ffff94c835537c00 going to sleep for 11 seconds 00000100:00100000:2.0:1788869367.724692:0:5748:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765421438848 00000100:00100000:2.0:1788869367.724698:0:5748:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765421438848 00000100:00100000:2.0:1788869367.724729:0:5748:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 171 00000100:00100000:2.0:1788869367.724737:0:5748:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c81f0f9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:121cd5bc-7f07-4cf7-8e2e-4356c89c0696+16:8346:x1875765421438848:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788869367.724921:0:5748:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c81f0f9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:121cd5bc-7f07-4cf7-8e2e-4356c89c0696+16:8346:x1875765421438848:12345-0@lo:502:llog_process_th.0 Request processed in 184us (411us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869367.724928:0:5748:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 171 00000100:00100000:3.0:1788869367.725106:0:8346:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94c82065c700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:121cd5bc-7f07-4cf7-8e2e-4356c89c0696:8346:1875765421438848:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788869367.728060:0:8346:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94c82065c700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:121cd5bc-7f07-4cf7-8e2e-4356c89c0696:8346:1875765421438976:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788869367.728202:0:8346:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869367.728245:0:8346:0:(client.c:2702:ptlrpc_set_wait()) set ffff94c808968e40 going to sleep for 11 seconds 00000100:00100000:2.0:1788869367.728376:0:5748:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765421438976 00000100:00100000:2.0:1788869367.728385:0:5748:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765421438976 00000100:00100000:2.0:1788869367.732313:0:5748:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 172 00000100:00100000:2.0:1788869367.732342:0:5748:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c81f0fa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:121cd5bc-7f07-4cf7-8e2e-4356c89c0696+16:8346:x1875765421438976:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788869367.732761:0:5748:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c81f0fa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:121cd5bc-7f07-4cf7-8e2e-4356c89c0696+16:8346:x1875765421438976:12345-0@lo:502:llog_process_th.0 Request processed in 431us (4558us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869367.732772:0:5748:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 172 00000100:00100000:3.0:1788869367.733770:0:8346:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94c82065c700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:121cd5bc-7f07-4cf7-8e2e-4356c89c0696:8346:1875765421438976:0@lo:502:llog_process_th.0 00000040:00080000:3.0:1788869367.733823:0:8346:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:0.0:1788869367.734085:0:5752:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:0.0:1788869367.734110:0:5752:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.139@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1788869367.734122:0:5752:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.139@tcp lock: ffff94c83504da00/0x3d2d1916761d647b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x3d2d1916761d6482 expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869367.734134:0:5752:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.139@tcp lock: ffff94c83504da00/0x3d2d1916761d647b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x3d2d1916761d6482 expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788869367.734154:0:5752:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:0.0:1788869367.734157:0:5752:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 34 10000000:01000000:0.0:1788869367.734160:0:5752:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:0.0:1788869367.734199:0:5752:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.139@tcp lock: ffff94c818d1ea00/0x3d2d1916761d6489 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869367.734220:0:5752:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.139@tcp lock: ffff94c818d1ea00/0x3d2d1916761d6489 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869367.734229:0:5752:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.139@tcp lock: ffff94c818d1ea00/0x3d2d1916761d6489 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788869367.734272:0:5752:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94c82cdc5180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:121cd5bc-7f07-4cf7-8e2e-4356c89c0696:5752:1875765421439104:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788869367.734326:0:5752:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869367.734361:0:5752:0:(client.c:2702:ptlrpc_set_wait()) set ffff94c805068e40 going to sleep for 11 seconds 00000100:00100000:3.0:1788869367.737588:0:5750:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765421439104 00000100:00100000:3.0:1788869367.737606:0:5750:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765421439104 00000100:00100000:3.0:1788869367.737669:0:5750:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 173 00000100:00100000:3.0:1788869367.737680:0:5750:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c81f0fbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:121cd5bc-7f07-4cf7-8e2e-4356c89c0696+16:5752:x1875765421439104:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788869367.737709:0:5750:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788869367.737734:0:5750:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff94c83504de00/0x3d2d1916761d6490 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x3d2d1916761d6489 expref: -99 pid: 5750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869367.737772:0:5750:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff94c83504de00/0x3d2d1916761d6490 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3d2d1916761d6489 expref: 17 pid: 5750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869367.737782:0:5750:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff94c83504de00/0x3d2d1916761d6490 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3d2d1916761d6489 expref: 17 pid: 5750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869367.737790:0:5750:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94c83504de00, rc 0) 00000100:00100000:3.0:1788869367.737889:0:5750:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c81f0fbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:121cd5bc-7f07-4cf7-8e2e-4356c89c0696+17:5752:x1875765421439104:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 210us (3561us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869367.737897:0:5750:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 173 00000100:00100000:3.0:1788869367.737961:0:5752:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94c82cdc5180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:121cd5bc-7f07-4cf7-8e2e-4356c89c0696:5752:1875765421439104:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788869367.737979:0:5752:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.139@tcp lock: ffff94c818d1ea00/0x3d2d1916761d6489 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x3d2d1916761d6490 expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869367.737990:0:5752:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.139@tcp lock: ffff94c818d1ea00/0x3d2d1916761d6489 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x3d2d1916761d6490 expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788869367.738074:0:5752:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94c82065c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:121cd5bc-7f07-4cf7-8e2e-4356c89c0696:5752:1875765421439232:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788869367.738108:0:5752:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869367.738152:0:5752:0:(client.c:2702:ptlrpc_set_wait()) set ffff94c808968e40 going to sleep for 11 seconds 00000100:00100000:3.0:1788869367.738165:0:5750:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765421439232 00000100:00100000:3.0:1788869367.738168:0:5750:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765421439232 00000100:00100000:3.0:1788869367.738182:0:5750:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 174 00000100:00100000:3.0:1788869367.738186:0:5750:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c81f0fa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:121cd5bc-7f07-4cf7-8e2e-4356c89c0696+17:5752:x1875765421439232:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788869367.738508:0:5750:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c81f0fa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:121cd5bc-7f07-4cf7-8e2e-4356c89c0696+17:5752:x1875765421439232:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 319us (397us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869367.738516:0:5750:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 174 00000100:00100000:3.0:1788869367.738549:0:5752:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94c82065c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:121cd5bc-7f07-4cf7-8e2e-4356c89c0696:5752:1875765421439232:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788869367.738580:0:5752:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94c82065c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:121cd5bc-7f07-4cf7-8e2e-4356c89c0696:5752:1875765421439360:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788869367.738622:0:5752:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869367.738637:0:5752:0:(client.c:2702:ptlrpc_set_wait()) set ffff94c83652a000 going to sleep for 11 seconds 00000100:00100000:3.0:1788869367.738648:0:5750:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765421439360 00000100:00100000:3.0:1788869367.738652:0:5750:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765421439360 00000100:00100000:3.0:1788869367.738668:0:5750:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 175 00000100:00100000:3.0:1788869367.738673:0:5750:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c81f0fac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:121cd5bc-7f07-4cf7-8e2e-4356c89c0696+17:5752:x1875765421439360:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788869367.738824:0:5750:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c81f0fac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:121cd5bc-7f07-4cf7-8e2e-4356c89c0696+17:5752:x1875765421439360:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 150us (202us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869367.738831:0:5750:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 175 00000100:00100000:3.0:1788869367.738865:0:5752:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94c82065c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:121cd5bc-7f07-4cf7-8e2e-4356c89c0696:5752:1875765421439360:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788869367.741731:0:8347:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94c82cdc4e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:121cd5bc-7f07-4cf7-8e2e-4356c89c0696:8347:1875765421439488:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788869367.741823:0:8347:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869367.741870:0:8347:0:(client.c:2702:ptlrpc_set_wait()) set ffff94c805068300 going to sleep for 11 seconds 00000100:00100000:3.0:1788869367.744350:0:5750:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765421439488 00000100:00100000:3.0:1788869367.744365:0:5750:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765421439488 00000100:00100000:3.0:1788869367.744437:0:5750:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 176 00000100:00100000:3.0:1788869367.744448:0:5750:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c81f0fb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:121cd5bc-7f07-4cf7-8e2e-4356c89c0696+17:8347:x1875765421439488:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788869367.744801:0:5750:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c81f0fb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:121cd5bc-7f07-4cf7-8e2e-4356c89c0696+17:8347:x1875765421439488:12345-0@lo:502:llog_process_th.0 Request processed in 355us (2977us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869367.744810:0:5750:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 176 00000100:00100000:2.0:1788869367.745650:0:8347:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94c82cdc4e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:121cd5bc-7f07-4cf7-8e2e-4356c89c0696:8347:1875765421439488:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788869367.745698:0:8347:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788869367.745710:0:8347:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788869367.745713:0:8347:0:(obd_config.c:1561:class_process_config()) marker 25 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1788869367.745719:0:8347:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000100:00100000:2.0:1788869367.745763:0:8347:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94c82c843100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:121cd5bc-7f07-4cf7-8e2e-4356c89c0696:8347:1875765421439616:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788869367.745820:0:8347:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869367.745869:0:8347:0:(client.c:2702:ptlrpc_set_wait()) set ffff94c803170780 going to sleep for 11 seconds 00000100:00100000:3.0:1788869367.745963:0:5748:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765421439616 00000100:00100000:3.0:1788869367.745979:0:5748:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765421439616 00000100:00100000:3.0:1788869367.746029:0:5748:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 177 00000100:00100000:3.0:1788869367.746044:0:5748:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c81f0fb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:121cd5bc-7f07-4cf7-8e2e-4356c89c0696+17:8347:x1875765421439616:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788869367.746277:0:5748:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c81f0fb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:121cd5bc-7f07-4cf7-8e2e-4356c89c0696+17:8347:x1875765421439616:12345-0@lo:502:llog_process_th.0 Request processed in 234us (457us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869367.746286:0:5748:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 177 00000100:00100000:0.0:1788869367.746475:0:8347:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94c82c843100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:121cd5bc-7f07-4cf7-8e2e-4356c89c0696:8347:1875765421439616:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788869367.746497:0:8347:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788869367.746503:0:8347:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788869367.746505:0:8347:0:(obd_config.c:1561:class_process_config()) marker 25 (0x2) lustre sys.jobid_var 00000040:00080000:0.0:1788869367.746510:0:8347:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 37 count 37 00000020:01000000:3.0:1788869367.747085:0:5752:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 34-36 (rc=0) 10000000:01000000:3.0:1788869367.747109:0:5752:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.139@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:3.0:1788869367.747121:0:5752:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.139@tcp lock: ffff94c818d1ea00/0x3d2d1916761d6489 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x3d2d1916761d6490 expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869367.747134:0:5752:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.139@tcp lock: ffff94c818d1ea00/0x3d2d1916761d6489 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x3d2d1916761d6490 expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788869367.747156:0:5752:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1788869367.747160:0:5752:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff94c805125000 from 4 10000000:01000000:3.0:1788869367.747163:0:5752:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788869367.747199:0:5752:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.139@tcp lock: ffff94c83504d600/0x3d2d1916761d6497 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869367.747209:0:5752:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.139@tcp lock: ffff94c83504d600/0x3d2d1916761d6497 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869367.747220:0:5752:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.139@tcp lock: ffff94c83504d600/0x3d2d1916761d6497 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788869367.747241:0:5752:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94c82065c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:121cd5bc-7f07-4cf7-8e2e-4356c89c0696:5752:1875765421439744:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788869367.747316:0:5752:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869367.747353:0:5752:0:(client.c:2702:ptlrpc_set_wait()) set ffff94c808968e40 going to sleep for 11 seconds 00000100:00100000:1.0:1788869367.748717:0:5749:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765421439744 00000100:00100000:1.0:1788869367.748735:0:5749:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765421439744 00000100:00100000:1.0:1788869367.748798:0:5749:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 178 00000100:00100000:1.0:1788869367.748810:0:5749:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c81f0f9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:121cd5bc-7f07-4cf7-8e2e-4356c89c0696+17:5752:x1875765421439744:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788869367.748829:0:5749:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788869367.748850:0:5749:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff94c8421f3c00/0x3d2d1916761d649e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x3d2d1916761d6497 expref: -99 pid: 5749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869367.748882:0:5749:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff94c8421f3c00/0x3d2d1916761d649e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3d2d1916761d6497 expref: 18 pid: 5749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869367.749356:0:5749:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff94c8421f3c00/0x3d2d1916761d649e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3d2d1916761d6497 expref: 18 pid: 5749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869367.749367:0:5749:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94c8421f3c00, rc 0) 00000100:00100000:1.0:1788869367.749580:0:5749:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c81f0f9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:121cd5bc-7f07-4cf7-8e2e-4356c89c0696+18:5752:x1875765421439744:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 771us (2262us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869367.749590:0:5749:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 178 00000100:00100000:2.0:1788869367.758527:0:5752:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94c82065c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:121cd5bc-7f07-4cf7-8e2e-4356c89c0696:5752:1875765421439744:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788869367.758569:0:5752:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.139@tcp lock: ffff94c83504d600/0x3d2d1916761d6497 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x3d2d1916761d649e expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869367.758586:0:5752:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.139@tcp lock: ffff94c83504d600/0x3d2d1916761d6497 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x3d2d1916761d649e expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788869367.758732:0:5752:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94c82c840700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:121cd5bc-7f07-4cf7-8e2e-4356c89c0696:5752:1875765421439872:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788869367.758813:0:5752:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869367.758875:0:5752:0:(client.c:2702:ptlrpc_set_wait()) set ffff94c803170180 going to sleep for 11 seconds 00000100:00100000:3.0:1788869367.758977:0:5750:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765421439872 00000100:00100000:3.0:1788869367.758996:0:5750:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765421439872 00000100:00100000:3.0:1788869367.759066:0:5750:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 179 00000100:00100000:3.0:1788869367.759077:0:5750:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c81f0fa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:121cd5bc-7f07-4cf7-8e2e-4356c89c0696+18:5752:x1875765421439872:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788869367.759635:0:5750:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c81f0fa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:121cd5bc-7f07-4cf7-8e2e-4356c89c0696+18:5752:x1875765421439872:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 558us (820us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869367.759645:0:5750:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 179 00000100:00100000:2.0:1788869367.759776:0:5752:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94c82c840700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:121cd5bc-7f07-4cf7-8e2e-4356c89c0696:5752:1875765421439872:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788869367.759809:0:5752:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94c82c840700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:121cd5bc-7f07-4cf7-8e2e-4356c89c0696:5752:1875765421440000:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788869367.759849:0:5752:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869367.759873:0:5752:0:(client.c:2702:ptlrpc_set_wait()) set ffff94c803170180 going to sleep for 11 seconds 00000100:00100000:2.0:1788869367.759889:0:5748:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765421440000 00000100:00100000:2.0:1788869367.759893:0:5748:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765421440000 00000100:00100000:2.0:1788869367.759920:0:5748:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 180 00000100:00100000:2.0:1788869367.759927:0:5748:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c81f0f8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:121cd5bc-7f07-4cf7-8e2e-4356c89c0696+18:5752:x1875765421440000:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788869367.760096:0:5748:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c81f0f8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:121cd5bc-7f07-4cf7-8e2e-4356c89c0696+18:5752:x1875765421440000:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 169us (246us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869367.760104:0:5748:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 180 00000100:00100000:2.0:1788869367.760149:0:5752:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94c82c840700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:121cd5bc-7f07-4cf7-8e2e-4356c89c0696:5752:1875765421440000:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788869367.760804:0:8349:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94c82c840700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:121cd5bc-7f07-4cf7-8e2e-4356c89c0696:8349:1875765421440128:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788869367.760848:0:8349:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869367.760880:0:8349:0:(client.c:2702:ptlrpc_set_wait()) set ffff94c803170480 going to sleep for 11 seconds 00000100:00100000:3.0:1788869367.760921:0:5748:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765421440128 00000100:00100000:3.0:1788869367.760927:0:5748:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765421440128 00000100:00100000:3.0:1788869367.760961:0:5748:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 181 00000100:00100000:3.0:1788869367.760969:0:5748:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c81f0fb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:121cd5bc-7f07-4cf7-8e2e-4356c89c0696+18:8349:x1875765421440128:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788869367.761156:0:5748:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c81f0fb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:121cd5bc-7f07-4cf7-8e2e-4356c89c0696+18:8349:x1875765421440128:12345-0@lo:502:llog_process_th.0 Request processed in 188us (307us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869367.761164:0:5748:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 181 00000100:00100000:0.0:1788869367.761348:0:8349:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94c82c840700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:121cd5bc-7f07-4cf7-8e2e-4356c89c0696:8349:1875765421440128:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788869367.761375:0:8349:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788869367.761386:0:8349:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788869367.761389:0:8349:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1788869367.761398:0:8349:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff94c805125000 00000020:00000080:0.0:1788869367.761401:0:8349:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1788869367.761494:0:8349:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94c82cdc5f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:121cd5bc-7f07-4cf7-8e2e-4356c89c0696:8349:1875765421440256:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788869367.761550:0:8349:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869367.761566:0:8349:0:(client.c:2702:ptlrpc_set_wait()) set ffff94c805068240 going to sleep for 11 seconds 00000100:00100000:2.0:1788869367.762743:0:5749:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765421440256 00000100:00100000:2.0:1788869367.762753:0:5749:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765421440256 00000100:00100000:2.0:1788869367.762806:0:5749:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 182 00000100:00100000:2.0:1788869367.762815:0:5749:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c81f0f8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:121cd5bc-7f07-4cf7-8e2e-4356c89c0696+18:8349:x1875765421440256:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788869367.763103:0:5749:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c81f0f8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:121cd5bc-7f07-4cf7-8e2e-4356c89c0696+18:8349:x1875765421440256:12345-0@lo:502:llog_process_th.0 Request processed in 289us (1552us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869367.763113:0:5749:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 182 00000100:00100000:0.0:1788869367.763272:0:8349:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94c82cdc5f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:121cd5bc-7f07-4cf7-8e2e-4356c89c0696:8349:1875765421440256:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788869367.763307:0:8349:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788869367.763315:0:8349:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788869367.763317:0:8349:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:0.0:1788869367.763323:0:8349:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:2.0:1788869367.763607:0:5752:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:2.0:1788869367.763630:0:5752:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.139@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788869367.763643:0:5752:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.139@tcp lock: ffff94c83504d600/0x3d2d1916761d6497 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x3d2d1916761d649e expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869367.763657:0:5752:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.139@tcp lock: ffff94c83504d600/0x3d2d1916761d6497 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x3d2d1916761d649e expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788869367.763668:0:5752:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:2.0:1788869367.763671:0:5752:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-sptlrpc-ffff94c81f1a99c0 from 1 10000000:01000000:2.0:1788869367.763675:0:5752:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1788869367.763712:0:5752:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.139@tcp lock: ffff94c80153bc00/0x3d2d1916761d64a5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869367.763722:0:5752:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.139@tcp lock: ffff94c80153bc00/0x3d2d1916761d64a5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869367.763733:0:5752:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.139@tcp lock: ffff94c80153bc00/0x3d2d1916761d64a5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788869367.763754:0:5752:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94c82c841180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:121cd5bc-7f07-4cf7-8e2e-4356c89c0696:5752:1875765421440384:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788869367.763793:0:5752:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869367.765232:0:5752:0:(client.c:2702:ptlrpc_set_wait()) set ffff94c803170cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788869367.765839:0:5749:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765421440384 00000100:00100000:0.0:1788869367.765853:0:5749:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765421440384 00000100:00100000:0.0:1788869367.765917:0:5749:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 183 00000100:00100000:0.0:1788869367.765928:0:5749:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c81f0f9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:121cd5bc-7f07-4cf7-8e2e-4356c89c0696+18:5752:x1875765421440384:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788869367.765947:0:5749:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788869367.765969:0:5749:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff94c818d1f800/0x3d2d1916761d64ac lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x3d2d1916761d64a5 expref: -99 pid: 5749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869367.766015:0:5749:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff94c818d1f800/0x3d2d1916761d64ac lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3d2d1916761d64a5 expref: 19 pid: 5749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869367.766029:0:5749:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff94c818d1f800/0x3d2d1916761d64ac lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3d2d1916761d64a5 expref: 19 pid: 5749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869367.766041:0:5749:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94c818d1f800, rc 0) 00000100:00100000:0.0:1788869367.766117:0:5749:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c81f0f9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:121cd5bc-7f07-4cf7-8e2e-4356c89c0696+19:5752:x1875765421440384:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 192us (2322us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869367.766126:0:5749:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 183 00000100:00100000:2.0:1788869367.766731:0:5752:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94c82c841180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:121cd5bc-7f07-4cf7-8e2e-4356c89c0696:5752:1875765421440384:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788869367.766754:0:5752:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.139@tcp lock: ffff94c80153bc00/0x3d2d1916761d64a5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x3d2d1916761d64ac expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869367.766766:0:5752:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.139@tcp lock: ffff94c80153bc00/0x3d2d1916761d64a5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x3d2d1916761d64ac expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788869367.766855:0:5752:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94c82c841180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:121cd5bc-7f07-4cf7-8e2e-4356c89c0696:5752:1875765421440512:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788869367.766896:0:5752:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869367.766929:0:5752:0:(client.c:2702:ptlrpc_set_wait()) set ffff94c803170cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788869367.766943:0:5749:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765421440512 00000100:00100000:2.0:1788869367.766948:0:5749:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765421440512 00000100:00100000:2.0:1788869367.766993:0:5749:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 184 00000100:00100000:2.0:1788869367.767001:0:5749:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c81f0f8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:121cd5bc-7f07-4cf7-8e2e-4356c89c0696+19:5752:x1875765421440512:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788869367.767316:0:5749:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c81f0f8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:121cd5bc-7f07-4cf7-8e2e-4356c89c0696+19:5752:x1875765421440512:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 315us (418us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788869367.767325:0:5749:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 184 00000100:00100000:2.0:1788869367.767359:0:5752:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94c82c841180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:121cd5bc-7f07-4cf7-8e2e-4356c89c0696:5752:1875765421440512:0@lo:501:ll_cfg_requeue.0 10000000:01000000:2.0:1788869367.767385:0:5752:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.139@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:2.0:1788869367.767393:0:5752:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.139@tcp lock: ffff94c80153bc00/0x3d2d1916761d64a5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x3d2d1916761d64ac expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869367.767403:0:5752:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.139@tcp lock: ffff94c80153bc00/0x3d2d1916761d64a5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x3d2d1916761d64ac expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869368.219472:0:7447:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788869368.757466:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1788869368.757526:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1788869368.757570:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765413025792 00000100:00100000:1.0:1788869368.757584:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765413025792 00000100:00100000:1.0:1788869368.757686:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 17 00000100:00100000:1.0:1788869368.757698:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c803fbb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2125b9b3-626e-4cbe-be83-fb446e976ce2+6:2345:x1875765413025792:12345-192.168.201.39@tcp:400:kworker.0 00000100:00100000:1.0:1788869368.757793:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c803fbb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2125b9b3-626e-4cbe-be83-fb446e976ce2+6:2345:x1875765413025792:12345-192.168.201.39@tcp:400:kworker.0 Request processed in 97us (265us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869368.757802:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 17 00000100:00080000:1.0:1788869368.757824:0:5751:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788869368.758410:0:5749:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765413025664 00000100:00100000:3.0:1788869368.758417:0:5749:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765413025664 00000100:00100000:3.0:1788869368.758462:0:5749:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 185 00000100:00100000:3.0:1788869368.758470:0:5749:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c81f0f9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3cca3acf-4935-4d0d-9982-d5d931f1c86b+10:2345:x1875765413025664:12345-192.168.201.39@tcp:400:kworker.0 00000100:00100000:3.0:1788869368.758522:0:5749:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c81f0f9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3cca3acf-4935-4d0d-9982-d5d931f1c86b+10:2345:x1875765413025664:12345-192.168.201.39@tcp:400:kworker.0 Request processed in 53us (1071us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869368.758529:0:5749:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 185 00000100:00100000:0.0:1788869368.782801:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1788869368.782850:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1788869368.783057:0:6544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765413026048 00000100:00100000:3.0:1788869368.783070:0:6544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765413026048 00000100:00100000:3.0:1788869368.783164:0:6544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765413025920 00000100:00100000:3.0:1788869368.783168:0:6544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765413025920 00000100:00100000:3.0:1788869368.783196:0:6544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 7 00000100:00100000:3.0:1788869368.783207:0:6544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c82cdc5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2125b9b3-626e-4cbe-be83-fb446e976ce2+5:2346:x1875765413026048:12345-192.168.201.39@tcp:400:kworker.0 00000100:00100000:3.0:1788869368.783454:0:6544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c82cdc5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2125b9b3-626e-4cbe-be83-fb446e976ce2+5:2346:x1875765413026048:12345-192.168.201.39@tcp:400:kworker.0 Request processed in 248us (667us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869368.783468:0:6544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 7 00000100:00080000:0.0:1788869368.784070:0:5751:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788869368.784077:0:5751:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788869368.784190:0:6544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 8 00000100:00100000:3.0:1788869368.784210:0:6544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c82cdc5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2125b9b3-626e-4cbe-be83-fb446e976ce2+5:2346:x1875765413025920:12345-192.168.201.39@tcp:400:kworker.0 00000100:00100000:3.0:1788869368.784277:0:6544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c82cdc5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2125b9b3-626e-4cbe-be83-fb446e976ce2+5:2346:x1875765413025920:12345-192.168.201.39@tcp:400:kworker.0 Request processed in 74us (1425us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869368.791166:0:6544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 8 00010000:00010000:0.0:1788869369.243972:0:5742:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788869369.952435:0:3285:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94c82c841180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:121cd5bc-7f07-4cf7-8e2e-4356c89c0696:3285:1875765421440768:0@lo:400:kworker.0 00000100:00100000:2.0:1788869369.952468:0:3283:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94c82c841f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3283:1875765421441024:0@lo:400:kworker.0 00000100:00100000:1.0:1788869369.952521:0:3286:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94c82c840e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3286:1875765421440896:0@lo:400:kworker.0 00000100:00100000:0.0:1788869369.952610:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869369.952672:0:3285:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94c803fbb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3285:1875765421440640:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788869369.952703:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869369.952737:0:3285:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94c82c842a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3285:1875765421441280:0@lo:400:kworker.0 00000100:00100000:0.0:1788869369.952765:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869369.952806:0:5750:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765421440768 00000100:00100000:0.0:1788869369.952815:0:5750:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765421440768 00000100:00100000:0.0:1788869369.952875:0:5750:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 186 00000100:00100000:0.0:1788869369.952886:0:5750:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c81f0f8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:121cd5bc-7f07-4cf7-8e2e-4356c89c0696+19:3285:x1875765421440768:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788869369.952947:0:5750:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c81f0f8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:121cd5bc-7f07-4cf7-8e2e-4356c89c0696+19:3285:x1875765421440768:12345-0@lo:400:kworker.0 Request processed in 62us (337us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869369.952956:0:5750:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 186 00000100:00100000:0.0:1788869369.953017:0:3285:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94c82c841180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:121cd5bc-7f07-4cf7-8e2e-4356c89c0696:3285:1875765421440768:0@lo:400:kworker.0 00000100:00100000:2.0:1788869369.954471:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869369.954529:0:3283:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788869369.954541:0:3283:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94c82c842680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3283:1875765421441152:0@lo:400:kworker.0 00000100:00100000:2.0:1788869369.954578:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869369.954632:0:7884:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765421441152 00000100:00100000:2.0:1788869369.954639:0:7884:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765421441152 00000100:00100000:2.0:1788869369.954698:0:7884:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788869369.954709:0:7884:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c82c842300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3283:x1875765421441152:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788869369.954760:0:7884:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c82c842300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3283:x1875765421441152:12345-0@lo:400:kworker.0 Request processed in 53us (179us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869369.954767:0:7884:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00010000:00080000:2.0:1788869369.954812:0:3283:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff94c82c842680 x1875765421441152/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788869385 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788869369.954828:0:3283:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94c82c842680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3283:1875765421441152:0@lo:400:kworker.0 00000100:00100000:2.0:1788869369.956354:0:6548:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765421440640 00000100:00100000:2.0:1788869369.956369:0:6548:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765421440640 00000100:00100000:2.0:1788869369.956432:0:6548:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788869369.956438:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869369.956442:0:6548:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c82cdc4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3285:x1875765421440640:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788869369.956475:0:3286:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94c82c840a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3286:1875765421441408:0@lo:400:kworker.0 00002000:00000024:2.0:1788869369.956486:0:6548:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788869369.956505:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869369.956535:0:6548:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c82cdc4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3285:x1875765421440640:12345-0@lo:13:osp-pre-1-0.0 Request processed in 95us (3831us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869369.956543:0:6548:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788869369.956543:0:5755:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765421441280 00000100:00100000:1.0:1788869369.956547:0:5755:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765421441280 00000100:00100000:1.0:1788869369.956577:0:5755:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765421441024 00000100:00100000:2.0:1788869369.956580:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765421440896 00000100:00100000:1.0:1788869369.956581:0:5755:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765421441024 00000100:00100000:2.0:1788869369.956583:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765421440896 00000100:00100000:1.0:1788869369.956596:0:5755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1788869369.956903:0:5755:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c82cdc5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3285:x1875765421441280:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788869369.956944:0:5755:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c82cdc5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3285:x1875765421441280:12345-0@lo:400:kworker.0 Request processed in 43us (4178us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869369.958084:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1788869369.958114:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c82c843800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3283:x1875765421441024:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788869369.958140:0:5756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1788869369.958153:0:5756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c803fb9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3286:x1875765421440896:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788869369.958205:0:5756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c803fb9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3286:x1875765421440896:12345-0@lo:400:kworker.0 Request processed in 56us (1766us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869369.958213:0:5756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00080000:0.0:1788869369.958273:0:5751:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788869369.958280:0:5751:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788869369.958284:0:5751:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788869369.958351:0:3285:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94c82c842a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3285:1875765421441280:0@lo:400:kworker.0 00010000:00080000:0.0:1788869369.958371:0:3285:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff94c803fbb480 x1875765421440640/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788869385 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788869369.958392:0:3285:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94c803fbb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3285:1875765421440640:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788869369.958621:0:5755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1788869369.958653:0:6547:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765421441408 00000100:00100000:1.0:1788869369.958660:0:6547:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765421441408 00000100:00100000:1.0:1788869369.958741:0:6547:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788869369.958749:0:6547:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c803fb8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3286:x1875765421441408:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788869369.958790:0:6547:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c803fb8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3286:x1875765421441408:12345-0@lo:400:kworker.0 Request processed in 42us (2283us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869369.958797:0:6547:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788869369.958887:0:3286:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94c82c840e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3286:1875765421440896:0@lo:400:kworker.0 00010000:00080000:1.0:1788869369.958902:0:3286:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff94c82c840a80 x1875765421441408/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788869385 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788869369.958912:0:3286:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94c82c840a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3286:1875765421441408:0@lo:400:kworker.0 00000100:00100000:2.0:1788869369.959046:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c82c843800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3283:x1875765421441024:12345-0@lo:400:kworker.0 Request processed in 950us (4582us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869369.959054:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1788869369.959111:0:3283:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94c82c841f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3283:1875765421441024:0@lo:400:kworker.0 00010000:00010000:0.0:1788869370.267507:0:5743:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788869371.294353:0:7447:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788869371.995409:0:3284:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788869371.995442:0:3284:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94c803fbb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3284:1875765421441536:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788869371.995534:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869371.995629:0:6548:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765421441536 00000100:00100000:1.0:1788869371.995638:0:6548:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765421441536 00000100:00100000:1.0:1788869371.995713:0:6548:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788869371.995724:0:6548:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c803fb8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3284:x1875765421441536:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788869371.995768:0:6548:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788869371.995822:0:6548:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c803fb8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3284:x1875765421441536:12345-0@lo:13:osp-pre-0-0.0 Request processed in 99us (288us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869371.995841:0:6548:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00080000:1.0:1788869371.996107:0:5751:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1788869371.996148:0:3284:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff94c803fbb480 x1875765421441536/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788869387 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788869371.996170:0:3284:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94c803fbb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3284:1875765421441536:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1788869372.318245:0:5742:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1788869373.092062:0:8615:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg139-server.virtnet: executing check_logdir /tmp/testlogs/ 00010000:00010000:0.0:1788869373.339627:0:5743:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788869373.881056:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1788869373.881096:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1788869373.881125:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1788869373.881148:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1788869373.881172:0:7884:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765413026560 00000100:00100000:0.0:1788869373.881172:0:5756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765413026304 00000100:00100000:2.0:1788869373.881180:0:7884:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765413026560 00000100:00100000:0.0:1788869373.881180:0:5756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765413026304 00000100:00100000:2.0:1788869373.881230:0:7884:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765413026432 00000100:00100000:2.0:1788869373.881233:0:7884:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765413026432 00000100:00100000:1.0:1788869373.885819:0:5748:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765413026176 00000100:00100000:1.0:1788869373.885835:0:5748:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765413026176 00000100:00100000:1.0:1788869373.885918:0:5748:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 187 00000100:00100000:1.0:1788869373.885929:0:5748:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c8061d9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3cca3acf-4935-4d0d-9982-d5d931f1c86b+10:2347:x1875765413026176:12345-192.168.201.39@tcp:400:kworker.0 00000100:00100000:1.0:1788869373.886833:0:5748:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c8061d9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3cca3acf-4935-4d0d-9982-d5d931f1c86b+10:2347:x1875765413026176:12345-192.168.201.39@tcp:400:kworker.0 Request processed in 903us (5703us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869373.886842:0:5748:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 187 00000100:00100000:0.0:1788869373.888551:0:5756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 21 00000100:00100000:0.0:1788869373.888566:0:5756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c82cdc4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2125b9b3-626e-4cbe-be83-fb446e976ce2+6:2347:x1875765413026304:12345-192.168.201.39@tcp:400:kworker.0 00000100:00100000:0.0:1788869373.888615:0:5756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c82cdc4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2125b9b3-626e-4cbe-be83-fb446e976ce2+6:2347:x1875765413026304:12345-192.168.201.39@tcp:400:kworker.0 Request processed in 54us (7567us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869373.888623:0:5756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 21 00000100:00100000:2.0:1788869373.892766:0:7884:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 11 00000100:00100000:2.0:1788869373.892781:0:7884:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c82cdc6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:2125b9b3-626e-4cbe-be83-fb446e976ce2+5:2347:x1875765413026560:12345-192.168.201.39@tcp:400:kworker.0 00000100:00100000:2.0:1788869373.892861:0:7884:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c82cdc6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:2125b9b3-626e-4cbe-be83-fb446e976ce2+5:2347:x1875765413026560:12345-192.168.201.39@tcp:400:kworker.0 Request processed in 84us (11763us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869373.892869:0:7884:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 11 00000100:00100000:2.0:1788869373.892884:0:7884:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 12 00000100:00100000:2.0:1788869373.892891:0:7884:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c82cdc7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:2125b9b3-626e-4cbe-be83-fb446e976ce2+5:2347:x1875765413026432:12345-192.168.201.39@tcp:400:kworker.0 00000100:00100000:2.0:1788869373.892916:0:7884:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c82cdc7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:2125b9b3-626e-4cbe-be83-fb446e976ce2+5:2347:x1875765413026432:12345-192.168.201.39@tcp:400:kworker.0 Request processed in 26us (11767us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869373.892922:0:7884:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 12 00000100:00080000:1.0:1788869373.898376:0:5751:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788869373.898388:0:5751:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788869373.898391:0:5751:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:2.0:1788869374.365525:0:7447:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788869375.068459:0:3286:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94c82d043100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3286:1875765421441920:0@lo:400:kworker.0 00000100:00100000:1.0:1788869375.068548:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869375.068618:0:3286:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1788869375.068623:0:3286:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94c803fb8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3286:1875765421441792:0@lo:400:kworker.0 00000100:00100000:1.0:1788869375.068643:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869375.068657:0:3286:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94c81f1f0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3286:1875765421442304:0@lo:400:kworker.0 00000100:00100000:1.0:1788869375.068704:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869375.068747:0:5757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765421441920 00000100:00100000:1.0:1788869375.068756:0:5757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765421441920 00000100:00100000:1.0:1788869375.068819:0:5757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765421441792 00000100:00100000:1.0:1788869375.068822:0:5757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765421441792 00000100:00100000:1.0:1788869375.068840:0:5757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1788869375.068848:0:5757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c81f1f3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3286:x1875765421441920:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788869375.068903:0:5757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c81f1f3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3286:x1875765421441920:12345-0@lo:400:kworker.0 Request processed in 55us (354us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869375.068910:0:5757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1788869375.068928:0:5757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1788869375.068934:0:5757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c81f1f0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3286:x1875765421441792:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788869375.068957:0:5757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c81f1f0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3286:x1875765421441792:12345-0@lo:400:kworker.0 Request processed in 23us (313us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869375.068962:0:5757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00080000:1.0:1788869375.068976:0:5751:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788869375.069005:0:3286:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94c803fb8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3286:1875765421441792:0@lo:400:kworker.0 00000100:00100000:1.0:1788869375.069044:0:3286:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94c82d043100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3286:1875765421441920:0@lo:400:kworker.0 00000100:00100000:0.0:1788869375.069141:0:3283:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94c82d043480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3283:1875765421442048:0@lo:400:kworker.0 00000100:00100000:0.0:1788869375.069173:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869375.069195:0:3283:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1788869375.069200:0:3283:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94c803fbb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:121cd5bc-7f07-4cf7-8e2e-4356c89c0696:3283:1875765421441664:0@lo:400:kworker.0 00000100:00100000:0.0:1788869375.069224:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869375.069242:0:3283:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94c82d042680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3283:1875765421442176:0@lo:400:kworker.0 00000100:00100000:0.0:1788869375.069282:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869375.069310:0:5756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765421442176 00000100:00100000:0.0:1788869375.069313:0:5756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765421442176 00000100:00100000:0.0:1788869375.069341:0:5756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1788869375.069346:0:5756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c82cdc7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3283:x1875765421442176:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788869375.069377:0:5756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c82cdc7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3283:x1875765421442176:12345-0@lo:400:kworker.0 Request processed in 31us (94us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869375.069390:0:5756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1788869375.069411:0:6546:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765421442304 00000100:00100000:0.0:1788869375.069414:0:6546:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765421442304 00000100:00100000:0.0:1788869375.069440:0:6546:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765421442048 00000100:00100000:0.0:1788869375.069442:0:6546:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765421442048 00000100:00100000:0.0:1788869375.069460:0:6546:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788869375.069465:0:6546:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c835a7ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3286:x1875765421442304:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788869375.069499:0:6546:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c835a7ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3286:x1875765421442304:12345-0@lo:400:kworker.0 Request processed in 33us (793us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869375.069505:0:6546:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788869375.069514:0:6546:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788869375.069520:0:6546:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c82cdc4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3283:x1875765421442048:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788869375.069542:0:6546:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c82cdc4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3283:x1875765421442048:12345-0@lo:400:kworker.0 Request processed in 23us (368us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869375.069547:0:6546:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788869375.069562:0:5749:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765421441664 00000100:00100000:0.0:1788869375.069565:0:5749:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765421441664 00000100:00100000:0.0:1788869375.069586:0:5749:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 188 00000100:00100000:0.0:1788869375.069591:0:5749:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c8061da050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:121cd5bc-7f07-4cf7-8e2e-4356c89c0696+19:3283:x1875765421441664:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788869375.069617:0:5749:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c8061da050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:121cd5bc-7f07-4cf7-8e2e-4356c89c0696+19:3283:x1875765421441664:12345-0@lo:400:kworker.0 Request processed in 25us (392us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869375.069622:0:5749:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 188 00000100:00080000:0.0:1788869375.069645:0:5751:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788869375.069648:0:5751:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788869375.069650:0:5751:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1788869375.069674:0:3286:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff94c81f1f0380 x1875765421442304/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788869391 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788869375.069697:0:3286:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94c81f1f0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3286:1875765421442304:0@lo:400:kworker.0 00000100:00100000:0.0:1788869375.069721:0:3283:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94c803fbb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:121cd5bc-7f07-4cf7-8e2e-4356c89c0696:3283:1875765421441664:0@lo:400:kworker.0 00000100:00100000:0.0:1788869375.069729:0:3283:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94c82d042680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3283:1875765421442176:0@lo:400:kworker.0 00010000:00080000:0.0:1788869375.069738:0:3283:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff94c82d043480 x1875765421442048/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788869391 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788869375.069746:0:3283:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94c82d043480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3283:1875765421442048:0@lo:400:kworker.0 00000100:00100000:3.0:1788869375.070024:0:3285:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788869375.070104:0:3285:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94c835a7ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3285:1875765421442432:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788869375.070137:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869375.073230:0:6548:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765421442432 00000100:00100000:1.0:1788869375.073281:0:6548:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765421442432 00000100:00100000:1.0:1788869375.073348:0:6548:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788869375.073359:0:6548:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c82065d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3285:x1875765421442432:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788869375.073407:0:6548:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788869375.073491:0:6548:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c82065d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3285:x1875765421442432:12345-0@lo:13:osp-pre-1-0.0 Request processed in 134us (3352us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869375.073499:0:6548:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00080000:3.0:1788869375.073761:0:3285:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff94c835a7ca80 x1875765421442432/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788869391 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788869375.073785:0:3285:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94c835a7ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3285:1875765421442432:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1788869375.388645:0:5742:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788869376.411490:0:5743:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788869377.116628:0:3284:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788869377.129139:0:3284:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94c835a7f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3284:1875765421442560:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788869377.129216:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869377.131081:0:6548:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765421442560 00000100:00100000:0.0:1788869377.131094:0:6548:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765421442560 00000100:00100000:0.0:1788869377.131180:0:6548:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788869377.131190:0:6548:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c82065ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3284:x1875765421442560:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788869377.131230:0:6548:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788869377.131404:0:6548:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c82065ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3284:x1875765421442560:12345-0@lo:13:osp-pre-0-0.0 Request processed in 215us (2186us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869377.131411:0:6548:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00080000:0.0:1788869377.131436:0:5751:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1788869377.131834:0:3284:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff94c835a7f800 x1875765421442560/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788869393 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788869377.131854:0:3284:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94c835a7f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3284:1875765421442560:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1788869377.435396:0:7447:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788869378.465100:0:5742:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1788869378.775735:0:8860:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg139-server.virtnet: executing yml_node 00000100:00100000:0.0:1788869378.991416:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1788869378.991454:0:5750:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765413026688 00000100:00100000:0.0:1788869378.991463:0:5750:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765413026688 00000100:00100000:0.0:1788869378.991512:0:5750:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 189 00000100:00100000:0.0:1788869378.991522:0:5750:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c810e10050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3cca3acf-4935-4d0d-9982-d5d931f1c86b+10:2348:x1875765413026688:12345-192.168.201.39@tcp:400:kworker.0 00000100:00100000:0.0:1788869378.991591:0:5750:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c810e10050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3cca3acf-4935-4d0d-9982-d5d931f1c86b+10:2348:x1875765413026688:12345-192.168.201.39@tcp:400:kworker.0 Request processed in 70us (184us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869378.991606:0:5750:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 189 00000100:00100000:2.0:1788869378.995615:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1788869378.995656:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1788869378.995681:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1788869378.995711:0:6544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765413026944 00000100:00100000:2.0:1788869378.995720:0:6544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765413026944 00000100:00100000:3.0:1788869378.995766:0:6546:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765413027072 00000100:00100000:3.0:1788869378.995773:0:6546:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765413027072 00000100:00100000:2.0:1788869378.995795:0:6544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 15 00000100:00100000:2.0:1788869378.995817:0:6544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c82c841f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2125b9b3-626e-4cbe-be83-fb446e976ce2+5:2348:x1875765413026944:12345-192.168.201.39@tcp:400:kworker.0 00000100:00100000:2.0:1788869378.995885:0:6544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c82c841f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2125b9b3-626e-4cbe-be83-fb446e976ce2+5:2348:x1875765413026944:12345-192.168.201.39@tcp:400:kworker.0 Request processed in 82us (279us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869378.995893:0:6544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 15 00000100:00100000:2.0:1788869378.995909:0:6544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 16 00000100:00100000:2.0:1788869378.995918:0:6544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c82c841880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2125b9b3-626e-4cbe-be83-fb446e976ce2+5:2348:x1875765413027072:12345-192.168.201.39@tcp:400:kworker.0 00000100:00100000:2.0:1788869378.995938:0:6544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c82c841880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2125b9b3-626e-4cbe-be83-fb446e976ce2+5:2348:x1875765413027072:12345-192.168.201.39@tcp:400:kworker.0 Request processed in 23us (256us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869378.995956:0:6544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 16 00000100:00080000:2.0:1788869378.995973:0:5751:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788869378.995977:0:5751:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788869378.996291:0:5756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765413026816 00000100:00100000:1.0:1788869378.996296:0:5756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765413026816 00000100:00100000:1.0:1788869378.996336:0:5756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 25 00000100:00100000:1.0:1788869378.996342:0:5756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c82c842680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2125b9b3-626e-4cbe-be83-fb446e976ce2+6:2348:x1875765413026816:12345-192.168.201.39@tcp:400:kworker.0 00000100:00100000:1.0:1788869378.996381:0:5756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c82c842680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2125b9b3-626e-4cbe-be83-fb446e976ce2+6:2348:x1875765413026816:12345-192.168.201.39@tcp:400:kworker.0 Request processed in 39us (724us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869378.996388:0:5756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 25 00000100:00080000:2.0:1788869378.996466:0:5751:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1788869379.485984:0:5743:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788869380.187708:0:3283:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788869380.187731:0:3283:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94c835a7e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3283:1875765421442688:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788869380.187805:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869380.189099:0:6548:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765421442688 00000100:00100000:1.0:1788869380.189110:0:6548:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765421442688 00000100:00100000:1.0:1788869380.189186:0:6548:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788869380.189197:0:6548:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c82cdc6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1875765421442688:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788869380.189238:0:6548:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788869380.189319:0:6548:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c82cdc6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1875765421442688:12345-0@lo:13:osp-pre-1-0.0 Request processed in 124us (1514us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869380.189327:0:6548:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00010000:00080000:1.0:1788869380.189372:0:3283:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff94c835a7e300 x1875765421442688/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788869396 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788869380.189391:0:3283:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94c835a7e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3283:1875765421442688:0@lo:13:osp-pre-1-0.0 00000100:00080000:2.0:1788869380.189590:0:5751:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788869380.190072:0:3285:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94c82065df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:121cd5bc-7f07-4cf7-8e2e-4356c89c0696:3285:1875765421442816:0@lo:400:kworker.0 00000100:00100000:0.0:1788869380.190107:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869380.190133:0:3285:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94c82065d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3285:1875765421443328:0@lo:400:kworker.0 00000100:00100000:0.0:1788869380.190152:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869380.190170:0:3285:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788869380.190175:0:3285:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94c82065e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3285:1875765421442944:0@lo:400:kworker.0 00000100:00100000:0.0:1788869380.190191:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869380.190212:0:5748:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765421442816 00000100:00100000:0.0:1788869380.190216:0:5748:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765421442816 00000100:00100000:0.0:1788869380.190241:0:5748:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 190 00000100:00100000:0.0:1788869380.190274:0:5748:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c810e11050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:121cd5bc-7f07-4cf7-8e2e-4356c89c0696+19:3285:x1875765421442816:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788869380.190307:0:5748:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c810e11050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:121cd5bc-7f07-4cf7-8e2e-4356c89c0696+19:3285:x1875765421442816:12345-0@lo:400:kworker.0 Request processed in 60us (199us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869380.190314:0:5748:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 190 00000100:00100000:0.0:1788869380.190339:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765421443328 00000100:00100000:0.0:1788869380.190342:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765421443328 00000100:00100000:0.0:1788869380.190367:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765421442944 00000100:00100000:0.0:1788869380.190370:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765421442944 00000100:00100000:0.0:1788869380.190389:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1788869380.190395:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c82cdc6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3285:x1875765421443328:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788869380.190499:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c82cdc6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3285:x1875765421443328:12345-0@lo:400:kworker.0 Request processed in 104us (345us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869380.190518:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1788869380.190531:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1788869380.190537:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c82cdc5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3285:x1875765421442944:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788869380.190567:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c82cdc5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3285:x1875765421442944:12345-0@lo:400:kworker.0 Request processed in 31us (375us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869380.190573:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1788869380.190604:0:3285:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94c82065e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3285:1875765421442944:0@lo:400:kworker.0 00000100:00100000:0.0:1788869380.190612:0:3285:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94c82065df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:121cd5bc-7f07-4cf7-8e2e-4356c89c0696:3285:1875765421442816:0@lo:400:kworker.0 00000100:00100000:0.0:1788869380.190619:0:3285:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94c82065d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3285:1875765421443328:0@lo:400:kworker.0 00000100:00100000:2.0:1788869380.190688:0:3284:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94c82065f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3284:1875765421443200:0@lo:400:kworker.0 00000100:00100000:2.0:1788869380.190717:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869380.190743:0:3284:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788869380.190748:0:3284:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94c82065c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3284:1875765421443072:0@lo:400:kworker.0 00000100:00100000:2.0:1788869380.190765:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869380.190786:0:5755:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765421443072 00000100:00100000:2.0:1788869380.190789:0:5755:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765421443072 00000100:00100000:2.0:1788869380.190811:0:5755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1788869380.190816:0:5755:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c82c840a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3284:x1875765421443072:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788869380.190843:0:5755:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c82c840a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3284:x1875765421443072:12345-0@lo:400:kworker.0 Request processed in 27us (77us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869380.190849:0:5755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00080000:2.0:1788869380.190867:0:5751:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788869380.190881:0:3284:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94c82065c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3284:1875765421443072:0@lo:400:kworker.0 00000100:00100000:0.0:1788869380.191295:0:6546:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765421443200 00000100:00100000:0.0:1788869380.191299:0:6546:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765421443200 00000100:00100000:0.0:1788869380.191342:0:6546:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1788869380.191348:0:6546:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c82c843b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3284:x1875765421443200:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788869380.191395:0:6546:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c82c843b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3284:x1875765421443200:12345-0@lo:400:kworker.0 Request processed in 46us (676us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869380.191401:0:6546:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00010000:00080000:1.0:1788869380.191502:0:3284:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff94c82065f100 x1875765421443200/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788869396 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788869380.191517:0:3284:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94c82065f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3284:1875765421443200:0@lo:400:kworker.0 00000100:00080000:2.0:1788869380.191582:0:5751:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1788869380.507507:0:7447:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788869381.531690:0:5742:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1788869382.079546:0:9051:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: Client: 2.17.55.24 00000100:00100000:0.0:1788869382.236525:0:3286:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94c835a7e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3286:1875765421443456:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788869382.236622:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869382.239131:0:6548:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765421443456 00000100:00100000:3.0:1788869382.239153:0:6548:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765421443456 00000100:00100000:3.0:1788869382.239240:0:6548:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788869382.239277:0:6548:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c82cdc5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3286:x1875765421443456:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788869382.239326:0:6548:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00080000:1.0:1788869382.239425:0:5751:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788869382.248335:0:6548:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c82cdc5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3286:x1875765421443456:12345-0@lo:13:osp-pre-0-0.0 Request processed in 9071us (11700us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869382.248355:0:6548:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00010000:00080000:0.0:1788869382.254440:0:3286:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff94c835a7e300 x1875765421443456/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788869398 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788869382.254475:0:3286:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94c835a7e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3286:1875765421443456:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1788869382.560349:0:5743:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788869383.581076:0:7447:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788869384.117913:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1788869384.117959:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1788869384.117984:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1788869384.118004:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1788869384.118031:0:5749:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765413027200 00000100:00100000:2.0:1788869384.118042:0:5749:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765413027200 00000100:00100000:2.0:1788869384.118100:0:5749:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 191 00000100:00100000:2.0:1788869384.118112:0:5749:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c810e10450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3cca3acf-4935-4d0d-9982-d5d931f1c86b+10:2348:x1875765413027200:12345-192.168.201.39@tcp:400:kworker.0 00000100:00100000:2.0:1788869384.118283:0:5749:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c810e10450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3cca3acf-4935-4d0d-9982-d5d931f1c86b+10:2348:x1875765413027200:12345-192.168.201.39@tcp:400:kworker.0 Request processed in 173us (381us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869384.118293:0:5749:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 191 00000100:00100000:2.0:1788869384.118331:0:5755:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765413027328 00000100:00100000:2.0:1788869384.118335:0:5755:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765413027328 00000100:00100000:2.0:1788869384.118374:0:5755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 29 00000100:00100000:2.0:1788869384.118380:0:5755:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c82c840e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2125b9b3-626e-4cbe-be83-fb446e976ce2+6:2348:x1875765413027328:12345-192.168.201.39@tcp:400:kworker.0 00000100:00100000:2.0:1788869384.118413:0:5755:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c82c840e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2125b9b3-626e-4cbe-be83-fb446e976ce2+6:2348:x1875765413027328:12345-192.168.201.39@tcp:400:kworker.0 Request processed in 33us (454us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869384.118420:0:5755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 29 00000100:00100000:2.0:1788869384.118439:0:6544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765413027456 00000100:00100000:2.0:1788869384.118443:0:6544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765413027456 00000100:00100000:2.0:1788869384.118471:0:6544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765413027584 00000100:00100000:2.0:1788869384.118474:0:6544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765413027584 00000100:00100000:2.0:1788869384.118510:0:6544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 10 00000100:00100000:2.0:1788869384.118517:0:6544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c82c842a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2125b9b3-626e-4cbe-be83-fb446e976ce2+5:2344:x1875765413027456:12345-192.168.201.39@tcp:9:kworker.0 00000020:00000080:2.0:1788869384.118550:0:6544:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x3d2d1916761d63e8 00000100:00080000:2.0:1788869384.118561:0:6544:0:(import.c:65:import_set_state_nolock()) ffff94c810e52800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1788869384.118651:0:6544:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967298 00000100:00080000:3.0:1788869384.120117:0:5751:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788869384.120125:0:5751:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788869384.120129:0:5751:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788869384.120212:0:6544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c82c842a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2125b9b3-626e-4cbe-be83-fb446e976ce2+2:2344:x1875765413027456:12345-192.168.201.39@tcp:9:kworker.0 Request processed in 1687us (2219us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869384.120223:0:6544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 10 00000100:00100000:2.0:1788869384.120262:0:6544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 11 00000100:00100000:2.0:1788869384.120273:0:6544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c82c841180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2125b9b3-626e-4cbe-be83-fb446e976ce2+5:2344:x1875765413027584:12345-192.168.201.39@tcp:9:kworker.0 00000020:00000080:2.0:1788869384.120299:0:6544:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x3d2d1916761d63ef 00000100:00080000:2.0:1788869384.120311:0:6544:0:(import.c:65:import_set_state_nolock()) ffff94c810e50800 : changing import state from FULL to CLOSED 00010000:00010000:1.0:1788869384.124276:0:5742:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788869384.124391:0:5743:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00000004:2.0:1788869384.124427:0:6544:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:2.0:1788869384.124871:0:6544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c82c841180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2125b9b3-626e-4cbe-be83-fb446e976ce2+2:2344:x1875765413027584:12345-192.168.201.39@tcp:9:kworker.0 Request processed in 4593us (6857us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869384.124883:0:6544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 11 00000001:02000400:3.0:1788869384.251076:0:9148:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: MDS: 2.17.55.24 00010000:00010000:2.0:1788869384.603385:0:7447:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788869385.308500:0:3284:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788869385.308525:0:3284:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94c835a7d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3284:1875765421443584:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788869385.308595:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869385.308715:0:6549:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765421443584 00000100:00100000:1.0:1788869385.308723:0:6549:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765421443584 00000100:00100000:1.0:1788869385.308785:0:6549:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1788869385.308795:0:6549:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c82065ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3284:x1875765421443584:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788869385.308841:0:6549:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788869385.308901:0:6549:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c82065ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3284:x1875765421443584:12345-0@lo:13:osp-pre-1-0.0 Request processed in 107us (306us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869385.308909:0:6549:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00010000:00080000:1.0:1788869385.308950:0:3284:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff94c835a7d880 x1875765421443584/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788869401 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788869385.308966:0:3284:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94c835a7d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3284:1875765421443584:0@lo:13:osp-pre-1-0.0 00000100:00080000:3.0:1788869385.309151:0:5751:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788869385.310467:0:3285:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94c82cdc7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3285:1875765421443840:0@lo:400:kworker.0 00000100:00100000:0.0:1788869385.310500:0:3286:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94c81f1f0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3286:1875765421443968:0@lo:400:kworker.0 00000100:00100000:3.0:1788869385.310515:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869385.310541:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869385.310565:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765421443840 00000100:00100000:3.0:1788869385.310571:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765421443840 00000100:00100000:3.0:1788869385.310605:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765421443968 00000100:00100000:3.0:1788869385.310608:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765421443968 00000100:00100000:3.0:1788869385.310633:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1788869385.310640:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c82065dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3285:x1875765421443840:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788869385.310684:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c82065dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3285:x1875765421443840:12345-0@lo:400:kworker.0 Request processed in 43us (167us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869385.310691:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1788869385.310713:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1788869385.310719:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c83fbb3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3286:x1875765421443968:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788869385.310752:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c83fbb3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3286:x1875765421443968:12345-0@lo:400:kworker.0 Request processed in 33us (210us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869385.310759:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00080000:3.0:1788869385.310780:0:5751:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788869385.310802:0:3285:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94c82cdc7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3285:1875765421443840:0@lo:400:kworker.0 00000100:00100000:3.0:1788869385.310839:0:3286:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94c81f1f0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3286:1875765421443968:0@lo:400:kworker.0 00000100:00100000:1.0:1788869385.310909:0:3284:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94c82cdc4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:121cd5bc-7f07-4cf7-8e2e-4356c89c0696:3284:1875765421443712:0@lo:400:kworker.0 00000100:00100000:1.0:1788869385.310942:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869385.310977:0:3284:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94c83fbb0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3284:1875765421444224:0@lo:400:kworker.0 00000100:00100000:1.0:1788869385.310997:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869385.311020:0:3284:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788869385.311025:0:3284:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94c83fbb2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3284:1875765421444096:0@lo:400:kworker.0 00000100:00100000:1.0:1788869385.311046:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869385.311166:0:5750:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765421443712 00000100:00100000:0.0:1788869385.311170:0:5750:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765421443712 00000100:00100000:0.0:1788869385.311207:0:5750:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 192 00000100:00100000:0.0:1788869385.311225:0:5750:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c81f14e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:121cd5bc-7f07-4cf7-8e2e-4356c89c0696+19:3284:x1875765421443712:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788869385.311294:0:5750:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c81f14e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:121cd5bc-7f07-4cf7-8e2e-4356c89c0696+19:3284:x1875765421443712:12345-0@lo:400:kworker.0 Request processed in 70us (352us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869385.311301:0:5750:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 192 00000100:00100000:1.0:1788869385.311419:0:3284:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94c82cdc4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:121cd5bc-7f07-4cf7-8e2e-4356c89c0696:3284:1875765421443712:0@lo:400:kworker.0 00000100:00100000:3.0:1788869385.311570:0:6547:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765421444096 00000100:00100000:3.0:1788869385.311575:0:6547:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765421444096 00000100:00100000:3.0:1788869385.311625:0:6547:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1788869385.311632:0:6547:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c835a7fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3284:x1875765421444096:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788869385.311669:0:6547:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c835a7fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3284:x1875765421444096:12345-0@lo:400:kworker.0 Request processed in 38us (622us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869385.311676:0:6547:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1788869385.311691:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765421444224 00000100:00100000:3.0:1788869385.311694:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765421444224 00000100:00100000:3.0:1788869385.311716:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1788869385.311722:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c835a7d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3284:x1875765421444224:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788869385.311750:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c835a7d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3284:x1875765421444224:12345-0@lo:400:kworker.0 Request processed in 28us (752us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869385.311756:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00010000:00080000:3.0:1788869385.311782:0:3284:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff94c83fbb2a00 x1875765421444096/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788869401 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788869385.311792:0:3284:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94c83fbb2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3284:1875765421444096:0@lo:400:kworker.0 00000100:00100000:3.0:1788869385.311818:0:3284:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94c83fbb0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3284:1875765421444224:0@lo:400:kworker.0 00000100:00080000:1.0:1788869385.311888:0:5751:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788869385.311892:0:5751:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1788869385.627491:0:5742:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1788869386.196016:0:9246:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: OSS: 2.17.55.24 00010000:00010000:3.0:1788869386.651482:0:5743:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788869387.357653:0:3286:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788869387.359898:0:3286:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94c835a7c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3286:1875765421444352:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788869387.359973:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869387.360043:0:6549:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765421444352 00000100:00100000:1.0:1788869387.360057:0:6549:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765421444352 00000100:00100000:1.0:1788869387.360155:0:6549:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1788869387.360169:0:6549:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c82065fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3286:x1875765421444352:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788869387.360219:0:6549:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788869387.360332:0:6549:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c82065fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3286:x1875765421444352:12345-0@lo:13:osp-pre-0-0.0 Request processed in 167us (357us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869387.360341:0:6549:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00010000:00080000:2.0:1788869387.360541:0:3286:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff94c835a7c380 x1875765421444352/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788869403 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788869387.360564:0:3286:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94c835a7c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3286:1875765421444352:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1788869387.362900:0:5751:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:02000400:0.0:1788869387.607150:0:9294:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: -----============= acceptance-small: sanity-pcc ============----- Tue Sep 8 08:09:45 EDT 2026 00010000:00010000:2.0:1788869387.676362:0:7447:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1788869388.427446:0:6571:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 2125b9b3-626e-4cbe-be83-fb446e976ce2 00000020:00000080:2.0:1788869388.427457:0:6571:0:(genops.c:906:class_export_put()) final put ffff94c810e56000/2125b9b3-626e-4cbe-be83-fb446e976ce2 00000020:00000080:2.0:1788869388.427485:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff94c810e56000/2125b9b3-626e-4cbe-be83-fb446e976ce2 for lustre-OST0000 00000020:00000080:2.0:1788869388.427532:0:36:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff94c810e52800 for lustre-OST0000 00000001:00100000:0.0:1788869388.432696:0:7458:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 2125b9b3-626e-4cbe-be83-fb446e976ce2 00000020:00000080:0.0:1788869388.432706:0:7458:0:(genops.c:906:class_export_put()) final put ffff94c810e54800/2125b9b3-626e-4cbe-be83-fb446e976ce2 00000020:00000080:1.0:1788869388.432775:0:472:0:(genops.c:865:class_export_destroy()) destroying export ffff94c810e54800/2125b9b3-626e-4cbe-be83-fb446e976ce2 for lustre-OST0001 00000020:00000080:1.0:1788869388.432825:0:472:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff94c810e50800 for lustre-OST0001 00010000:00010000:1.0:1788869388.700465:0:5742:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788869389.236167:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1788869389.236210:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1788869389.236310:0:5748:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765413027712 00000100:00100000:3.0:1788869389.236319:0:5748:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765413027712 00000100:00100000:3.0:1788869389.236363:0:5748:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 193 00000100:00100000:3.0:1788869389.236371:0:5748:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c81f14ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3cca3acf-4935-4d0d-9982-d5d931f1c86b+10:2345:x1875765413027712:12345-192.168.201.39@tcp:400:kworker.0 00000100:00100000:0.0:1788869389.236426:0:5757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765413027840 00000100:00100000:0.0:1788869389.236431:0:5757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765413027840 00000100:00100000:3.0:1788869389.236437:0:5748:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c81f14ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3cca3acf-4935-4d0d-9982-d5d931f1c86b+10:2345:x1875765413027712:12345-192.168.201.39@tcp:400:kworker.0 Request processed in 65us (275us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869389.236446:0:5748:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 193 00000100:00100000:0.0:1788869389.236472:0:5757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 33 00000100:00100000:0.0:1788869389.236480:0:5757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c82c840700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2125b9b3-626e-4cbe-be83-fb446e976ce2+6:2345:x1875765413027840:12345-192.168.201.39@tcp:400:kworker.0 00000100:00100000:0.0:1788869389.236508:0:5757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c82c840700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2125b9b3-626e-4cbe-be83-fb446e976ce2+6:2345:x1875765413027840:12345-192.168.201.39@tcp:400:kworker.0 Request processed in 30us (298us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869389.236512:0:5757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 33 00000100:00080000:3.0:1788869389.236583:0:5751:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1788869389.725164:0:5743:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788869390.427600:0:3286:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94c835a7c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3286:1875765421444480:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788869390.427673:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869390.427788:0:6549:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765421444480 00000100:00100000:1.0:1788869390.427801:0:6549:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765421444480 00000100:00100000:1.0:1788869390.427889:0:6549:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1788869390.427903:0:6549:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c82c843100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3286:x1875765421444480:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788869390.427952:0:6549:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788869390.428033:0:6549:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c82c843100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3286:x1875765421444480:12345-0@lo:13:osp-pre-1-0.0 Request processed in 133us (358us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869390.428042:0:6549:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00080000:2.0:1788869390.428093:0:3286:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff94c835a7c000 x1875765421444480/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788869406 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788869390.428118:0:3286:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94c835a7c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3286:1875765421444480:0@lo:13:osp-pre-1-0.0 00000100:00080000:3.0:1788869390.428141:0:5751:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788869390.428372:0:3284:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788869390.428453:0:3283:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788869390.428469:0:3283:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94c82c842d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3283:1875765421444736:0@lo:400:kworker.0 00000100:00100000:1.0:1788869390.428513:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869390.429412:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765421444736 00000100:00100000:0.0:1788869390.429419:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765421444736 00000100:00100000:0.0:1788869390.429465:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1788869390.429473:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c835a7f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3283:x1875765421444736:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788869390.429522:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c835a7f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3283:x1875765421444736:12345-0@lo:400:kworker.0 Request processed in 50us (1010us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869390.429529:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1788869390.429566:0:3283:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94c82c842d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3283:1875765421444736:0@lo:400:kworker.0 00000100:00100000:3.0:1788869390.432486:0:3284:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94c82c841500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:121cd5bc-7f07-4cf7-8e2e-4356c89c0696:3284:1875765421444608:0@lo:400:kworker.0 00000100:00100000:3.0:1788869390.432573:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869390.436211:0:3283:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94c82c840380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3283:1875765421445120:0@lo:400:kworker.0 00000100:00100000:1.0:1788869390.436301:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869390.436371:0:3285:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94c82c841c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3285:1875765421444864:0@lo:400:kworker.0 00000100:00100000:1.0:1788869390.436396:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869390.436491:0:3285:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788869390.436497:0:3285:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94c82c843480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3285:1875765421444992:0@lo:400:kworker.0 00000100:00100000:1.0:1788869390.436590:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869390.436757:0:6544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765421444992 00000100:00100000:1.0:1788869390.436764:0:6544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765421444992 00000100:00100000:1.0:1788869390.436814:0:6544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1788869390.436823:0:6544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c835a7d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3285:x1875765421444992:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788869390.436885:0:6544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c835a7d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3285:x1875765421444992:12345-0@lo:400:kworker.0 Request processed in 63us (294us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869390.436907:0:6544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00010000:00080000:1.0:1788869390.436948:0:3285:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff94c82c843480 x1875765421444992/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788869406 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788869390.436961:0:3285:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94c82c843480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3285:1875765421444992:0@lo:400:kworker.0 00000100:00100000:1.0:1788869390.436991:0:5757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765421445120 00000100:00100000:1.0:1788869390.436995:0:5757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765421445120 00000100:00100000:1.0:1788869390.438641:0:5757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765421444864 00000100:00100000:1.0:1788869390.438650:0:5757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765421444864 00000100:00100000:1.0:1788869390.438689:0:5757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1788869390.438697:0:5757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c835a7dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3283:x1875765421445120:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788869390.438770:0:5757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c835a7dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3283:x1875765421445120:12345-0@lo:400:kworker.0 Request processed in 73us (2469us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869390.438777:0:5757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1788869390.438790:0:5757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1788869390.438796:0:5757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c835a7ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3285:x1875765421444864:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788869390.438820:0:5757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c835a7ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3285:x1875765421444864:12345-0@lo:400:kworker.0 Request processed in 25us (2424us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869390.438826:0:5757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1788869390.438863:0:3285:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94c82c841c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3285:1875765421444864:0@lo:400:kworker.0 00000100:00100000:1.0:1788869390.438888:0:3283:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94c82c840380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3283:1875765421445120:0@lo:400:kworker.0 00000100:00080000:2.0:1788869390.442926:0:5751:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788869390.442938:0:5751:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788869390.451363:0:5749:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765421444608 00000100:00100000:0.0:1788869390.451408:0:5749:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765421444608 00000100:00100000:0.0:1788869390.451587:0:5749:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 194 00000100:00100000:0.0:1788869390.451600:0:5749:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c81f14f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:121cd5bc-7f07-4cf7-8e2e-4356c89c0696+19:3284:x1875765421444608:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788869390.451753:0:5749:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c81f14f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:121cd5bc-7f07-4cf7-8e2e-4356c89c0696+19:3284:x1875765421444608:12345-0@lo:400:kworker.0 Request processed in 156us (19179us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869390.451762:0:5749:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 194 00000100:00100000:1.0:1788869390.451889:0:3284:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94c82c841500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:121cd5bc-7f07-4cf7-8e2e-4356c89c0696:3284:1875765421444608:0@lo:400:kworker.0 00010000:00010000:2.0:1788869390.747370:0:7447:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788869391.772787:0:5742:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788869392.477078:0:3284:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94c835a7f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3284:1875765421445248:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788869392.479069:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869392.479160:0:6548:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765421445248 00000100:00100000:3.0:1788869392.479167:0:6548:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765421445248 00000100:00100000:3.0:1788869392.479242:0:6548:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1788869392.479272:0:6548:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c82065e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3284:x1875765421445248:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788869392.479310:0:6548:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788869392.479365:0:6548:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c82065e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3284:x1875765421445248:12345-0@lo:13:osp-pre-0-0.0 Request processed in 115us (300us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869392.479372:0:6548:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00080000:3.0:1788869392.479392:0:5751:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1788869392.479421:0:3284:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff94c835a7f100 x1875765421445248/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788869408 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788869392.479440:0:3284:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94c835a7f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3284:1875765421445248:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1788869392.795419:0:5743:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788869393.819418:0:7447:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788869394.351210:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1788869394.351492:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1788869394.351588:0:5750:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765413027968 00000100:00100000:1.0:1788869394.351596:0:5757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765413028096 00000100:00100000:1.0:1788869394.351605:0:5757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765413028096 00000100:00100000:2.0:1788869394.351662:0:5750:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765413027968 00000100:00100000:1.0:1788869394.351700:0:5757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 37 00000100:00100000:2.0:1788869394.351705:0:5750:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 195 00000100:00100000:2.0:1788869394.351714:0:5750:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c81f14f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3cca3acf-4935-4d0d-9982-d5d931f1c86b+10:2348:x1875765413027968:12345-192.168.201.39@tcp:400:kworker.0 00000100:00100000:1.0:1788869394.351721:0:5757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c82065d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2125b9b3-626e-4cbe-be83-fb446e976ce2+6:2348:x1875765413028096:12345-192.168.201.39@tcp:400:kworker.0 00000100:00100000:2.0:1788869394.351781:0:5750:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c81f14f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3cca3acf-4935-4d0d-9982-d5d931f1c86b+10:2348:x1875765413027968:12345-192.168.201.39@tcp:400:kworker.0 Request processed in 68us (581us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869394.351790:0:5750:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 195 00000100:00080000:0.0:1788869394.351796:0:5751:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788869394.352021:0:5757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c82065d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2125b9b3-626e-4cbe-be83-fb446e976ce2+6:2348:x1875765413028096:12345-192.168.201.39@tcp:400:kworker.0 Request processed in 308us (527us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869394.352030:0:5757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 37 00010000:00010000:1.0:1788869394.844413:0:5742:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788869395.547650:0:3286:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788869395.547676:0:3286:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94c82c841500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3286:1875765421445376:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788869395.547743:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869395.547895:0:6548:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765421445376 00000100:00100000:2.0:1788869395.547903:0:6548:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765421445376 00000100:00100000:2.0:1788869395.547967:0:6548:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1788869395.547977:0:6548:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c83fbb2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3286:x1875765421445376:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788869395.548011:0:6548:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788869395.548066:0:6548:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c83fbb2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3286:x1875765421445376:12345-0@lo:13:osp-pre-1-0.0 Request processed in 81us (312us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869395.548074:0:6548:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00080000:0.0:1788869395.548158:0:5751:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:0.0:1788869395.548187:0:3286:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff94c82c841500 x1875765421445376/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788869411 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788869395.548205:0:3286:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94c82c841500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3286:1875765421445376:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788869395.548564:0:3286:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94c835a7c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:121cd5bc-7f07-4cf7-8e2e-4356c89c0696:3286:1875765421445504:0@lo:400:kworker.0 00000100:00100000:0.0:1788869395.548596:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869395.548702:0:3283:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94c835a7d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3283:1875765421445632:0@lo:400:kworker.0 00000100:00100000:1.0:1788869395.548731:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869395.548749:0:3283:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788869395.548753:0:3283:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94c835a7ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3283:1875765421445760:0@lo:400:kworker.0 00000100:00100000:1.0:1788869395.548768:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869395.548831:0:3286:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94c835a7e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3286:1875765421446016:0@lo:400:kworker.0 00000100:00100000:0.0:1788869395.548850:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869395.548871:0:3286:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788869395.548876:0:3286:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94c835a7df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3286:1875765421445888:0@lo:400:kworker.0 00000100:00100000:0.0:1788869395.548899:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869395.548973:0:5756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765421445632 00000100:00100000:3.0:1788869395.548978:0:5756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765421445632 00000100:00100000:3.0:1788869395.549016:0:5756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765421445760 00000100:00100000:3.0:1788869395.549020:0:5756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765421445760 00000100:00100000:0.0:1788869395.549090:0:5757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765421446016 00000100:00100000:0.0:1788869395.549094:0:5757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765421446016 00000100:00100000:1.0:1788869395.549150:0:5755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1788869395.549158:0:5755:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c835a7f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3283:x1875765421445632:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788869395.549200:0:5755:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c835a7f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3283:x1875765421445632:12345-0@lo:400:kworker.0 Request processed in 42us (467us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869395.549207:0:5755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1788869395.549245:0:3283:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94c835a7d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3283:1875765421445632:0@lo:400:kworker.0 00000100:00100000:1.0:1788869395.549325:0:6547:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765421445888 00000100:00100000:1.0:1788869395.549329:0:6547:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765421445888 00000100:00100000:3.0:1788869395.549393:0:5756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1788869395.549400:0:5756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c835a7c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3283:x1875765421445760:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788869395.549439:0:5756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c835a7c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3283:x1875765421445760:12345-0@lo:400:kworker.0 Request processed in 39us (668us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869395.549445:0:5756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1788869395.549493:0:5749:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765421445504 00000100:00100000:2.0:1788869395.549497:0:5749:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765421445504 00000100:00100000:2.0:1788869395.549523:0:5749:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 196 00000100:00100000:2.0:1788869395.549530:0:5749:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c81f14dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:121cd5bc-7f07-4cf7-8e2e-4356c89c0696+19:3286:x1875765421445504:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788869395.549569:0:5749:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c81f14dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:121cd5bc-7f07-4cf7-8e2e-4356c89c0696+19:3286:x1875765421445504:12345-0@lo:400:kworker.0 Request processed in 39us (972us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869395.549576:0:5749:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 196 00000100:00100000:2.0:1788869395.549638:0:3283:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94c835a7ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3283:1875765421445760:0@lo:400:kworker.0 00000100:00100000:2.0:1788869395.549669:0:3286:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94c835a7c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:121cd5bc-7f07-4cf7-8e2e-4356c89c0696:3286:1875765421445504:0@lo:400:kworker.0 00000100:00100000:0.0:1788869395.550258:0:5757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1788869395.550266:0:5757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c83fbb1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3286:x1875765421446016:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788869395.550358:0:5757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c83fbb1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3286:x1875765421446016:12345-0@lo:400:kworker.0 Request processed in 93us (1506us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869395.550365:0:5757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1788869395.550597:0:3286:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94c835a7e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3286:1875765421446016:0@lo:400:kworker.0 00000100:00100000:1.0:1788869395.550727:0:6547:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1788869395.550734:0:6547:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c83fbb3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3286:x1875765421445888:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788869395.550769:0:6547:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c83fbb3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3286:x1875765421445888:12345-0@lo:400:kworker.0 Request processed in 36us (1869us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869395.550775:0:6547:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00010000:00080000:0.0:1788869395.550873:0:3286:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff94c835a7df80 x1875765421445888/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788869411 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788869395.550884:0:3286:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94c835a7df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3286:1875765421445888:0@lo:400:kworker.0 00000100:00080000:3.0:1788869395.550933:0:5751:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788869395.550939:0:5751:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1788869395.867479:0:5743:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1788869396.415666:0:9925:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-pcc: start setup 08:09:54 (1788869394) === 00000100:00100000:3.0:1788869396.718147:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1788869396.718462:0:5748:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765413028224 00000100:00100000:2.0:1788869396.718472:0:5748:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765413028224 00000100:00100000:2.0:1788869396.718535:0:5748:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 197 00000100:00100000:2.0:1788869396.718545:0:5748:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c81f14e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3cca3acf-4935-4d0d-9982-d5d931f1c86b+10:8070:x1875765413028224:12345-192.168.201.39@tcp:101:mount.lustre.0 00010000:00010000:2.0:1788869396.718561:0:5748:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788869396.718588:0:5748:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff94c80153ae00/0x3d2d1916761d64b3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x375c010249035783 expref: -99 pid: 5748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869396.718617:0:5748:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff94c80153ae00/0x3d2d1916761d64b3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.201.39@tcp remote: 0x375c010249035783 expref: 11 pid: 5748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869396.718629:0:5748:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff94c80153ae00/0x3d2d1916761d64b3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.201.39@tcp remote: 0x375c010249035783 expref: 11 pid: 5748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869396.718638:0:5748:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94c80153ae00, rc 0) 00000100:00100000:2.0:1788869396.718698:0:5748:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c81f14e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3cca3acf-4935-4d0d-9982-d5d931f1c86b+11:8070:x1875765413028224:12345-192.168.201.39@tcp:101:mount.lustre.0 Request processed in 154us (560us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869396.718717:0:5748:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 197 00000100:00100000:2.0:1788869396.720993:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1788869396.721047:0:5750:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765413028352 00000100:00100000:0.0:1788869396.721055:0:5750:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765413028352 00000100:00100000:0.0:1788869396.721176:0:5750:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 198 00000100:00100000:0.0:1788869396.721189:0:5750:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c81f14cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3cca3acf-4935-4d0d-9982-d5d931f1c86b+11:8070:x1875765413028352:12345-192.168.201.39@tcp:501:mount.lustre.0 00000100:00100000:0.0:1788869396.721678:0:5750:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c81f14cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3cca3acf-4935-4d0d-9982-d5d931f1c86b+11:8070:x1875765413028352:12345-192.168.201.39@tcp:501:mount.lustre.0 Request processed in 491us (730us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869396.721687:0:5750:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 198 00000100:00100000:0.0:1788869396.725497:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1788869396.725645:0:5748:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765413028480 00000100:00100000:2.0:1788869396.725660:0:5748:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765413028480 00000100:00100000:2.0:1788869396.725753:0:5748:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 199 00000100:00100000:2.0:1788869396.725763:0:5748:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c81f14f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3cca3acf-4935-4d0d-9982-d5d931f1c86b+11:8070:x1875765413028480:12345-192.168.201.39@tcp:503:mount.lustre.0 00000100:00100000:2.0:1788869396.726005:0:5748:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c81f14f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3cca3acf-4935-4d0d-9982-d5d931f1c86b+11:8070:x1875765413028480:12345-192.168.201.39@tcp:503:mount.lustre.0 Request processed in 243us (513us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869396.726014:0:5748:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 199 00000100:00100000:3.0:1788869396.728818:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1788869396.729274:0:5750:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765413028608 00000100:00100000:0.0:1788869396.729285:0:5750:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765413028608 00000100:00100000:0.0:1788869396.729349:0:5750:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 200 00000100:00100000:0.0:1788869396.729360:0:5750:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c81f14c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3cca3acf-4935-4d0d-9982-d5d931f1c86b+11:8074:x1875765413028608:12345-192.168.201.39@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788869396.729705:0:5750:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c81f14c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3cca3acf-4935-4d0d-9982-d5d931f1c86b+11:8074:x1875765413028608:12345-192.168.201.39@tcp:502:llog_process_th.0 Request processed in 345us (892us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869396.729734:0:5750:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 200 00000100:00100000:1.0:1788869396.746479:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1788869396.746558:0:5748:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765413028736 00000100:00100000:2.0:1788869396.746582:0:5748:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765413028736 00000100:00100000:2.0:1788869396.746641:0:5748:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 201 00000100:00100000:2.0:1788869396.746649:0:5748:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c81f14d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3cca3acf-4935-4d0d-9982-d5d931f1c86b+11:8074:x1875765413028736:12345-192.168.201.39@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788869396.746952:0:5748:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c81f14d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3cca3acf-4935-4d0d-9982-d5d931f1c86b+11:8074:x1875765413028736:12345-192.168.201.39@tcp:502:llog_process_th.0 Request processed in 303us (489us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869396.746969:0:5748:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 201 00000100:00100000:1.0:1788869396.751940:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1788869396.752001:0:5749:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765413028864 00000100:00100000:2.0:1788869396.752010:0:5749:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765413028864 00000100:00100000:2.0:1788869396.752073:0:5749:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 202 00000100:00100000:2.0:1788869396.752082:0:5749:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c81f14c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3cca3acf-4935-4d0d-9982-d5d931f1c86b+11:8070:x1875765413028864:12345-192.168.201.39@tcp:101:mount.lustre.0 00010000:00010000:2.0:1788869396.752097:0:5749:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788869396.752177:0:5749:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff94c80153be00/0x3d2d1916761d64ba lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x375c0102490357ad expref: -99 pid: 5749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869396.752205:0:5749:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff94c80153be00/0x3d2d1916761d64ba lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.201.39@tcp remote: 0x375c0102490357ad expref: 12 pid: 5749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869396.752225:0:5749:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff94c80153be00/0x3d2d1916761d64ba lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.201.39@tcp remote: 0x375c0102490357ad expref: 12 pid: 5749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869396.752232:0:5749:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94c80153be00, rc 0) 00000100:00100000:2.0:1788869396.752301:0:5749:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c81f14c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3cca3acf-4935-4d0d-9982-d5d931f1c86b+12:8070:x1875765413028864:12345-192.168.201.39@tcp:101:mount.lustre.0 Request processed in 220us (370us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869396.752308:0:5749:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 202 00000100:00100000:3.0:1788869396.754338:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1788869396.755540:0:5750:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765413028992 00000100:00100000:0.0:1788869396.755562:0:5750:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765413028992 00000100:00100000:0.0:1788869396.755668:0:5750:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 203 00000100:00100000:0.0:1788869396.755679:0:5750:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c81f149c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3cca3acf-4935-4d0d-9982-d5d931f1c86b+12:8070:x1875765413028992:12345-192.168.201.39@tcp:256:mount.lustre.0 20000000:01000000:0.0:1788869396.755704:0:5750:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:0.0:1788869396.755720:0:5750:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:0.0:1788869396.755723:0:5750:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:0.0:1788869396.755726:0:5750:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:0.0:1788869396.755727:0:5750:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 5 00000100:00100000:0.0:1788869396.757320:0:5750:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c81f149c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3cca3acf-4935-4d0d-9982-d5d931f1c86b+12:8070:x1875765413028992:12345-192.168.201.39@tcp:256:mount.lustre.0 Request processed in 1639us (2983us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869396.757329:0:5750:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 203 00000100:00100000:1.0:1788869396.760841:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1788869396.761000:0:5748:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765413029120 00000100:00100000:3.0:1788869396.761011:0:5748:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765413029120 00000100:00100000:3.0:1788869396.761069:0:5748:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 204 00000100:00100000:3.0:1788869396.761092:0:5748:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c81f14a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3cca3acf-4935-4d0d-9982-d5d931f1c86b+12:8070:x1875765413029120:12345-192.168.201.39@tcp:101:mount.lustre.0 00010000:00010000:3.0:1788869396.761230:0:5748:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788869396.761274:0:5748:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff94c83504ca00/0x3d2d1916761d64c1 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x375c0102490357b4 expref: -99 pid: 5748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869396.761304:0:5748:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff94c83504ca00/0x3d2d1916761d64c1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.201.39@tcp remote: 0x375c0102490357b4 expref: 13 pid: 5748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869396.761315:0:5748:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff94c83504ca00/0x3d2d1916761d64c1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.201.39@tcp remote: 0x375c0102490357b4 expref: 13 pid: 5748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869396.761324:0:5748:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94c83504ca00, rc 0) 00000100:00100000:3.0:1788869396.761517:0:5748:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c81f14a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3cca3acf-4935-4d0d-9982-d5d931f1c86b+13:8070:x1875765413029120:12345-192.168.201.39@tcp:101:mount.lustre.0 Request processed in 425us (685us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869396.761525:0:5748:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 204 00000100:00100000:3.0:1788869396.763374:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1788869396.763654:0:5750:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765413029248 00000100:00100000:0.0:1788869396.763663:0:5750:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765413029248 00000100:00100000:0.0:1788869396.763715:0:5750:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 205 00000100:00100000:0.0:1788869396.763724:0:5750:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c81f148c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3cca3acf-4935-4d0d-9982-d5d931f1c86b+13:8070:x1875765413029248:12345-192.168.201.39@tcp:501:mount.lustre.0 00000100:00100000:0.0:1788869396.764275:0:5750:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c81f148c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3cca3acf-4935-4d0d-9982-d5d931f1c86b+13:8070:x1875765413029248:12345-192.168.201.39@tcp:501:mount.lustre.0 Request processed in 550us (906us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869396.764284:0:5750:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 205 00000100:00100000:1.0:1788869396.765799:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1788869396.765975:0:5748:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765413029376 00000100:00100000:3.0:1788869396.765983:0:5748:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765413029376 00000100:00100000:3.0:1788869396.766085:0:5748:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 206 00000100:00100000:3.0:1788869396.766096:0:5748:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c81f14b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3cca3acf-4935-4d0d-9982-d5d931f1c86b+13:8070:x1875765413029376:12345-192.168.201.39@tcp:503:mount.lustre.0 00000100:00100000:3.0:1788869396.766342:0:5748:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c81f14b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3cca3acf-4935-4d0d-9982-d5d931f1c86b+13:8070:x1875765413029376:12345-192.168.201.39@tcp:503:mount.lustre.0 Request processed in 247us (548us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869396.766350:0:5748:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 206 00000100:00100000:1.0:1788869396.769188:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1788869396.769695:0:5750:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765413029504 00000100:00100000:0.0:1788869396.769705:0:5750:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765413029504 00000100:00100000:0.0:1788869396.769767:0:5750:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 207 00000100:00100000:0.0:1788869396.769777:0:5750:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c81f148050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3cca3acf-4935-4d0d-9982-d5d931f1c86b+13:8076:x1875765413029504:12345-192.168.201.39@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788869396.770166:0:5750:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c81f148050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3cca3acf-4935-4d0d-9982-d5d931f1c86b+13:8076:x1875765413029504:12345-192.168.201.39@tcp:502:llog_process_th.0 Request processed in 389us (988us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869396.770175:0:5750:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 207 00000100:00100000:0.0:1788869396.775348:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1788869396.775502:0:5748:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765413029632 00000100:00100000:3.0:1788869396.775513:0:5748:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765413029632 00000100:00100000:3.0:1788869396.775560:0:5748:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 208 00000100:00100000:3.0:1788869396.775569:0:5748:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c81f149050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3cca3acf-4935-4d0d-9982-d5d931f1c86b+13:8076:x1875765413029632:12345-192.168.201.39@tcp:502:llog_process_th.0 00000100:00100000:3.0:1788869396.775826:0:5748:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c81f149050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3cca3acf-4935-4d0d-9982-d5d931f1c86b+13:8076:x1875765413029632:12345-192.168.201.39@tcp:502:llog_process_th.0 Request processed in 257us (486us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869396.775835:0:5748:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 208 00000100:00100000:1.0:1788869396.781402:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1788869396.781452:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1788869396.781481:0:5756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765413029760 00000100:00100000:3.0:1788869396.781490:0:5756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765413029760 00000100:00100000:3.0:1788869396.781534:0:5756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765413030144 00000100:00100000:3.0:1788869396.781537:0:5756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765413030144 00000100:00100000:3.0:1788869396.781600:0:5756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 41 00000100:00100000:3.0:1788869396.781611:0:5756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c835a7c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2125b9b3-626e-4cbe-be83-fb446e976ce2+6:2345:x1875765413030144:12345-192.168.201.39@tcp:400:kworker.0 00000100:00080000:1.0:1788869396.781623:0:5751:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788869396.781837:0:5755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 10 00000100:00100000:2.0:1788869396.781844:0:5755:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c835a7d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2344:x1875765413029760:12345-192.168.201.39@tcp:38:mount.lustre.0 00010000:00080000:2.0:1788869396.781869:0:5755:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0000: connection from 10cd6f3c-009b-4acc-9ca5-e50cb17e412c@192.168.201.39@tcp t0 exp 0000000000000000 cur 145 last 0 00000020:00000080:2.0:1788869396.781912:0:5755:0:(genops.c:1406:class_connect()) connect: client 10cd6f3c-009b-4acc-9ca5-e50cb17e412c, cookie 0x3d2d1916761d64c8 00000004:00100000:2.0:1788869396.781942:0:5755:0:(mdt_handler.c:7362:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:2.0:1788869396.782486:0:5755:0:(import.c:65:import_set_state_nolock()) ffff94c83c6a0800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788869396.782634:0:5755:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c835a7d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:10cd6f3c-009b-4acc-9ca5-e50cb17e412c+6:2344:x1875765413029760:12345-192.168.201.39@tcp:38:mount.lustre.0 Request processed in 787us (1240us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869396.782641:0:5755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 10 00000100:00100000:3.0:1788869396.782764:0:5756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c835a7c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2125b9b3-626e-4cbe-be83-fb446e976ce2+6:2345:x1875765413030144:12345-192.168.201.39@tcp:400:kworker.0 Request processed in 1154us (1311us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869396.782771:0:5756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 41 00000100:00100000:1.0:1788869396.785306:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1788869396.785752:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1788869396.788131:0:5755:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765413029888 00000100:00100000:2.0:1788869396.788144:0:5755:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765413029888 00000100:00100000:2.0:1788869396.788213:0:5755:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765413030016 00000100:00100000:2.0:1788869396.788217:0:5755:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765413030016 00000100:00100000:2.0:1788869396.788243:0:5755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 11 00000100:00100000:2.0:1788869396.788271:0:5755:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c835a7e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:10cd6f3c-009b-4acc-9ca5-e50cb17e412c+7:0:x1875765413029888:12345-192.168.201.39@tcp:41:mount.lustre.0 00000004:00000024:2.0:1788869396.788317:0:5755:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00080000:1.0:1788869396.788466:0:5751:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788869396.788668:0:5755:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c835a7e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:10cd6f3c-009b-4acc-9ca5-e50cb17e412c+7:0:x1875765413029888:12345-192.168.201.39@tcp:41:mount.lustre.0 Request processed in 416us (3368us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869396.788694:0:5755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 11 00000100:00100000:2.0:1788869396.788713:0:5755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 12 00000100:00100000:2.0:1788869396.788721:0:5755:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c82065ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:10cd6f3c-009b-4acc-9ca5-e50cb17e412c+6:8070:x1875765413030016:12345-192.168.201.39@tcp:41:mount.lustre.0 00000004:00000024:2.0:1788869396.788733:0:5755:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:2.0:1788869396.788757:0:5755:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c82065ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:10cd6f3c-009b-4acc-9ca5-e50cb17e412c+6:8070:x1875765413030016:12345-192.168.201.39@tcp:41:mount.lustre.0 Request processed in 37us (3006us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869396.788765:0:5755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 12 00000100:00100000:1.0:1788869396.790975:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1788869396.791062:0:5755:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765413030272 00000100:00100000:2.0:1788869396.791070:0:5755:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765413030272 00000100:00100000:2.0:1788869396.791186:0:5755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 13 00000100:00100000:2.0:1788869396.791197:0:5755:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c835a7f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:10cd6f3c-009b-4acc-9ca5-e50cb17e412c+6:8070:x1875765413030272:12345-192.168.201.39@tcp:40:mount.lustre.0 00000100:00100000:2.0:1788869396.791317:0:5755:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c835a7f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:10cd6f3c-009b-4acc-9ca5-e50cb17e412c+6:8070:x1875765413030272:12345-192.168.201.39@tcp:40:mount.lustre.0 Request processed in 122us (346us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869396.791324:0:5755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 13 00000100:00100000:1.0:1788869396.797819:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1788869396.797865:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1788869396.797917:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1788869396.798006:0:7884:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765413030400 00000100:00100000:3.0:1788869396.798016:0:7884:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765413030400 00000100:00100000:3.0:1788869396.798058:0:7884:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765413030528 00000100:00100000:3.0:1788869396.798061:0:7884:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765413030528 00000100:00100000:3.0:1788869396.798080:0:7884:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 12 00000100:00100000:3.0:1788869396.798087:0:7884:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c835a7ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2344:x1875765413030400:12345-192.168.201.39@tcp:8:mount.lustre.0 00010000:00080000:3.0:1788869396.798117:0:7884:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0000: connection from 10cd6f3c-009b-4acc-9ca5-e50cb17e412c@192.168.201.39@tcp t0 exp 0000000000000000 cur 145 last 0 00000020:00000080:3.0:1788869396.798147:0:7884:0:(genops.c:1406:class_connect()) connect: client 10cd6f3c-009b-4acc-9ca5-e50cb17e412c, cookie 0x3d2d1916761d64cf 00002000:00100000:3.0:1788869396.798159:0:7884:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 10cd6f3c-009b-4acc-9ca5-e50cb17e412c/ffff94c835501000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113718 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1788869396.798181:0:7884:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:3.0:1788869396.798371:0:7884:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1788869396.798394:0:7884:0:(import.c:65:import_set_state_nolock()) ffff94c835500800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788869396.798455:0:7884:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c835a7ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:10cd6f3c-009b-4acc-9ca5-e50cb17e412c+6:2344:x1875765413030400:12345-192.168.201.39@tcp:8:mount.lustre.0 Request processed in 368us (646us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869396.798461:0:7884:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 12 00000100:00100000:3.0:1788869396.798473:0:7884:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 13 00000100:00100000:3.0:1788869396.798476:0:7884:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c835a7df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2344:x1875765413030528:12345-192.168.201.39@tcp:8:mount.lustre.0 00010000:00080000:3.0:1788869396.798486:0:7884:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0001: connection from 10cd6f3c-009b-4acc-9ca5-e50cb17e412c@192.168.201.39@tcp t0 exp 0000000000000000 cur 145 last 0 00000020:00000080:3.0:1788869396.798500:0:7884:0:(genops.c:1406:class_connect()) connect: client 10cd6f3c-009b-4acc-9ca5-e50cb17e412c, cookie 0x3d2d1916761d64d6 00002000:00100000:3.0:1788869396.798506:0:7884:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 10cd6f3c-009b-4acc-9ca5-e50cb17e412c/ffff94c835503000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113718 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1788869396.798520:0:7884:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:3.0:1788869396.798639:0:7884:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1788869396.798653:0:7884:0:(import.c:65:import_set_state_nolock()) ffff94c835501800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788869396.798680:0:7884:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c835a7df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:10cd6f3c-009b-4acc-9ca5-e50cb17e412c+6:2344:x1875765413030528:12345-192.168.201.39@tcp:8:mount.lustre.0 Request processed in 201us (814us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869396.798687:0:7884:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 13 00000100:00100000:0.0:1788869396.798992:0:5758:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765413030656 00000100:00100000:0.0:1788869396.798998:0:5758:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765413030656 00000100:00100000:0.0:1788869396.799038:0:5758:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 1 00000100:00100000:0.0:1788869396.799046:0:5758:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c835a7e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:10cd6f3c-009b-4acc-9ca5-e50cb17e412c+6:8070:x1875765413030656:12345-192.168.201.39@tcp:33:mount.lustre.0 00000004:00200000:0.0:1788869396.799305:0:5758:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000100:00100000:0.0:1788869396.799395:0:5758:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c835a7e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:10cd6f3c-009b-4acc-9ca5-e50cb17e412c+6:8070:x1875765413030656:12345-192.168.201.39@tcp:33:mount.lustre.0 Request processed in 350us (1477us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869396.799402:0:5758:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 1 00010000:00010000:2.0:1788869396.891528:0:7447:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788869397.595379:0:3284:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788869397.595401:0:3284:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94c82065ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3284:1875765421446144:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788869397.595472:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869397.595595:0:6548:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765421446144 00000100:00100000:2.0:1788869397.595603:0:6548:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765421446144 00000100:00100000:2.0:1788869397.595660:0:6548:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1788869397.595669:0:6548:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c82065f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3284:x1875765421446144:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788869397.595695:0:6548:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788869397.595754:0:6548:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c82065f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3284:x1875765421446144:12345-0@lo:13:osp-pre-0-0.0 Request processed in 86us (281us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869397.595761:0:6548:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00080000:3.0:1788869397.595806:0:5751:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1788869397.595812:0:3284:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff94c82065ca80 x1875765421446144/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788869413 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788869397.595832:0:3284:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94c82065ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3284:1875765421446144:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1788869397.918586:0:5742:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1788869398.664964:0:7458:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 10cd6f3c-009b-4acc-9ca5-e50cb17e412c 00000001:00100000:2.0:1788869398.666491:0:5777:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 10cd6f3c-009b-4acc-9ca5-e50cb17e412c 00000001:00100000:1.0:1788869398.669685:0:6571:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 10cd6f3c-009b-4acc-9ca5-e50cb17e412c 00010000:00010000:3.0:1788869398.939463:0:5743:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1788869399.948083:0:10120:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg139-client.virtnet: executing check_config_client /mnt/lustre 00010000:00010000:1.0:1788869399.966887:0:7447:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788869400.668035:0:3284:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94c82c840380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3284:1875765421446272:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788869400.668103:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869400.668163:0:6548:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765421446272 00000100:00100000:2.0:1788869400.668170:0:6548:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765421446272 00000100:00100000:2.0:1788869400.668234:0:6548:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1788869400.668244:0:6548:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c83fbb0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3284:x1875765421446272:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788869400.668352:0:6548:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788869400.668398:0:6548:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c83fbb0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3284:x1875765421446272:12345-0@lo:13:osp-pre-1-0.0 Request processed in 156us (294us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869400.668406:0:6548:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00010000:00080000:2.0:1788869400.668441:0:3284:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff94c82c840380 x1875765421446272/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788869416 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788869400.668459:0:3284:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94c82c840380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3284:1875765421446272:0@lo:13:osp-pre-1-0.0 00000100:00080000:3.0:1788869400.668530:0:5751:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788869400.677277:0:3283:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94c82065c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3283:1875765421446656:0@lo:400:kworker.0 00000100:00100000:2.0:1788869400.677303:0:3286:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94c82065f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3286:1875765421446528:0@lo:400:kworker.0 00000100:00100000:1.0:1788869400.677374:0:3285:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94c82065ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:121cd5bc-7f07-4cf7-8e2e-4356c89c0696:3285:1875765421446400:0@lo:400:kworker.0 00000100:00100000:3.0:1788869400.679512:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869400.679586:0:3283:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788869400.679601:0:3283:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94c82065d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3283:1875765421446784:0@lo:400:kworker.0 00000100:00100000:3.0:1788869400.679647:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869400.679701:0:7884:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765421446784 00000100:00100000:3.0:1788869400.679708:0:7884:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765421446784 00000100:00100000:3.0:1788869400.679767:0:7884:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1788869400.679776:0:7884:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c81f1f0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3283:x1875765421446784:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788869400.679897:0:5756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765421446656 00000100:00100000:0.0:1788869400.679903:0:5756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765421446656 00000100:00100000:0.0:1788869400.679934:0:5756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1788869400.679942:0:5756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c82065e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3283:x1875765421446656:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788869400.681621:0:5756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c82065e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3283:x1875765421446656:12345-0@lo:400:kworker.0 Request processed in 1673us (2109us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869400.681634:0:5756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1788869400.681880:0:7884:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c81f1f0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3283:x1875765421446784:12345-0@lo:400:kworker.0 Request processed in 2104us (2231us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869400.681889:0:7884:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00080000:3.0:1788869400.681921:0:5751:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788869400.681926:0:5751:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788869400.682177:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:3.0:1788869400.682231:0:3283:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff94c82065d500 x1875765421446784/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788869416 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788869400.682245:0:3283:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94c82065d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3283:1875765421446784:0@lo:400:kworker.0 00000100:00100000:3.0:1788869400.682300:0:3283:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94c82065c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3283:1875765421446656:0@lo:400:kworker.0 00000100:00100000:2.0:1788869400.682353:0:5755:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765421446528 00000100:00100000:2.0:1788869400.682360:0:5755:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765421446528 00000100:00100000:2.0:1788869400.684194:0:5755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1788869400.684209:0:5755:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c82c840380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3286:x1875765421446528:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788869400.684302:0:5755:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c82c840380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3286:x1875765421446528:12345-0@lo:400:kworker.0 Request processed in 99us (2125us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869400.684309:0:5755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1788869400.684355:0:3286:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94c82065f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3286:1875765421446528:0@lo:400:kworker.0 00000100:00100000:2.0:1788869400.686540:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869400.686601:0:3285:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94c82065df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3285:1875765421446912:0@lo:400:kworker.0 00000100:00100000:2.0:1788869400.686640:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869400.686722:0:5749:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765421446400 00000100:00100000:0.0:1788869400.686729:0:5749:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765421446400 00000100:00100000:0.0:1788869400.686775:0:5749:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 209 00000100:00100000:0.0:1788869400.686783:0:5749:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c81f148450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:121cd5bc-7f07-4cf7-8e2e-4356c89c0696+19:3285:x1875765421446400:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788869400.686840:0:5749:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c81f148450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:121cd5bc-7f07-4cf7-8e2e-4356c89c0696+19:3285:x1875765421446400:12345-0@lo:400:kworker.0 Request processed in 58us (307us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869400.686848:0:5749:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 209 00000100:00100000:2.0:1788869400.686922:0:3285:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94c82065ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:121cd5bc-7f07-4cf7-8e2e-4356c89c0696:3285:1875765421446400:0@lo:400:kworker.0 00000100:00100000:1.0:1788869400.692114:0:5756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765421446912 00000100:00100000:1.0:1788869400.692128:0:5756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765421446912 00000100:00100000:1.0:1788869400.692196:0:5756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1788869400.692206:0:5756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c82c841c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3285:x1875765421446912:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788869400.692316:0:5756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c82c841c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3285:x1875765421446912:12345-0@lo:400:kworker.0 Request processed in 112us (5675us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869400.692324:0:5756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1788869400.692344:0:3285:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94c82065df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3285:1875765421446912:0@lo:400:kworker.0 00000100:00080000:3.0:1788869400.693062:0:5751:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1788869400.989008:0:5742:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788869402.011580:0:5743:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788869402.029046:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1788869402.029085:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1788869402.029093:0:5755:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765413030912 00000100:00100000:2.0:1788869402.029103:0:5755:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765413030912 00000100:00100000:1.0:1788869402.029128:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1788869402.029159:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1788869402.029175:0:5755:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765413031040 00000100:00100000:2.0:1788869402.029180:0:5755:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765413031040 00000100:00100000:2.0:1788869402.029207:0:5755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 45 00000100:00100000:2.0:1788869402.029216:0:5755:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c835a7c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2125b9b3-626e-4cbe-be83-fb446e976ce2+6:2346:x1875765413030912:12345-192.168.201.39@tcp:400:kworker.0 00000100:00100000:2.0:1788869402.029305:0:5755:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c835a7c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2125b9b3-626e-4cbe-be83-fb446e976ce2+6:2346:x1875765413030912:12345-192.168.201.39@tcp:400:kworker.0 Request processed in 89us (274us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869402.029315:0:5755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 45 00000100:00100000:2.0:1788869402.029335:0:5755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 46 00000100:00100000:2.0:1788869402.029342:0:5755:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c82d043480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:10cd6f3c-009b-4acc-9ca5-e50cb17e412c+5:2346:x1875765413031040:12345-192.168.201.39@tcp:400:kworker.0 00000100:00100000:2.0:1788869402.029368:0:5755:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c82d043480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:10cd6f3c-009b-4acc-9ca5-e50cb17e412c+5:2346:x1875765413031040:12345-192.168.201.39@tcp:400:kworker.0 Request processed in 27us (208us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869402.029374:0:5755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 46 00000100:00080000:2.0:1788869402.029391:0:5751:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788869402.031591:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1788869402.031734:0:5750:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765413030784 00000100:00100000:1.0:1788869402.031743:0:5750:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765413030784 00000100:00100000:1.0:1788869402.031794:0:5750:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 210 00000100:00100000:1.0:1788869402.031803:0:5750:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c81f149450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3cca3acf-4935-4d0d-9982-d5d931f1c86b+13:2346:x1875765413030784:12345-192.168.201.39@tcp:400:kworker.0 00000100:00100000:3.0:1788869402.031848:0:6544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765413031168 00000100:00100000:3.0:1788869402.031854:0:6544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765413031168 00000100:00100000:1.0:1788869402.031863:0:5750:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c81f149450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3cca3acf-4935-4d0d-9982-d5d931f1c86b+13:2346:x1875765413030784:12345-192.168.201.39@tcp:400:kworker.0 Request processed in 61us (2735us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869402.031872:0:5750:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 210 00000100:00100000:3.0:1788869402.031950:0:6544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765413031296 00000100:00100000:3.0:1788869402.031954:0:6544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765413031296 00000100:00100000:3.0:1788869402.032068:0:6544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 22 00000100:00100000:3.0:1788869402.032079:0:6544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c835a7ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:10cd6f3c-009b-4acc-9ca5-e50cb17e412c+5:2346:x1875765413031168:12345-192.168.201.39@tcp:400:kworker.0 00000100:00100000:3.0:1788869402.032167:0:6544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c835a7ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:10cd6f3c-009b-4acc-9ca5-e50cb17e412c+5:2346:x1875765413031168:12345-192.168.201.39@tcp:400:kworker.0 Request processed in 90us (3081us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869402.032175:0:6544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 22 00000100:00100000:3.0:1788869402.032194:0:6544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 23 00000100:00100000:3.0:1788869402.032202:0:6544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c82d042680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:10cd6f3c-009b-4acc-9ca5-e50cb17e412c+5:2346:x1875765413031296:12345-192.168.201.39@tcp:400:kworker.0 00000100:00080000:2.0:1788869402.032295:0:5751:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788869402.032300:0:5751:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788869402.032439:0:6544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c82d042680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:10cd6f3c-009b-4acc-9ca5-e50cb17e412c+5:2346:x1875765413031296:12345-192.168.201.39@tcp:400:kworker.0 Request processed in 237us (855us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869402.032448:0:6544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 23 00000100:00100000:1.0:1788869402.715468:0:3285:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788869402.715492:0:3285:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94c82065df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3285:1875765421447040:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788869402.715560:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869402.716077:0:6549:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765421447040 00000100:00100000:3.0:1788869402.716087:0:6549:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765421447040 00000100:00100000:3.0:1788869402.716156:0:6549:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1788869402.716169:0:6549:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c82d043100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3285:x1875765421447040:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788869402.716205:0:6549:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788869402.716301:0:6549:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c82d043100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3285:x1875765421447040:12345-0@lo:13:osp-pre-0-0.0 Request processed in 136us (741us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869402.716309:0:6549:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00080000:3.0:1788869402.716346:0:5751:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1788869402.721127:0:3285:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff94c82065df80 x1875765421447040/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788869418 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788869402.721153:0:3285:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94c82065df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3285:1875765421447040:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1788869403.035786:0:7447:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788869404.061934:0:5742:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788869405.083457:0:5743:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788869405.787572:0:3284:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94c82065f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3284:1875765421447296:0@lo:400:kworker.0 00000100:00100000:3.0:1788869405.787636:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869405.787681:0:3284:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94c82cdc4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3284:1875765421447808:0@lo:400:kworker.0 00000100:00100000:3.0:1788869405.787711:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869405.787736:0:3284:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1788869405.787740:0:3284:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94c82065ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:121cd5bc-7f07-4cf7-8e2e-4356c89c0696:3284:1875765421447168:0@lo:400:kworker.0 00000100:00100000:3.0:1788869405.787757:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869405.787769:0:3284:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94c82065df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3284:1875765421447680:0@lo:400:kworker.0 00000100:00100000:3.0:1788869405.787781:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869405.787795:0:3285:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94c82065c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3285:1875765421447424:0@lo:400:kworker.0 00000100:00100000:3.0:1788869405.787807:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869405.787817:0:3285:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788869405.787826:0:3285:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94c82065d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3285:1875765421447552:0@lo:400:kworker.0 00000100:00100000:3.0:1788869405.787842:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869405.787870:0:5755:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765421447296 00000100:00100000:3.0:1788869405.787877:0:5755:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765421447296 00000100:00100000:3.0:1788869405.787911:0:5755:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765421447680 00000100:00100000:3.0:1788869405.787913:0:5755:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765421447680 00000100:00100000:3.0:1788869405.787926:0:5755:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765421447424 00000100:00100000:3.0:1788869405.787927:0:5755:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765421447424 00000100:00100000:3.0:1788869405.787937:0:5755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1788869405.787942:0:5755:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c82cdc7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3284:x1875765421447296:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788869405.787977:0:5755:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c82cdc7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3284:x1875765421447296:12345-0@lo:400:kworker.0 Request processed in 36us (342us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869405.787982:0:5755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1788869405.787993:0:5755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1788869405.787996:0:5755:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c83c6f3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3284:x1875765421447680:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788869405.788010:0:5755:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c83c6f3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3284:x1875765421447680:12345-0@lo:400:kworker.0 Request processed in 14us (229us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869405.788014:0:5755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1788869405.788020:0:5755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1788869405.788023:0:5755:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c83c6f2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3285:x1875765421447424:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788869405.788038:0:5755:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c83c6f2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3285:x1875765421447424:12345-0@lo:400:kworker.0 Request processed in 15us (230us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869405.788042:0:5755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1788869405.788052:0:7884:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765421447808 00000100:00100000:3.0:1788869405.788054:0:7884:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765421447808 00000100:00100000:3.0:1788869405.788069:0:7884:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765421447552 00000100:00100000:3.0:1788869405.788070:0:7884:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765421447552 00000100:00100000:3.0:1788869405.788080:0:7884:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1788869405.788089:0:7884:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c83c6f0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3284:x1875765421447808:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788869405.788108:0:7884:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c83c6f0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3284:x1875765421447808:12345-0@lo:400:kworker.0 Request processed in 20us (397us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869405.788112:0:7884:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1788869405.788123:0:7884:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1788869405.788131:0:7884:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c83c6f1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3285:x1875765421447552:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788869405.788159:0:7884:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c83c6f1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3285:x1875765421447552:12345-0@lo:400:kworker.0 Request processed in 30us (316us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869405.788165:0:7884:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1788869405.788184:0:5748:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765421447168 00000100:00100000:3.0:1788869405.788187:0:5748:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765421447168 00000100:00100000:3.0:1788869405.788219:0:5748:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 211 00000100:00100000:3.0:1788869405.788225:0:5748:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c81f148850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:121cd5bc-7f07-4cf7-8e2e-4356c89c0696+19:3284:x1875765421447168:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788869405.788272:0:5748:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c81f148850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:121cd5bc-7f07-4cf7-8e2e-4356c89c0696+19:3284:x1875765421447168:12345-0@lo:400:kworker.0 Request processed in 47us (513us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869405.788278:0:5748:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 211 00000100:00080000:3.0:1788869405.788317:0:5751:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788869405.788321:0:5751:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788869405.788323:0:5751:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1788869405.788347:0:3285:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff94c82065d500 x1875765421447552/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788869421 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788869405.788357:0:3285:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94c82065d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3285:1875765421447552:0@lo:400:kworker.0 00000100:00100000:3.0:1788869405.788363:0:3285:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94c82065c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3285:1875765421447424:0@lo:400:kworker.0 00000100:00100000:3.0:1788869405.788379:0:3284:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94c82065ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:121cd5bc-7f07-4cf7-8e2e-4356c89c0696:3284:1875765421447168:0@lo:400:kworker.0 00000100:00100000:3.0:1788869405.788384:0:3284:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94c82065df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3284:1875765421447680:0@lo:400:kworker.0 00000100:00100000:3.0:1788869405.788415:0:3284:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94c82065f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3284:1875765421447296:0@lo:400:kworker.0 00010000:00080000:3.0:1788869405.788428:0:3284:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff94c82cdc4000 x1875765421447808/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788869421 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788869405.788438:0:3284:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94c82cdc4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3284:1875765421447808:0@lo:400:kworker.0 00000100:00100000:2.0:1788869405.788563:0:3285:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94c83c6f3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3285:1875765421447936:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788869405.788624:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869405.788663:0:6549:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765421447936 00000100:00100000:0.0:1788869405.788669:0:6549:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765421447936 00000100:00100000:0.0:1788869405.788716:0:6549:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1788869405.788725:0:6549:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c83c6f0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3285:x1875765421447936:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788869405.788756:0:6549:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788869405.788807:0:6549:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c83c6f0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3285:x1875765421447936:12345-0@lo:13:osp-pre-1-0.0 Request processed in 84us (182us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869405.788816:0:6549:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00010000:00080000:3.0:1788869405.788832:0:3285:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff94c83c6f3b80 x1875765421447936/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788869421 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788869405.788848:0:3285:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94c83c6f3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3285:1875765421447936:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1788869406.108365:0:7447:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788869407.131597:0:5742:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788869407.155964:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1788869407.156001:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1788869407.156026:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1788869407.156046:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1788869407.156087:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1788869407.156116:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765413031552 00000100:00100000:2.0:1788869407.156128:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765413031552 00000100:00100000:2.0:1788869407.156174:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765413031680 00000100:00100000:2.0:1788869407.156176:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765413031680 00000100:00100000:2.0:1788869407.156195:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 50 00000100:00100000:2.0:1788869407.156203:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c82c843480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2125b9b3-626e-4cbe-be83-fb446e976ce2+6:2346:x1875765413031552:12345-192.168.201.39@tcp:400:kworker.0 00000100:00100000:2.0:1788869407.156287:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c82c843480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2125b9b3-626e-4cbe-be83-fb446e976ce2+6:2346:x1875765413031552:12345-192.168.201.39@tcp:400:kworker.0 Request processed in 84us (284us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869407.156294:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 50 00000100:00100000:2.0:1788869407.156310:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 51 00000100:00100000:2.0:1788869407.156316:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c82c842d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:10cd6f3c-009b-4acc-9ca5-e50cb17e412c+5:2346:x1875765413031680:12345-192.168.201.39@tcp:400:kworker.0 00000100:00100000:2.0:1788869407.156338:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c82c842d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:10cd6f3c-009b-4acc-9ca5-e50cb17e412c+5:2346:x1875765413031680:12345-192.168.201.39@tcp:400:kworker.0 Request processed in 23us (312us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869407.156344:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 51 00000100:00100000:2.0:1788869407.156359:0:7884:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765413031808 00000100:00100000:2.0:1788869407.156362:0:7884:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765413031808 00000100:00100000:2.0:1788869407.156397:0:7884:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765413031936 00000100:00100000:2.0:1788869407.156401:0:7884:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765413031936 00000100:00100000:2.0:1788869407.156419:0:7884:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 26 00000100:00100000:2.0:1788869407.156426:0:7884:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c82c841500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:10cd6f3c-009b-4acc-9ca5-e50cb17e412c+5:2346:x1875765413031808:12345-192.168.201.39@tcp:400:kworker.0 00000100:00100000:2.0:1788869407.156453:0:7884:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c82c841500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:10cd6f3c-009b-4acc-9ca5-e50cb17e412c+5:2346:x1875765413031808:12345-192.168.201.39@tcp:400:kworker.0 Request processed in 28us (406us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869407.156459:0:7884:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 26 00000100:00100000:2.0:1788869407.156470:0:7884:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 27 00000100:00100000:2.0:1788869407.156477:0:7884:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c810e6ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:10cd6f3c-009b-4acc-9ca5-e50cb17e412c+5:2346:x1875765413031936:12345-192.168.201.39@tcp:400:kworker.0 00000100:00100000:2.0:1788869407.156499:0:7884:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c810e6ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:10cd6f3c-009b-4acc-9ca5-e50cb17e412c+5:2346:x1875765413031936:12345-192.168.201.39@tcp:400:kworker.0 Request processed in 22us (411us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869407.156510:0:7884:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 27 00000100:00080000:2.0:1788869407.156525:0:5751:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788869407.156528:0:5751:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788869407.156529:0:5751:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788869407.157287:0:5749:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765413031424 00000100:00100000:0.0:1788869407.157292:0:5749:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765413031424 00000100:00100000:0.0:1788869407.157319:0:5749:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 212 00000100:00100000:0.0:1788869407.157324:0:5749:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c81f149850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3cca3acf-4935-4d0d-9982-d5d931f1c86b+13:2346:x1875765413031424:12345-192.168.201.39@tcp:400:kworker.0 00000100:00100000:0.0:1788869407.157352:0:5749:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c81f149850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3cca3acf-4935-4d0d-9982-d5d931f1c86b+13:2346:x1875765413031424:12345-192.168.201.39@tcp:400:kworker.0 Request processed in 28us (1398us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869407.157356:0:5749:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 212 00000100:00100000:1.0:1788869407.835668:0:3285:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788869407.835690:0:3285:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94c83c6f3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3285:1875765421448064:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788869407.835755:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869407.835818:0:6548:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765421448064 00000100:00100000:3.0:1788869407.835825:0:6548:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765421448064 00000100:00100000:3.0:1788869407.835878:0:6548:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1788869407.835889:0:6548:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c803fbb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3285:x1875765421448064:12345-0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1788869407.835902:0:5751:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00000024:3.0:1788869407.835926:0:6548:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788869407.835980:0:6548:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c803fbb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3285:x1875765421448064:12345-0@lo:13:osp-pre-0-0.0 Request processed in 92us (223us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869407.835988:0:6548:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00010000:00080000:1.0:1788869407.836027:0:3285:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff94c83c6f3b80 x1875765421448064/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788869423 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788869407.836046:0:3285:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94c83c6f3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3285:1875765421448064:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1788869408.155570:0:5743:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1788869408.348733:0:10820:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:0.0:1788869409.183440:0:7447:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788869410.204300:0:5742:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1788869410.225276:0:10969:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffd926740e0 20000000:00000080:2.0:1788869410.225301:0:10969:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff94c82cdf8800 uarg=0000000000000000 20000000:01000000:3.0:1788869410.225668:0:10969:0:(mgs_llog.c:6188:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:3.0:1788869410.225675:0:10969:0:(mgs_llog.c:4643:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:3.0:1788869410.225681:0:10969:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:0.0:1788869410.226720:0:10970:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 7 20000000:00000400:3.0:1788869410.226908:0:10969:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:3.0:1788869410.233607:0:10969:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:3.0:1788869410.233651:0:10969:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff94c83504cc00/0x3d2d1916761d64dd lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 10969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869410.233679:0:10969:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff94c80153b000/0x3d2d1916761d6420 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.201.39@tcp remote: 0x375c01024903577c expref: 12 pid: 5749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869410.233708:0:10969:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff94c818d1f600/0x3d2d1916761d644a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3d2d1916761d6443 expref: 18 pid: 5750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869410.233716:0:10969:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff94c800030e00/0x3d2d1916761d6474 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3d2d1916761d646d expref: 18 pid: 5750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869410.233723:0:10969:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff94c8421f3c00/0x3d2d1916761d649e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3d2d1916761d6497 expref: 18 pid: 5749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869410.233730:0:10969:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff94c83504ca00/0x3d2d1916761d64c1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.201.39@tcp remote: 0x375c0102490357b4 expref: 12 pid: 5748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869410.233739:0:10969:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff94c83504cc00/0x3d2d1916761d64dd lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 10969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869410.233795:0:10969:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff94c83504ca00/0x3d2d1916761d64c1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.201.39@tcp remote: 0x375c0102490357b4 expref: 12 pid: 5748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869410.233812:0:10969:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff94c83504ca00/0x3d2d1916761d64c1 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.201.39@tcp remote: 0x375c0102490357b4 expref: 12 pid: 5748 timeout: 258 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788869410.233830:0:10969:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94c83c6f0000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10969:1875765421448192:192.168.201.39@tcp:104: 00010000:00010000:3.0:1788869410.233972:0:10969:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff94c8421f3c00/0x3d2d1916761d649e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x3d2d1916761d6497 expref: 18 pid: 5749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869410.233981:0:10969:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff94c8421f3c00/0x3d2d1916761d649e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x3d2d1916761d6497 expref: 18 pid: 5749 timeout: 308 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788869410.233991:0:10969:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94c83c6f3480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10969:1875765421448320:0@lo:104: 00000100:00100000:3.0:1788869410.234125:0:10969:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788869410.234503:0:10969:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff94c800030e00/0x3d2d1916761d6474 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x3d2d1916761d646d expref: 18 pid: 5750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869410.234512:0:10969:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff94c800030e00/0x3d2d1916761d6474 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x3d2d1916761d646d expref: 18 pid: 5750 timeout: 308 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788869410.234521:0:10969:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94c83c6f2d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10969:1875765421448448:0@lo:104: 00000100:00100000:3.0:1788869410.234549:0:10969:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788869410.234947:0:10969:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff94c818d1f600/0x3d2d1916761d644a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x3d2d1916761d6443 expref: 18 pid: 5750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869410.234956:0:10969:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff94c818d1f600/0x3d2d1916761d644a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x3d2d1916761d6443 expref: 18 pid: 5750 timeout: 308 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788869410.234964:0:10969:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94c83c6f3100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10969:1875765421448576:0@lo:104: 00000100:00100000:3.0:1788869410.234986:0:10969:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869410.235014:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765421448320 00000100:00100000:0.0:1788869410.235022:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765421448320 00000100:00100000:2.0:1788869410.235082:0:5738:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765421448448 00000100:00100000:2.0:1788869410.235086:0:5738:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765421448448 00000100:00100000:2.0:1788869410.235127:0:5738:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1788869410.235138:0:5738:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c83c6f1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:121cd5bc-7f07-4cf7-8e2e-4356c89c0696+4:10969:x1875765421448320:12345-0@lo:104: 00010000:00010000:2.0:1788869410.235153:0:5738:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.139@tcp lock: ffff94c83504d600/0x3d2d1916761d6497 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x3d2d1916761d649e expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869410.235216:0:5738:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788869410.235222:0:5738:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c83c6f1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:121cd5bc-7f07-4cf7-8e2e-4356c89c0696+4:10969:x1875765421448320:12345-0@lo:104: Request processed in 87us (1098us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869410.235230:0:5738:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1788869410.235459:0:5738:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1788869410.235467:0:5738:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c83c6f1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:121cd5bc-7f07-4cf7-8e2e-4356c89c0696+3:10969:x1875765421448448:12345-0@lo:104: 00010000:00010000:2.0:1788869410.235476:0:5738:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.139@tcp lock: ffff94c800030400/0x3d2d1916761d646d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x3d2d1916761d6474 expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869410.235514:0:5738:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1788869410.235519:0:5738:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c83c6f1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:121cd5bc-7f07-4cf7-8e2e-4356c89c0696+3:10969:x1875765421448448:12345-0@lo:104: Request processed in 54us (970us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869410.235526:0:5738:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00010000:00010000:2.0:1788869410.235554:0:5743:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788869410.235561:0:5743:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.139@tcp lock: ffff94c83504d600/0x3d2d1916761d6497 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x3d2d1916761d649e expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869410.235569:0:5743:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94c83504d600 already unused, calling callback (ffffffffc1ce9c20) 10000000:00010000:2.0:1788869410.235573:0:5743:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.139@tcp lock: ffff94c83504d600/0x3d2d1916761d6497 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x3d2d1916761d649e expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869410.235582:0:5743:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.139@tcp lock: ffff94c83504d600/0x3d2d1916761d6497 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x3d2d1916761d649e expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788869410.235590:0:5743:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.139@tcp lock: ffff94c83504d600/0x3d2d1916761d6497 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x3d2d1916761d649e expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788869410.235597:0:5743:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1788869410.235629:0:5743:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.139@tcp lock: ffff94c83504d600/0x3d2d1916761d6497 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3d2d1916761d649e expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869410.235636:0:5743:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788869410.235659:0:5743:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.139@tcp lock: ffff94c83504d600/0x3d2d1916761d6497 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3d2d1916761d649e expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869410.235667:0:5743:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.139@tcp lock: ffff94c83504d600/0x3d2d1916761d6497 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3d2d1916761d649e expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869410.235677:0:5743:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788869410.235680:0:5743:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.139@tcp lock: ffff94c800030400/0x3d2d1916761d646d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x3d2d1916761d6474 expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869410.235686:0:5743:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94c800030400 already unused, calling callback (ffffffffc1ce9c20) 10000000:00010000:2.0:1788869410.235689:0:5743:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.139@tcp lock: ffff94c800030400/0x3d2d1916761d646d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x3d2d1916761d6474 expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869410.235702:0:5743:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.139@tcp lock: ffff94c800030400/0x3d2d1916761d646d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x3d2d1916761d6474 expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788869410.235709:0:5743:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.139@tcp lock: ffff94c800030400/0x3d2d1916761d646d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x3d2d1916761d6474 expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788869410.235715:0:5743:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1788869410.235728:0:5743:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.139@tcp lock: ffff94c800030400/0x3d2d1916761d646d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3d2d1916761d6474 expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869410.235734:0:5743:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788869410.235739:0:5743:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.139@tcp lock: ffff94c800030400/0x3d2d1916761d646d lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3d2d1916761d6474 expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869410.235746:0:5743:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.139@tcp lock: ffff94c800030400/0x3d2d1916761d646d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3d2d1916761d6474 expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869410.235755:0:5743:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788869410.235756:0:5743:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788869410.235758:0:5743:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788869410.235772:0:3284:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94c810e6b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:121cd5bc-7f07-4cf7-8e2e-4356c89c0696:3284:1875765421448832:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788869410.235803:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869410.235832:0:3284:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788869410.235838:0:3284:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94c810e69500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:121cd5bc-7f07-4cf7-8e2e-4356c89c0696:3284:1875765421448704:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788869410.235860:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869410.235886:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765421448832 00000100:00100000:2.0:1788869410.235890:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765421448832 00010000:00010000:2.0:1788869410.235910:0:5788:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff94c800030e00/0x3d2d1916761d6474 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3d2d1916761d646d expref: 19 pid: 5750 timeout: 308 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788869410.235942:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765421448704 00000100:00100000:2.0:1788869410.235946:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765421448704 00010000:00010000:2.0:1788869410.235958:0:5788:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff94c8421f3c00/0x3d2d1916761d649e lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3d2d1916761d6497 expref: 20 pid: 5749 timeout: 308 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788869410.235975:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1788869410.235981:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c810ef3850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:121cd5bc-7f07-4cf7-8e2e-4356c89c0696+20:3284:x1875765421448832:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788869410.235992:0:5788:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788869410.235997:0:5788:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff94c800030e00/0x3d2d1916761d6474 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3d2d1916761d646d expref: 20 pid: 5750 timeout: 308 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869410.236006:0:5788:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff94c800030e00/0x3d2d1916761d6474 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x3d2d1916761d646d expref: 20 pid: 5750 timeout: 308 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869410.236024:0:5788:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788869410.236051:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c810ef3850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:121cd5bc-7f07-4cf7-8e2e-4356c89c0696+20:3284:x1875765421448832:12345-0@lo:103:ldlm_bl.0 Request processed in 70us (248us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869410.236058:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1788869410.236100:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1788869410.236106:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c810e68700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:121cd5bc-7f07-4cf7-8e2e-4356c89c0696+19:3284:x1875765421448704:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788869410.236113:0:5788:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788869410.236117:0:5788:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff94c8421f3c00/0x3d2d1916761d649e lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3d2d1916761d6497 expref: 19 pid: 5749 timeout: 308 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869410.236125:0:5788:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff94c8421f3c00/0x3d2d1916761d649e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x3d2d1916761d6497 expref: 19 pid: 5749 timeout: 308 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869410.236135:0:5788:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788869410.236161:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c810e68700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:121cd5bc-7f07-4cf7-8e2e-4356c89c0696+19:3284:x1875765421448704:12345-0@lo:103:ldlm_bl.0 Request processed in 55us (300us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869410.236167:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1788869410.236211:0:3284:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94c810e69500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:121cd5bc-7f07-4cf7-8e2e-4356c89c0696:3284:1875765421448704:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788869410.236220:0:3284:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94c810e6b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:121cd5bc-7f07-4cf7-8e2e-4356c89c0696:3284:1875765421448832:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788869410.236486:0:7447:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788869410.236707:0:10969:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff94c80153b000/0x3d2d1916761d6420 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.201.39@tcp remote: 0x375c01024903577c expref: 12 pid: 5749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869410.236720:0:10969:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff94c80153b000/0x3d2d1916761d6420 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.201.39@tcp remote: 0x375c01024903577c expref: 12 pid: 5749 timeout: 258 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788869410.236732:0:10969:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94c83c6f1180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10969:1875765421448960:192.168.201.39@tcp:104: 00000100:00100000:3.0:1788869410.236790:0:10969:0:(client.c:2702:ptlrpc_set_wait()) set ffff94c83510e9c0 going to sleep for 11 seconds 00010000:00010000:3.0:1788869410.236805:0:10969:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff94c8421f3c00/0x3d2d1916761d649e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x3d2d1916761d6497 expref: 18 pid: 5749 timeout: 308 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788869410.236817:0:10969:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94c83c6f3480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10969:1875765421448320:0@lo:104: 00010000:00010000:3.0:1788869410.236826:0:10969:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff94c800030e00/0x3d2d1916761d6474 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x3d2d1916761d646d expref: 17 pid: 5750 timeout: 308 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788869410.236844:0:10969:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94c83c6f2d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10969:1875765421448448:0@lo:104: 00000100:00100000:2.0:1788869410.237126:0:5738:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765421448576 00000100:00100000:2.0:1788869410.237132:0:5738:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765421448576 00000100:00100000:2.0:1788869410.237167:0:5738:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1788869410.237174:0:5738:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c83c6f0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:121cd5bc-7f07-4cf7-8e2e-4356c89c0696+3:10969:x1875765421448576:12345-0@lo:104: 00010000:00010000:2.0:1788869410.237183:0:5738:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.139@tcp lock: ffff94c800030c00/0x3d2d1916761d6443 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x3d2d1916761d644a expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869410.237233:0:5738:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788869410.237239:0:5738:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c83c6f0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:121cd5bc-7f07-4cf7-8e2e-4356c89c0696+3:10969:x1875765421448576:12345-0@lo:104: Request processed in 66us (2253us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869410.237246:0:5738:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00010000:00010000:2.0:1788869410.237286:0:5742:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788869410.237291:0:5742:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.139@tcp lock: ffff94c800030c00/0x3d2d1916761d6443 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x3d2d1916761d644a expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869410.237298:0:5742:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94c800030c00 already unused, calling callback (ffffffffc1ce9c20) 10000000:00010000:2.0:1788869410.237302:0:5742:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.139@tcp lock: ffff94c800030c00/0x3d2d1916761d6443 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x3d2d1916761d644a expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869410.237310:0:5742:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.139@tcp lock: ffff94c800030c00/0x3d2d1916761d6443 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x3d2d1916761d644a expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788869410.237327:0:5742:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.139@tcp lock: ffff94c800030c00/0x3d2d1916761d6443 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x3d2d1916761d644a expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788869410.237339:0:5742:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1788869410.237363:0:5742:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.139@tcp lock: ffff94c800030c00/0x3d2d1916761d6443 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3d2d1916761d644a expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869410.237370:0:5742:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788869410.237389:0:5742:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.139@tcp lock: ffff94c800030c00/0x3d2d1916761d6443 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3d2d1916761d644a expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869410.237397:0:5742:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.139@tcp lock: ffff94c800030c00/0x3d2d1916761d6443 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3d2d1916761d644a expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869410.237410:0:5742:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788869410.237412:0:5742:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788869410.237414:0:5742:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788869410.237424:0:3285:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94c810e6b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:121cd5bc-7f07-4cf7-8e2e-4356c89c0696:3285:1875765421449088:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788869410.237453:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869410.237653:0:10969:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94c83c6f3100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10969:1875765421448576:0@lo:104: 00000100:00100000:0.0:1788869410.237731:0:5739:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765421449088 00000100:00100000:0.0:1788869410.237735:0:5739:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765421449088 00010000:00010000:0.0:1788869410.237757:0:5739:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff94c818d1f600/0x3d2d1916761d644a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3d2d1916761d6443 expref: 17 pid: 5750 timeout: 308 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788869410.237851:0:5739:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1788869410.237859:0:5739:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c810e69500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:121cd5bc-7f07-4cf7-8e2e-4356c89c0696+17:3285:x1875765421449088:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788869410.237869:0:5739:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788869410.237875:0:5739:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff94c818d1f600/0x3d2d1916761d644a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3d2d1916761d6443 expref: 17 pid: 5750 timeout: 308 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869410.237884:0:5739:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff94c818d1f600/0x3d2d1916761d644a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x3d2d1916761d6443 expref: 17 pid: 5750 timeout: 308 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869410.237898:0:5739:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff94c818d1f600/0x3d2d1916761d644a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x3d2d1916761d6443 expref: 17 pid: 5750 timeout: 308 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869410.237910:0:5739:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788869410.237945:0:5739:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c810e69500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:121cd5bc-7f07-4cf7-8e2e-4356c89c0696+16:3285:x1875765421449088:12345-0@lo:103:ldlm_bl.0 Request processed in 88us (492us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869410.237952:0:5739:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1788869410.238005:0:3285:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94c810e6b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:121cd5bc-7f07-4cf7-8e2e-4356c89c0696:3285:1875765421449088:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788869410.238737:0:10969:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94c83c6f0000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10969:1875765421448192:192.168.201.39@tcp:104: 00000100:00100000:2.0:1788869410.239662:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1788869410.239725:0:7448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765413032064 00000100:00100000:3.0:1788869410.239732:0:7448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765413032064 00010000:00010000:3.0:1788869410.239799:0:7448:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff94c83504ca00/0x3d2d1916761d64c1 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.201.39@tcp remote: 0x375c0102490357b4 expref: 13 pid: 5748 timeout: 258 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788869410.239831:0:7448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 28 00000100:00100000:3.0:1788869410.239840:0:7448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c810e6b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:3cca3acf-4935-4d0d-9982-d5d931f1c86b+13:2348:x1875765413032064:12345-192.168.201.39@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788869410.239852:0:7448:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788869410.239955:0:7448:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff94c83504ca00/0x3d2d1916761d64c1 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.201.39@tcp remote: 0x375c0102490357b4 expref: 13 pid: 5748 timeout: 258 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869410.239964:0:7448:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff94c83504ca00/0x3d2d1916761d64c1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.201.39@tcp remote: 0x375c0102490357b4 expref: 13 pid: 5748 timeout: 258 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869410.239978:0:7448:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff94c83504ca00/0x3d2d1916761d64c1 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.201.39@tcp remote: 0x375c0102490357b4 expref: 13 pid: 5748 timeout: 258 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869410.239988:0:7448:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788869410.240845:0:7448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c810e6b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:3cca3acf-4935-4d0d-9982-d5d931f1c86b+12:2348:x1875765413032064:12345-192.168.201.39@tcp:103:ldlm_bl.0 Request processed in 1004us (1184us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869410.240853:0:7448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 28 00000100:00100000:3.0:1788869410.242559:0:10969:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94c83c6f1180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10969:1875765421448960:192.168.201.39@tcp:104: 00010000:00010000:3.0:1788869410.242603:0:10969:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff94c83504cc00/0x3d2d1916761d64dd lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 10969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788869410.244853:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1788869410.244918:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765413032192 00000100:00100000:1.0:1788869410.244927:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765413032192 00010000:00010000:1.0:1788869410.244965:0:5788:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff94c80153b000/0x3d2d1916761d6420 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.201.39@tcp remote: 0x375c01024903577c expref: 12 pid: 5749 timeout: 258 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788869410.245015:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 29 00000100:00100000:1.0:1788869410.245026:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c83fbb0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3cca3acf-4935-4d0d-9982-d5d931f1c86b+12:2347:x1875765413032192:12345-192.168.201.39@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788869410.245043:0:5788:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788869410.245049:0:5788:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff94c80153b000/0x3d2d1916761d6420 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.201.39@tcp remote: 0x375c01024903577c expref: 12 pid: 5749 timeout: 258 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869410.245063:0:5788:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff94c80153b000/0x3d2d1916761d6420 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.201.39@tcp remote: 0x375c01024903577c expref: 12 pid: 5749 timeout: 258 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869410.245085:0:5788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff94c80153b000/0x3d2d1916761d6420 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.201.39@tcp remote: 0x375c01024903577c expref: 12 pid: 5749 timeout: 258 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869410.245101:0:5788:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff94c83504cc00/0x3d2d1916761d64dd lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 10969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869410.245108:0:5788:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff94c83504cc00/0x3d2d1916761d64dd lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 10969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869410.245123:0:5788:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff94c83504cc00/0x3d2d1916761d64dd lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 10969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869410.245127:0:5788:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff94c83504cc00/0x3d2d1916761d64dd lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 10969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869410.245133:0:5788:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff94c83504cc00/0x3d2d1916761d64dd lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 10969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869410.245137:0:5788:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff94c83504cc00/0x3d2d1916761d64dd lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 10969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869410.245149:0:5788:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94c83504cc00 already unused, calling callback (ffffffffc1703220) 00010000:00010000:1.0:1788869410.245152:0:5788:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff94c83504cc00/0x3d2d1916761d64dd lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 10969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869410.245158:0:5788:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff94c83504cc00/0x3d2d1916761d64dd lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 10969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869410.245178:0:5788:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff94c83504cc00/0x3d2d1916761d64dd lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869410.245189:0:5788:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788869410.245232:0:10969:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff94c83504cc00/0x3d2d1916761d64dd lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869410.245240:0:10969:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff94c83504cc00/0x3d2d1916761d64dd lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788869410.245245:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c83fbb0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3cca3acf-4935-4d0d-9982-d5d931f1c86b+11:2347:x1875765413032192:12345-192.168.201.39@tcp:103:ldlm_bl.0 Request processed in 220us (398us total) trans 0 rc 0/0 00010000:00010000:3.0:1788869410.245247:0:10969:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff94c83504cc00/0x3d2d1916761d64dd lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788869410.245274:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 29 00000100:00100000:1.0:1788869410.908890:0:3286:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94c83c6f1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3286:1875765421449216:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788869410.908985:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869410.909405:0:3286:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94c83c6f3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3286:1875765421449728:0@lo:400:kworker.0 00000100:00100000:3.0:1788869410.909441:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869410.909465:0:3286:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788869410.909471:0:3286:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94c83c6f2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3286:1875765421449600:0@lo:400:kworker.0 00000100:00100000:3.0:1788869410.909497:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869410.909542:0:3284:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94c83c6f3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3284:1875765421449472:0@lo:400:kworker.0 00000100:00100000:3.0:1788869410.909566:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869410.909584:0:3284:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1788869410.909589:0:3284:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94c83c6f0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:121cd5bc-7f07-4cf7-8e2e-4356c89c0696:3284:1875765421449344:0@lo:400:kworker.0 00000100:00100000:3.0:1788869410.909618:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869410.909643:0:3284:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94c83c6f0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3284:1875765421449856:0@lo:400:kworker.0 00000100:00100000:3.0:1788869410.909664:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869410.909697:0:5750:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765421449344 00000100:00100000:3.0:1788869410.909705:0:5750:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765421449344 00000100:00100000:3.0:1788869410.909759:0:5750:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 213 00000100:00100000:3.0:1788869410.909769:0:5750:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c81f14a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:121cd5bc-7f07-4cf7-8e2e-4356c89c0696+16:3284:x1875765421449344:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788869410.909821:0:5750:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c81f14a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:121cd5bc-7f07-4cf7-8e2e-4356c89c0696+16:3284:x1875765421449344:12345-0@lo:400:kworker.0 Request processed in 53us (202us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869410.909845:0:5750:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 213 00000100:00100000:3.0:1788869410.909901:0:3284:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94c83c6f0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:121cd5bc-7f07-4cf7-8e2e-4356c89c0696:3284:1875765421449344:0@lo:400:kworker.0 00000100:00100000:3.0:1788869410.909932:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765421449600 00000100:00100000:3.0:1788869410.909936:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765421449600 00000100:00100000:3.0:1788869410.909971:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765421449472 00000100:00100000:3.0:1788869410.909974:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765421449472 00000100:00100000:3.0:1788869410.909985:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765421449856 00000100:00100000:3.0:1788869410.909987:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765421449856 00000100:00100000:3.0:1788869410.910001:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1788869410.910007:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c83c6f2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3286:x1875765421449600:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788869410.910042:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c83c6f2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3286:x1875765421449600:12345-0@lo:400:kworker.0 Request processed in 35us (544us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869410.910049:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1788869410.910060:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1788869410.910065:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c83c6f2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3284:x1875765421449472:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788869410.910093:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c83c6f2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3284:x1875765421449472:12345-0@lo:400:kworker.0 Request processed in 28us (526us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869410.910099:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1788869410.910109:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1788869410.910115:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c83c6f3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3284:x1875765421449856:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788869410.910139:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c83c6f3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3284:x1875765421449856:12345-0@lo:400:kworker.0 Request processed in 24us (474us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869410.910145:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1788869410.910161:0:7884:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765421449728 00000100:00100000:3.0:1788869410.910164:0:7884:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765421449728 00000100:00100000:3.0:1788869410.910190:0:7884:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1788869410.910205:0:7884:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c83c6f1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3286:x1875765421449728:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788869410.910234:0:7884:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c83c6f1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3286:x1875765421449728:12345-0@lo:400:kworker.0 Request processed in 30us (793us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869410.910241:0:7884:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1788869410.910406:0:3286:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94c83c6f2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3286:1875765421449600:0@lo:400:kworker.0 00010000:00080000:3.0:1788869410.910421:0:3286:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff94c83c6f3480 x1875765421449728/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788869426 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788869410.910432:0:3286:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94c83c6f3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3286:1875765421449728:0@lo:400:kworker.0 00000100:00100000:3.0:1788869410.910453:0:3284:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94c83c6f0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3284:1875765421449856:0@lo:400:kworker.0 00000100:00100000:3.0:1788869410.910462:0:3284:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94c83c6f3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3284:1875765421449472:0@lo:400:kworker.0 00000100:00080000:3.0:1788869410.910497:0:5751:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788869410.910503:0:5751:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788869410.911328:0:6549:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765421449216 00000100:00100000:1.0:1788869410.911337:0:6549:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765421449216 00000100:00100000:1.0:1788869410.911386:0:6549:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1788869410.911393:0:6549:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c803fb8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3286:x1875765421449216:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788869410.911431:0:6549:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788869410.911479:0:6549:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c803fb8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3286:x1875765421449216:12345-0@lo:13:osp-pre-1-0.0 Request processed in 87us (2495us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869410.911486:0:6549:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00080000:3.0:1788869410.911551:0:5751:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:3.0:1788869410.911574:0:3286:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff94c83c6f1180 x1875765421449216/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788869426 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788869410.911591:0:3286:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94c83c6f1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3286:1875765421449216:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1788869411.228628:0:5743:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1788869411.675338:0:5752:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1788869411.675345:0:5752:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff94c83f970800 from 7 10000000:01000000:1.0:1788869411.675350:0:5752:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788869411.675426:0:5752:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.139@tcp lock: ffff94c8421f3c00/0x3d2d1916761d64e4 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869411.675439:0:5752:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.139@tcp lock: ffff94c8421f3c00/0x3d2d1916761d64e4 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869411.675450:0:5752:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.139@tcp lock: ffff94c8421f3c00/0x3d2d1916761d64e4 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788869411.675474:0:5752:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94c702348380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:121cd5bc-7f07-4cf7-8e2e-4356c89c0696:5752:1875765421449984:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788869411.675542:0:5752:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869411.675598:0:5752:0:(client.c:2702:ptlrpc_set_wait()) set ffff94c835279300 going to sleep for 11 seconds 00000100:00100000:3.0:1788869411.675856:0:5748:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765421449984 00000100:00100000:3.0:1788869411.675862:0:5748:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765421449984 00000100:00100000:3.0:1788869411.675910:0:5748:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 214 00000100:00100000:3.0:1788869411.675919:0:5748:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c81f14bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:121cd5bc-7f07-4cf7-8e2e-4356c89c0696+16:5752:x1875765421449984:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788869411.675933:0:5748:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788869411.675947:0:5748:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff94c83504cc00/0x3d2d1916761d64eb lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x3d2d1916761d64e4 expref: -99 pid: 5748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869411.675968:0:5748:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff94c83504cc00/0x3d2d1916761d64eb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3d2d1916761d64e4 expref: 17 pid: 5748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869411.675988:0:5748:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff94c83504cc00/0x3d2d1916761d64eb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3d2d1916761d64e4 expref: 17 pid: 5748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869411.675998:0:5748:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94c83504cc00, rc 0) 00000100:00100000:3.0:1788869411.676039:0:5748:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c81f14bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:121cd5bc-7f07-4cf7-8e2e-4356c89c0696+17:5752:x1875765421449984:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 121us (497us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869411.676046:0:5748:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 214 00000100:00100000:1.0:1788869411.676072:0:5752:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94c702348380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:121cd5bc-7f07-4cf7-8e2e-4356c89c0696:5752:1875765421449984:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788869411.676087:0:5752:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.139@tcp lock: ffff94c8421f3c00/0x3d2d1916761d64e4 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3d2d1916761d64eb expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869411.676104:0:5752:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.139@tcp lock: ffff94c8421f3c00/0x3d2d1916761d64e4 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x3d2d1916761d64eb expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788869411.676166:0:5752:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94c702348380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:121cd5bc-7f07-4cf7-8e2e-4356c89c0696:5752:1875765421450112:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788869411.676191:0:5752:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869411.676215:0:5752:0:(client.c:2702:ptlrpc_set_wait()) set ffff94c835279300 going to sleep for 11 seconds 00000100:00100000:3.0:1788869411.676330:0:5749:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765421450112 00000100:00100000:3.0:1788869411.676334:0:5749:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765421450112 00000100:00100000:3.0:1788869411.676356:0:5749:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 215 00000100:00100000:3.0:1788869411.676363:0:5749:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c81f14a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:121cd5bc-7f07-4cf7-8e2e-4356c89c0696+17:5752:x1875765421450112:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788869411.676582:0:5749:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c81f14a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:121cd5bc-7f07-4cf7-8e2e-4356c89c0696+17:5752:x1875765421450112:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 218us (389us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869411.676590:0:5749:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 215 00000100:00100000:1.0:1788869411.676609:0:5752:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94c702348380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:121cd5bc-7f07-4cf7-8e2e-4356c89c0696:5752:1875765421450112:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788869411.676634:0:5752:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94c702348380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:121cd5bc-7f07-4cf7-8e2e-4356c89c0696:5752:1875765421450240:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788869411.676681:0:5752:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869411.676712:0:5752:0:(client.c:2702:ptlrpc_set_wait()) set ffff94c835279300 going to sleep for 11 seconds 00000100:00100000:3.0:1788869411.676839:0:5748:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765421450240 00000100:00100000:3.0:1788869411.676843:0:5748:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765421450240 00000100:00100000:3.0:1788869411.676866:0:5748:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 216 00000100:00100000:3.0:1788869411.676872:0:5748:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c81f14ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:121cd5bc-7f07-4cf7-8e2e-4356c89c0696+17:5752:x1875765421450240:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788869411.677020:0:5748:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c81f14ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:121cd5bc-7f07-4cf7-8e2e-4356c89c0696+17:5752:x1875765421450240:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 147us (339us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869411.677027:0:5748:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 216 00000100:00100000:1.0:1788869411.677046:0:5752:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94c702348380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:121cd5bc-7f07-4cf7-8e2e-4356c89c0696:5752:1875765421450240:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1788869411.677944:0:11070:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:3.0:1788869411.678328:0:5752:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:3.0:1788869411.678349:0:5752:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.139@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788869411.678358:0:5752:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.139@tcp lock: ffff94c8421f3c00/0x3d2d1916761d64e4 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3d2d1916761d64eb expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869411.678378:0:5752:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.139@tcp lock: ffff94c8421f3c00/0x3d2d1916761d64e4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3d2d1916761d64eb expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788869411.678388:0:5752:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1788869411.678391:0:5752:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff94c839dd4000 from 7 10000000:01000000:3.0:1788869411.678394:0:5752:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788869411.678415:0:5752:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.139@tcp lock: ffff94c83504ca00/0x3d2d1916761d64f2 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869411.678421:0:5752:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.139@tcp lock: ffff94c83504ca00/0x3d2d1916761d64f2 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869411.678427:0:5752:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.139@tcp lock: ffff94c83504ca00/0x3d2d1916761d64f2 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788869411.678442:0:5752:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94c83c6f1180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:121cd5bc-7f07-4cf7-8e2e-4356c89c0696:5752:1875765421450368:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788869411.678477:0:5752:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869411.678502:0:5749:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765421450368 00000100:00100000:3.0:1788869411.678505:0:5752:0:(client.c:2702:ptlrpc_set_wait()) set ffff94c83510e540 going to sleep for 11 seconds 00000100:00100000:0.0:1788869411.678509:0:5749:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765421450368 00000100:00100000:0.0:1788869411.678546:0:5749:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 217 00000100:00100000:0.0:1788869411.678555:0:5749:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c81f14b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:121cd5bc-7f07-4cf7-8e2e-4356c89c0696+17:5752:x1875765421450368:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788869411.678566:0:5749:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788869411.678576:0:5749:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff94c818d1f600/0x3d2d1916761d64f9 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x3d2d1916761d64f2 expref: -99 pid: 5749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869411.678594:0:5749:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff94c818d1f600/0x3d2d1916761d64f9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3d2d1916761d64f2 expref: 18 pid: 5749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869411.678609:0:5749:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff94c818d1f600/0x3d2d1916761d64f9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3d2d1916761d64f2 expref: 18 pid: 5749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869411.678617:0:5749:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94c818d1f600, rc 0) 00000100:00100000:0.0:1788869411.678676:0:5749:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c81f14b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:121cd5bc-7f07-4cf7-8e2e-4356c89c0696+18:5752:x1875765421450368:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 121us (198us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869411.678683:0:5749:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 217 00000100:00100000:1.0:1788869411.678686:0:5752:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94c83c6f1180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:121cd5bc-7f07-4cf7-8e2e-4356c89c0696:5752:1875765421450368:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788869411.678701:0:5752:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.139@tcp lock: ffff94c83504ca00/0x3d2d1916761d64f2 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x3d2d1916761d64f9 expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869411.678711:0:5752:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.139@tcp lock: ffff94c83504ca00/0x3d2d1916761d64f2 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x3d2d1916761d64f9 expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788869411.678751:0:5752:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94c702348380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:121cd5bc-7f07-4cf7-8e2e-4356c89c0696:5752:1875765421450496:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788869411.678774:0:5752:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869411.678790:0:5752:0:(client.c:2702:ptlrpc_set_wait()) set ffff94c835279240 going to sleep for 11 seconds 00000100:00100000:0.0:1788869411.678804:0:5748:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765421450496 00000100:00100000:0.0:1788869411.678809:0:5748:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765421450496 00000100:00100000:0.0:1788869411.678835:0:5748:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 218 00000100:00100000:0.0:1788869411.678843:0:5748:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c81f14b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:121cd5bc-7f07-4cf7-8e2e-4356c89c0696+18:5752:x1875765421450496:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788869411.679005:0:5748:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c81f14b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:121cd5bc-7f07-4cf7-8e2e-4356c89c0696+18:5752:x1875765421450496:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 163us (229us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869411.679012:0:5748:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 218 00000100:00100000:1.0:1788869411.679016:0:5752:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94c702348380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:121cd5bc-7f07-4cf7-8e2e-4356c89c0696:5752:1875765421450496:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788869411.679041:0:5752:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94c702348380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:121cd5bc-7f07-4cf7-8e2e-4356c89c0696:5752:1875765421450624:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788869411.679071:0:5752:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869411.679085:0:5752:0:(client.c:2702:ptlrpc_set_wait()) set ffff94c835279240 going to sleep for 11 seconds 00000100:00100000:0.0:1788869411.679094:0:5749:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765421450624 00000100:00100000:0.0:1788869411.679099:0:5749:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765421450624 00000100:00100000:0.0:1788869411.679119:0:5749:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 219 00000100:00100000:0.0:1788869411.679125:0:5749:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c81f0fd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:121cd5bc-7f07-4cf7-8e2e-4356c89c0696+18:5752:x1875765421450624:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788869411.679234:0:5749:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c81f0fd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:121cd5bc-7f07-4cf7-8e2e-4356c89c0696+18:5752:x1875765421450624:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 108us (161us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869411.679239:0:5752:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94c702348380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:121cd5bc-7f07-4cf7-8e2e-4356c89c0696:5752:1875765421450624:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788869411.679244:0:5749:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 219 00000040:00080000:1.0:1788869411.680054:0:11071:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:3.0:1788869411.680120:0:5752:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:3.0:1788869411.680137:0:5752:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.139@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788869411.680143:0:5752:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.139@tcp lock: ffff94c83504ca00/0x3d2d1916761d64f2 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x3d2d1916761d64f9 expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869411.680153:0:5752:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.139@tcp lock: ffff94c83504ca00/0x3d2d1916761d64f2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x3d2d1916761d64f9 expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788869411.680163:0:5752:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1788869411.680165:0:5752:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff94c805125000 from 7 10000000:01000000:3.0:1788869411.680168:0:5752:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788869411.680191:0:5752:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.139@tcp lock: ffff94c83504c800/0x3d2d1916761d6500 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869411.680208:0:5752:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.139@tcp lock: ffff94c83504c800/0x3d2d1916761d6500 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869411.680216:0:5752:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.139@tcp lock: ffff94c83504c800/0x3d2d1916761d6500 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788869411.680230:0:5752:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94c83c6f3100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:121cd5bc-7f07-4cf7-8e2e-4356c89c0696:5752:1875765421450752:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788869411.680286:0:5752:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869411.680412:0:5748:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765421450752 00000100:00100000:0.0:1788869411.680428:0:5748:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765421450752 00000100:00100000:3.0:1788869411.680432:0:5752:0:(client.c:2702:ptlrpc_set_wait()) set ffff94c83510e780 going to sleep for 11 seconds 00000100:00100000:0.0:1788869411.680460:0:5748:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 220 00000100:00100000:0.0:1788869411.680468:0:5748:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c81f0fc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:121cd5bc-7f07-4cf7-8e2e-4356c89c0696+18:5752:x1875765421450752:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788869411.680481:0:5748:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788869411.680496:0:5748:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff94c818d1f000/0x3d2d1916761d6507 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x3d2d1916761d6500 expref: -99 pid: 5748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869411.680517:0:5748:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff94c818d1f000/0x3d2d1916761d6507 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3d2d1916761d6500 expref: 19 pid: 5748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869411.680527:0:5748:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff94c818d1f000/0x3d2d1916761d6507 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3d2d1916761d6500 expref: 19 pid: 5748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869411.680534:0:5748:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94c818d1f000, rc 0) 00000100:00100000:0.0:1788869411.680567:0:5748:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c81f0fc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:121cd5bc-7f07-4cf7-8e2e-4356c89c0696+19:5752:x1875765421450752:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 100us (281us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869411.680574:0:5748:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 220 00000100:00100000:3.0:1788869411.680604:0:5752:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94c83c6f3100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:121cd5bc-7f07-4cf7-8e2e-4356c89c0696:5752:1875765421450752:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788869411.680617:0:5752:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.139@tcp lock: ffff94c83504c800/0x3d2d1916761d6500 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x3d2d1916761d6507 expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869411.680625:0:5752:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.139@tcp lock: ffff94c83504c800/0x3d2d1916761d6500 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x3d2d1916761d6507 expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788869411.680655:0:5752:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94c83c6f3100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:121cd5bc-7f07-4cf7-8e2e-4356c89c0696:5752:1875765421450880:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788869411.680678:0:5752:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869411.680695:0:5752:0:(client.c:2702:ptlrpc_set_wait()) set ffff94c83510e780 going to sleep for 11 seconds 00000100:00100000:0.0:1788869411.680719:0:5749:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765421450880 00000100:00100000:0.0:1788869411.680724:0:5749:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765421450880 00000100:00100000:0.0:1788869411.680748:0:5749:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 221 00000100:00100000:0.0:1788869411.680755:0:5749:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c81f0fd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:121cd5bc-7f07-4cf7-8e2e-4356c89c0696+19:5752:x1875765421450880:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788869411.680907:0:5749:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c81f0fd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:121cd5bc-7f07-4cf7-8e2e-4356c89c0696+19:5752:x1875765421450880:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 152us (228us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869411.680914:0:5749:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 221 00000100:00100000:3.0:1788869411.680932:0:5752:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94c83c6f3100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:121cd5bc-7f07-4cf7-8e2e-4356c89c0696:5752:1875765421450880:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788869411.680953:0:5752:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94c83c6f3100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:121cd5bc-7f07-4cf7-8e2e-4356c89c0696:5752:1875765421451008:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788869411.680984:0:5752:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869411.681011:0:5752:0:(client.c:2702:ptlrpc_set_wait()) set ffff94c83510e780 going to sleep for 11 seconds 00000100:00100000:0.0:1788869411.681033:0:5748:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765421451008 00000100:00100000:0.0:1788869411.681038:0:5748:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765421451008 00000100:00100000:0.0:1788869411.681064:0:5748:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 222 00000100:00100000:0.0:1788869411.681071:0:5748:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c81f0fe050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:121cd5bc-7f07-4cf7-8e2e-4356c89c0696+19:5752:x1875765421451008:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788869411.681185:0:5748:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c81f0fe050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:121cd5bc-7f07-4cf7-8e2e-4356c89c0696+19:5752:x1875765421451008:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 114us (200us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869411.681192:0:5748:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 222 00000100:00100000:3.0:1788869411.681216:0:5752:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94c83c6f3100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:121cd5bc-7f07-4cf7-8e2e-4356c89c0696:5752:1875765421451008:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1788869411.682283:0:11072:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:3.0:1788869411.682384:0:5752:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:3.0:1788869411.682399:0:5752:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.139@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788869411.682406:0:5752:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.139@tcp lock: ffff94c83504c800/0x3d2d1916761d6500 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x3d2d1916761d6507 expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869411.682421:0:5752:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.139@tcp lock: ffff94c83504c800/0x3d2d1916761d6500 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x3d2d1916761d6507 expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869412.252936:0:7447:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788869412.268103:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1788869412.268151:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1788869412.268178:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1788869412.268211:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1788869412.268240:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1788869412.268352:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765413032576 00000100:00100000:3.0:1788869412.268362:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765413032576 00000100:00100000:3.0:1788869412.268515:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765413032448 00000100:00100000:3.0:1788869412.268520:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765413032448 00000100:00100000:3.0:1788869412.268556:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 55 00000100:00100000:3.0:1788869412.268604:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c83c6f3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:10cd6f3c-009b-4acc-9ca5-e50cb17e412c+5:2345:x1875765413032576:12345-192.168.201.39@tcp:400:kworker.0 00000100:00100000:3.0:1788869412.268681:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c83c6f3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:10cd6f3c-009b-4acc-9ca5-e50cb17e412c+5:2345:x1875765413032576:12345-192.168.201.39@tcp:400:kworker.0 Request processed in 116us (529us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869412.268688:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 55 00000100:00100000:3.0:1788869412.268702:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 56 00000100:00100000:3.0:1788869412.268708:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c83c6f3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2125b9b3-626e-4cbe-be83-fb446e976ce2+6:2345:x1875765413032448:12345-192.168.201.39@tcp:400:kworker.0 00000100:00100000:3.0:1788869412.268729:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c83c6f3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2125b9b3-626e-4cbe-be83-fb446e976ce2+6:2345:x1875765413032448:12345-192.168.201.39@tcp:400:kworker.0 Request processed in 22us (519us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869412.268733:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 56 00000100:00100000:3.0:1788869412.268754:0:6547:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765413032832 00000100:00100000:3.0:1788869412.268756:0:6547:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765413032832 00000100:00100000:3.0:1788869412.268775:0:6547:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765413032704 00000100:00100000:3.0:1788869412.268776:0:6547:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765413032704 00000100:00100000:3.0:1788869412.268795:0:6547:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 29 00000100:00100000:3.0:1788869412.268800:0:6547:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c83c6f0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:10cd6f3c-009b-4acc-9ca5-e50cb17e412c+5:2345:x1875765413032832:12345-192.168.201.39@tcp:400:kworker.0 00000100:00100000:3.0:1788869412.268823:0:6547:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c83c6f0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:10cd6f3c-009b-4acc-9ca5-e50cb17e412c+5:2345:x1875765413032832:12345-192.168.201.39@tcp:400:kworker.0 Request processed in 24us (646us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869412.268827:0:6547:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 29 00000100:00100000:3.0:1788869412.268839:0:6547:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 30 00000100:00100000:3.0:1788869412.268844:0:6547:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c83c6f2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:10cd6f3c-009b-4acc-9ca5-e50cb17e412c+5:2345:x1875765413032704:12345-192.168.201.39@tcp:400:kworker.0 00000100:00100000:3.0:1788869412.268872:0:6547:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c83c6f2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:10cd6f3c-009b-4acc-9ca5-e50cb17e412c+5:2345:x1875765413032704:12345-192.168.201.39@tcp:400:kworker.0 Request processed in 29us (633us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869412.268877:0:6547:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 30 00000100:00080000:3.0:1788869412.268891:0:5751:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788869412.268894:0:5751:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788869412.268896:0:5751:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788869412.268917:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1788869412.269023:0:5750:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765413032320 00000100:00100000:3.0:1788869412.269027:0:5750:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765413032320 00000100:00100000:3.0:1788869412.269083:0:5750:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765413032960 00000100:00100000:3.0:1788869412.269087:0:5750:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765413032960 00000100:00100000:3.0:1788869412.269106:0:5750:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 223 00000100:00100000:3.0:1788869412.269113:0:5750:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c81f0ffc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3cca3acf-4935-4d0d-9982-d5d931f1c86b+12:2345:x1875765413032320:12345-192.168.201.39@tcp:400:kworker.0 00000100:00100000:3.0:1788869412.269143:0:5750:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c81f0ffc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3cca3acf-4935-4d0d-9982-d5d931f1c86b+12:2345:x1875765413032320:12345-192.168.201.39@tcp:400:kworker.0 Request processed in 32us (1051us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869412.269148:0:5750:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 223 00000100:00100000:3.0:1788869412.269172:0:5750:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 224 00000100:00100000:3.0:1788869412.269176:0:5750:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c81f0fe450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3cca3acf-4935-4d0d-9982-d5d931f1c86b+11:5555:x1875765413032960:12345-192.168.201.39@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788869412.269185:0:5750:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788869412.269203:0:5750:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff94c83504ce00/0x3d2d1916761d650e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x375c0102490357de expref: -99 pid: 5750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869412.269228:0:5750:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff94c83504ce00/0x3d2d1916761d650e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.201.39@tcp remote: 0x375c0102490357de expref: 12 pid: 5750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869412.269240:0:5750:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff94c83504ce00/0x3d2d1916761d650e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.201.39@tcp remote: 0x375c0102490357de expref: 12 pid: 5750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869412.269263:0:5750:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94c83504ce00, rc 0) 00000100:00100000:3.0:1788869412.269278:0:5750:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c81f0fe450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3cca3acf-4935-4d0d-9982-d5d931f1c86b+12:5555:x1875765413032960:12345-192.168.201.39@tcp:101:ll_cfg_requeue.0 Request processed in 102us (360us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869412.269294:0:5750:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 224 00000100:00100000:0.0:1788869412.280976:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1788869412.282385:0:5750:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765413033088 00000100:00100000:3.0:1788869412.282397:0:5750:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765413033088 00000100:00100000:3.0:1788869412.282491:0:5750:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 225 00000100:00100000:3.0:1788869412.282505:0:5750:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c81f0fec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3cca3acf-4935-4d0d-9982-d5d931f1c86b+12:5555:x1875765413033088:12345-192.168.201.39@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788869412.282830:0:5750:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c81f0fec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3cca3acf-4935-4d0d-9982-d5d931f1c86b+12:5555:x1875765413033088:12345-192.168.201.39@tcp:501:ll_cfg_requeue.0 Request processed in 321us (1854us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869412.282840:0:5750:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 225 00000100:00100000:3.0:1788869412.285753:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1788869412.285865:0:5749:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765413033216 00000100:00100000:0.0:1788869412.285878:0:5749:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765413033216 00000100:00100000:0.0:1788869412.285948:0:5749:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 226 00000100:00100000:0.0:1788869412.285961:0:5749:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c81f0ff850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3cca3acf-4935-4d0d-9982-d5d931f1c86b+12:5555:x1875765413033216:12345-192.168.201.39@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788869412.286363:0:5749:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c81f0ff850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3cca3acf-4935-4d0d-9982-d5d931f1c86b+12:5555:x1875765413033216:12345-192.168.201.39@tcp:503:ll_cfg_requeue.0 Request processed in 401us (620us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869412.286420:0:5749:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 226 00000100:00100000:0.0:1788869412.291783:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1788869412.291884:0:5750:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765413033344 00000100:00100000:1.0:1788869412.291897:0:5750:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765413033344 00000100:00100000:1.0:1788869412.291990:0:5750:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 227 00000100:00100000:1.0:1788869412.292003:0:5750:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c81f0ff450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3cca3acf-4935-4d0d-9982-d5d931f1c86b+12:5555:x1875765413033344:12345-192.168.201.39@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788869412.292025:0:5750:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788869412.292048:0:5750:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff94c8421f2800/0x3d2d1916761d6515 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x375c0102490357e5 expref: -99 pid: 5750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869412.292097:0:5750:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff94c8421f2800/0x3d2d1916761d6515 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.201.39@tcp remote: 0x375c0102490357e5 expref: 13 pid: 5750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869412.292109:0:5750:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff94c8421f2800/0x3d2d1916761d6515 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.201.39@tcp remote: 0x375c0102490357e5 expref: 13 pid: 5750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869412.292121:0:5750:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94c8421f2800, rc 0) 00000100:00100000:1.0:1788869412.292205:0:5750:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c81f0ff450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3cca3acf-4935-4d0d-9982-d5d931f1c86b+13:5555:x1875765413033344:12345-192.168.201.39@tcp:101:ll_cfg_requeue.0 Request processed in 205us (435us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869412.292214:0:5750:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 227 00000100:00100000:1.0:1788869412.297768:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1788869412.297870:0:5748:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765413033472 00000100:00100000:3.0:1788869412.297883:0:5748:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765413033472 00000100:00100000:3.0:1788869412.297948:0:5748:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 228 00000100:00100000:3.0:1788869412.298080:0:5748:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c81f0fdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3cca3acf-4935-4d0d-9982-d5d931f1c86b+13:5555:x1875765413033472:12345-192.168.201.39@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788869412.298587:0:5748:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c81f0fdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3cca3acf-4935-4d0d-9982-d5d931f1c86b+13:5555:x1875765413033472:12345-192.168.201.39@tcp:501:ll_cfg_requeue.0 Request processed in 510us (831us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869412.298598:0:5748:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 228 00000100:00100000:0.0:1788869412.300729:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1788869412.300811:0:5750:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765413033600 00000100:00100000:1.0:1788869412.300821:0:5750:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765413033600 00000100:00100000:1.0:1788869412.300909:0:5750:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 229 00000100:00100000:1.0:1788869412.300922:0:5750:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c81f0fe850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3cca3acf-4935-4d0d-9982-d5d931f1c86b+13:5555:x1875765413033600:12345-192.168.201.39@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788869412.301201:0:5750:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c81f0fe850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3cca3acf-4935-4d0d-9982-d5d931f1c86b+13:5555:x1875765413033600:12345-192.168.201.39@tcp:503:ll_cfg_requeue.0 Request processed in 280us (479us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869412.301212:0:5750:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 229 00000001:02000400:2.0:1788869412.338925:0:11166:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg139-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00100000:0.0:1788869412.956241:0:3284:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94c83c6f0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3284:1875765421451136:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788869412.956390:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869412.956467:0:6549:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765421451136 00000100:00100000:3.0:1788869412.956476:0:6549:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765421451136 00000100:00080000:0.0:1788869412.956540:0:5751:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788869412.956546:0:6549:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1788869412.956556:0:6549:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c83fbb3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3284:x1875765421451136:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788869412.956592:0:6549:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788869412.956666:0:6549:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c83fbb3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3284:x1875765421451136:12345-0@lo:13:osp-pre-0-0.0 Request processed in 113us (277us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869412.956671:0:6549:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00010000:00080000:0.0:1788869412.956729:0:3284:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff94c83c6f0000 x1875765421451136/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788869428 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788869412.956755:0:3284:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94c83c6f0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3284:1875765421451136:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1788869413.277408:0:5742:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1788869414.155223:0:11265:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-pcc: finish setup 08:10:12 (1788869412) === 00000100:00100000:0.0:1788869414.282366:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1788869414.282497:0:5764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765413033728 00000100:00100000:2.0:1788869414.282507:0:5764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765413033728 00000100:00100000:2.0:1788869414.282582:0:5764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 0 00000100:00100000:2.0:1788869414.282594:0:5764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c83fbb1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:2125b9b3-626e-4cbe-be83-fb446e976ce2+6:9619:x1875765413033728:12345-192.168.201.39@tcp:700:mkdir.0 00000100:00100000:2.0:1788869414.282673:0:5764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c83fbb1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:2125b9b3-626e-4cbe-be83-fb446e976ce2+6:9619:x1875765413033728:12345-192.168.201.39@tcp:700:mkdir.0 Request processed in 82us (316us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869414.282693:0:5764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 0 00000100:00080000:0.0:1788869414.282920:0:5751:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788869414.284226:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1788869414.284286:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765413033984 00000100:00100000:0.0:1788869414.284293:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765413033984 00000100:00100000:0.0:1788869414.284336:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 14 00000100:00100000:0.0:1788869414.284345:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c83c6f0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2125b9b3-626e-4cbe-be83-fb446e976ce2+6:9619:x1875765413033984:12345-192.168.201.39@tcp:36:mkdir.0 00010000:00010000:0.0:1788869414.284403:0:5786:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788869414.284479:0:5786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94c8421f3a00/0x3d2d1916761d63fd lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.39@tcp remote: 0x375c010249035767 expref: 6 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869414.284512:0:5786:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff94c81a585200) 00010000:00010000:0.0:1788869414.284524:0:5786:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788869414.284757:0:5786:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94c818d1fe00/0x3d2d1916761d651c lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869414.284771:0:5786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94c818d1fe00/0x3d2d1916761d651c lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869414.284780:0:5786:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94c818d1fe00/0x3d2d1916761d651c lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869414.284806:0:5786:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94c818d1fc00/0x3d2d1916761d6523 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869414.284812:0:5786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94c818d1fc00/0x3d2d1916761d6523 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869414.284817:0:5786:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94c818d1fc00/0x3d2d1916761d6523 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788869414.285902:0:5786:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 512 00010000:00010000:0.0:1788869414.285911:0:5786:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94c818d1fe00/0x3d2d1916761d651c lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869414.285917:0:5786:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94c818d1fe00/0x3d2d1916761d651c lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869414.285922:0:5786:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94c818d1fe00/0x3d2d1916761d651c lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869414.285926:0:5786:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94c818d1fe00 already unused, calling callback (ffffffffc21124f0) 00010000:00010000:0.0:1788869414.285933:0:5786:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94c818d1fe00/0x3d2d1916761d651c lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869414.285938:0:5786:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94c818d1fe00/0x3d2d1916761d651c lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869414.285949:0:5786:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff94c803990b00) 00010000:00010000:0.0:1788869414.285952:0:5786:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788869414.285956:0:5786:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94c818d1fe00/0x3d2d1916761d651c lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869414.285962:0:5786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94c818d1fe00/0x3d2d1916761d651c lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788869414.285977:0:5786:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000079872a41 reply state 00000000b691fdde transno 4294967297 ns: mdt-lustre-MDT0000_UUID lock: ffff94c818d1fc00/0x3d2d1916761d6523 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788869414.285986:0:5786:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788869414.286076:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c83c6f0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2125b9b3-626e-4cbe-be83-fb446e976ce2+7:9619:x1875765413033984:12345-192.168.201.39@tcp:36:mkdir.0 Request processed in 1727us (1847us total) trans 4294967297 rc 0/0 00000100:00100000:0.0:1788869414.286085:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 14 00010000:00010000:2.0:1788869414.290006:0:3269:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94c818d1fc00/0x3d2d1916761d6523 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869414.290024:0:3269:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94c818d1fc00/0x3d2d1916761d6523 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869414.290032:0:3269:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94c818d1fc00/0x3d2d1916761d6523 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869414.290039:0:3269:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94c818d1fc00 already unused, calling callback (ffffffffc21124f0) 00010000:00010000:2.0:1788869414.290043:0:3269:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94c818d1fc00/0x3d2d1916761d6523 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869414.290051:0:3269:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94c818d1fc00/0x3d2d1916761d6523 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869414.290067:0:3269:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff94c803990300) 00010000:00010000:2.0:1788869414.290070:0:3269:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788869414.290074:0:3269:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94c818d1fc00/0x3d2d1916761d6523 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869414.290081:0:3269:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94c818d1fc00/0x3d2d1916761d6523 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788869414.297168:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1788869414.297231:0:5756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765413034112 00000100:00100000:0.0:1788869414.297242:0:5756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765413034112 00000100:00100000:0.0:1788869414.297382:0:5756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 15 00000100:00100000:0.0:1788869414.297393:0:5756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c83c6f1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2125b9b3-626e-4cbe-be83-fb446e976ce2+6:9620:x1875765413034112:12345-192.168.201.39@tcp:101:chmod.0 00010000:00010000:0.0:1788869414.297416:0:5756:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788869414.297437:0:5756:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94c818d1fe00/0x3d2d1916761d652a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x375c0102490357ec expref: -99 pid: 5756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869414.297505:0:5756:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94c818d1ec00/0x3d2d1916761d6531 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869414.297531:0:5756:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94c818d1ec00/0x3d2d1916761d6531 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869414.297542:0:5756:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94c818d1ec00/0x3d2d1916761d6531 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788869414.297601:0:5756:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000004:00200000:0.0:1788869414.297605:0:5756:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:0.0:1788869414.297643:0:5756:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff94c818d1ec00/0x3d2d1916761d6531 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869414.297668:0:5756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94c818d1fe00/0x3d2d1916761d652a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0x375c0102490357ec expref: 8 pid: 5756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869414.297686:0:5756:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94c818d1ec00/0x3d2d1916761d6531 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0x375c0102490357ec expref: 7 pid: 5756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869414.297695:0:5756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff94c803990b00) 00010000:00010000:0.0:1788869414.297698:0:5756:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788869414.297701:0:5756:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94c818d1ec00, rc 0) 00000100:00100000:0.0:1788869414.297750:0:5756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c83c6f1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2125b9b3-626e-4cbe-be83-fb446e976ce2+7:9620:x1875765413034112:12345-192.168.201.39@tcp:101:chmod.0 Request processed in 360us (591us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869414.297757:0:5756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 15 00010000:00010000:0.0:1788869414.299334:0:5743:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788869414.300524:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1788869414.301233:0:5755:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765413034368 00000100:00100000:0.0:1788869414.301243:0:5755:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765413034368 00000100:00100000:0.0:1788869414.301329:0:5755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 16 00000100:00100000:0.0:1788869414.301340:0:5755:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c82cdc6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2125b9b3-626e-4cbe-be83-fb446e976ce2+7:9620:x1875765413034368:12345-192.168.201.39@tcp:36:chmod.0 00010000:00010000:0.0:1788869414.301408:0:5755:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788869414.301434:0:5755:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94c818d1ec00/0x3d2d1916761d6531 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.39@tcp remote: 0x375c0102490357ec expref: 7 pid: 5756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869414.301453:0:5755:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff94c803990b00) 00010000:00010000:0.0:1788869414.301464:0:5755:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788869414.301487:0:5755:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94c818d1e200/0x3d2d1916761d6538 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869414.301501:0:5755:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94c818d1e200/0x3d2d1916761d6538 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869414.301510:0:5755:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94c818d1e200/0x3d2d1916761d6538 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788869414.301795:0:5755:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000009b3b1e9b reply state 00000000c633870e transno 4294967298 ns: mdt-lustre-MDT0000_UUID lock: ffff94c818d1e200/0x3d2d1916761d6538 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788869414.301805:0:5755:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:0.0:1788869414.301816:0:5755:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000100:00100000:0.0:1788869414.301895:0:5755:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c82cdc6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2125b9b3-626e-4cbe-be83-fb446e976ce2+8:9620:x1875765413034368:12345-192.168.201.39@tcp:36:chmod.0 Request processed in 556us (1377us total) trans 4294967298 rc 0/0 00000100:00100000:0.0:1788869414.301920:0:5755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 16 00010000:00010000:2.0:1788869414.303386:0:3270:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94c818d1e200/0x3d2d1916761d6538 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869414.303400:0:3270:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94c818d1e200/0x3d2d1916761d6538 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869414.303422:0:3270:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94c818d1e200/0x3d2d1916761d6538 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869414.303429:0:3270:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94c818d1e200 already unused, calling callback (ffffffffc21124f0) 00010000:00010000:2.0:1788869414.303434:0:3270:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94c818d1e200/0x3d2d1916761d6538 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869414.303442:0:3270:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94c818d1e200/0x3d2d1916761d6538 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869414.303456:0:3270:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff94c803990f00) 00010000:00010000:2.0:1788869414.303460:0:3270:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1788869414.303464:0:3270:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94c818d1e200/0x3d2d1916761d6538 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869414.303470:0:3270:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94c818d1e200/0x3d2d1916761d6538 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788869414.318045:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1788869414.318868:0:5757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765413034496 00000100:00100000:0.0:1788869414.318880:0:5757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765413034496 00000100:00100000:0.0:1788869414.318943:0:5757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 17 00000100:00100000:0.0:1788869414.318953:0:5757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c82cdc4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2125b9b3-626e-4cbe-be83-fb446e976ce2+7:9621:x1875765413034496:12345-192.168.201.39@tcp:101:chown.0 00010000:00010000:0.0:1788869414.318978:0:5757:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788869414.319002:0:5757:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94c818d1ec00/0x3d2d1916761d653f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x375c0102490357f3 expref: -99 pid: 5757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869414.319085:0:5757:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94c818d1fe00/0x3d2d1916761d6546 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869414.319098:0:5757:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94c818d1fe00/0x3d2d1916761d6546 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869414.319110:0:5757:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94c818d1fe00/0x3d2d1916761d6546 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5757 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788869414.319169:0:5757:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000004:00200000:0.0:1788869414.319174:0:5757:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:0.0:1788869414.319211:0:5757:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff94c818d1fe00/0x3d2d1916761d6546 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869414.319237:0:5757:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94c818d1ec00/0x3d2d1916761d653f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0x375c0102490357f3 expref: 9 pid: 5757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869414.319313:0:5757:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94c818d1fe00/0x3d2d1916761d6546 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0x375c0102490357f3 expref: 8 pid: 5757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869414.319321:0:5757:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff94c803990b00) 00010000:00010000:0.0:1788869414.319325:0:5757:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788869414.319328:0:5757:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94c818d1fe00, rc 0) 00000100:00100000:0.0:1788869414.319400:0:5757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c82cdc4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2125b9b3-626e-4cbe-be83-fb446e976ce2+8:9621:x1875765413034496:12345-192.168.201.39@tcp:101:chown.0 Request processed in 449us (1365us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869414.319407:0:5757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 17 00000100:00100000:1.0:1788869414.322483:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1788869414.322545:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765413034624 00000100:00100000:3.0:1788869414.322555:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765413034624 00000100:00100000:3.0:1788869414.322614:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 18 00000100:00100000:3.0:1788869414.322625:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c702348380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2125b9b3-626e-4cbe-be83-fb446e976ce2+8:9621:x1875765413034624:12345-192.168.201.39@tcp:101:chown.0 00010000:00010000:3.0:1788869414.322642:0:5786:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788869414.322662:0:5786:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504d000/0x3d2d1916761d654d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x375c0102490357fa expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869414.322731:0:5786:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504c400/0x3d2d1916761d6554 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869414.322759:0:5786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504c400/0x3d2d1916761d6554 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869414.322770:0:5786:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504c400/0x3d2d1916761d6554 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869414.322798:0:5786:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504c200/0x3d2d1916761d655b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869414.322805:0:5786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504c200/0x3d2d1916761d655b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869414.322811:0:5786:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504c200/0x3d2d1916761d655b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869414.323072:0:5786:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504d400/0x3d2d1916761d6562 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869414.323081:0:5786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504d400/0x3d2d1916761d6562 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869414.323100:0:5786:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504d400/0x3d2d1916761d6562 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788869414.323136:0:5786:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 512 00000004:00200000:3.0:1788869414.323148:0:5786:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1788869414.323171:0:5786:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504d400/0x3d2d1916761d6562 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869414.323183:0:5786:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504c400/0x3d2d1916761d6554 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869414.323199:0:5786:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504c400/0x3d2d1916761d6554 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869414.323206:0:5786:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504c400/0x3d2d1916761d6554 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869414.323212:0:5786:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94c83504c400 already unused, calling callback (ffffffffc21124f0) 00010000:00010000:3.0:1788869414.323216:0:5786:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504c400/0x3d2d1916761d6554 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869414.323224:0:5786:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504c400/0x3d2d1916761d6554 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869414.323236:0:5786:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff94c803990b00) 00010000:00010000:3.0:1788869414.323239:0:5786:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788869414.323243:0:5786:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504c400/0x3d2d1916761d6554 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869414.323521:0:5786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504c400/0x3d2d1916761d6554 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869414.323535:0:5786:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504c200/0x3d2d1916761d655b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869414.323542:0:5786:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504c200/0x3d2d1916761d655b lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869414.323551:0:5786:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504c200/0x3d2d1916761d655b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869414.323556:0:5786:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94c83504c200 already unused, calling callback (ffffffffc21124f0) 00010000:00010000:3.0:1788869414.323565:0:5786:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504c200/0x3d2d1916761d655b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869414.323572:0:5786:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504c200/0x3d2d1916761d655b lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869414.323581:0:5786:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff94c819394500) 00010000:00010000:3.0:1788869414.323584:0:5786:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788869414.323586:0:5786:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504c200/0x3d2d1916761d655b lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869414.323592:0:5786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504c200/0x3d2d1916761d655b lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869414.323622:0:5786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504d000/0x3d2d1916761d654d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0x375c0102490357fa expref: 10 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869414.323636:0:5786:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504d400/0x3d2d1916761d6562 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0x375c0102490357fa expref: 9 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869414.323643:0:5786:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff94c819394700) 00010000:00010000:3.0:1788869414.323646:0:5786:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788869414.323648:0:5786:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94c83504d400, rc 0) 00000100:00100000:2.0:1788869414.323834:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c702348380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2125b9b3-626e-4cbe-be83-fb446e976ce2+9:9621:x1875765413034624:12345-192.168.201.39@tcp:101:chown.0 Request processed in 1208us (1356us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869414.323848:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 18 00000100:00100000:2.0:1788869414.326127:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1788869414.326179:0:5757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765413034880 00000100:00100000:0.0:1788869414.326188:0:5757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765413034880 00000100:00100000:0.0:1788869414.326303:0:5757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 19 00000100:00100000:0.0:1788869414.326314:0:5757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c810e69180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2125b9b3-626e-4cbe-be83-fb446e976ce2+9:9621:x1875765413034880:12345-192.168.201.39@tcp:36:chown.0 00010000:00010000:0.0:1788869414.326378:0:5757:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788869414.326399:0:5757:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504d400/0x3d2d1916761d6562 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.39@tcp remote: 0x375c0102490357fa expref: 9 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869414.326415:0:5757:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff94c819394700) 00010000:00010000:0.0:1788869414.326425:0:5757:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788869414.326447:0:5757:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94c818d1ec00/0x3d2d1916761d6569 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869414.326458:0:5757:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94c818d1ec00/0x3d2d1916761d6569 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869414.326467:0:5757:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94c818d1ec00/0x3d2d1916761d6569 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5757 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788869414.338066:0:5777:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967299 is committed 00000004:00010000:3.0:1788869414.338089:0:5757:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000023ca3bad reply state 0000000079fff1b3 transno 4294967299 ns: mdt-lustre-MDT0000_UUID lock: ffff94c818d1ec00/0x3d2d1916761d6569 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5757 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788869414.338104:0:5757:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:3.0:1788869414.338209:0:5757:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00010000:00080000:3.0:1788869414.338325:0:5757:0:(ldlm_lib.c:3454:target_send_reply()) Schedule reply immediately 00000100:00100000:3.0:1788869414.338343:0:5757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c810e69180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2125b9b3-626e-4cbe-be83-fb446e976ce2+7:9621:x1875765413034880:12345-192.168.201.39@tcp:36:chown.0 Request processed in 12027us (12217us total) trans 4294967299 rc 0/0 00010000:00010000:2.0:1788869414.338352:0:3269:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94c818d1ec00/0x3d2d1916761d6569 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5757 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788869414.338364:0:5757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 19 00010000:00010000:2.0:1788869414.338365:0:3269:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94c818d1ec00/0x3d2d1916761d6569 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869414.338375:0:3269:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94c818d1ec00/0x3d2d1916761d6569 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869414.338388:0:3269:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94c818d1ec00 already unused, calling callback (ffffffffc21124f0) 00010000:00010000:2.0:1788869414.338393:0:3269:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94c818d1ec00/0x3d2d1916761d6569 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869414.338401:0:3269:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94c818d1ec00/0x3d2d1916761d6569 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869414.338418:0:3269:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff94c803990600) 00010000:00010000:2.0:1788869414.338421:0:3269:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1788869414.338426:0:3269:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94c818d1ec00/0x3d2d1916761d6569 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869414.338431:0:3269:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94c818d1ec00/0x3d2d1916761d6569 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5757 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788869414.347534:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1788869414.347595:0:5755:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765413035008 00000100:00100000:0.0:1788869414.347605:0:5755:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765413035008 00000100:00100000:0.0:1788869414.347655:0:5755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 20 00000100:00100000:0.0:1788869414.347663:0:5755:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c810e68e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2125b9b3-626e-4cbe-be83-fb446e976ce2+6:9622:x1875765413035008:12345-192.168.201.39@tcp:101:touch.500 00010000:00010000:0.0:1788869414.347689:0:5755:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788869414.347707:0:5755:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94c818d1e600/0x3d2d1916761d6570 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x375c010249035801 expref: -99 pid: 5755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1788869414.348326:0:5755:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 500, time 572us 00010000:00010000:0.0:1788869414.353610:0:5755:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff94c818d1fa00/0x3d2d1916761d6577 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869414.353635:0:5755:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94c818d1fa00/0x3d2d1916761d6577 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869414.353645:0:5755:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94c818d1fa00/0x3d2d1916761d6577 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869414.353660:0:5755:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94c818d1ec00/0x3d2d1916761d657e lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869414.353665:0:5755:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94c818d1ec00/0x3d2d1916761d657e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869414.353670:0:5755:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94c818d1ec00/0x3d2d1916761d657e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869414.354077:0:5755:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94c818d1e200/0x3d2d1916761d6585 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869414.354083:0:5755:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94c818d1e200/0x3d2d1916761d6585 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869414.354089:0:5755:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94c818d1e200/0x3d2d1916761d6585 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788869414.354186:0:5755:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00000004:00200000:0.0:1788869414.354189:0:5755:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1788869414.354301:0:5755:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff94c818d1e200/0x3d2d1916761d6585 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869414.354312:0:5755:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff94c818d1fa00/0x3d2d1916761d6577 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869414.354322:0:5755:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94c818d1fa00/0x3d2d1916761d6577 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869414.354329:0:5755:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94c818d1fa00/0x3d2d1916761d6577 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869414.354336:0:5755:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94c818d1fa00 already unused, calling callback (ffffffffc21124f0) 00010000:00010000:0.0:1788869414.354340:0:5755:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94c818d1fa00/0x3d2d1916761d6577 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869414.354348:0:5755:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94c818d1fa00/0x3d2d1916761d6577 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869414.354360:0:5755:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff94c803990b00) 00010000:00010000:0.0:1788869414.354363:0:5755:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788869414.354368:0:5755:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94c818d1fa00/0x3d2d1916761d6577 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869414.354375:0:5755:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94c818d1fa00/0x3d2d1916761d6577 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869414.354385:0:5755:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94c818d1ec00/0x3d2d1916761d657e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869414.354390:0:5755:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94c818d1ec00/0x3d2d1916761d657e lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869414.354394:0:5755:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94c818d1ec00/0x3d2d1916761d657e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869414.354397:0:5755:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94c818d1ec00 already unused, calling callback (ffffffffc21124f0) 00010000:00010000:0.0:1788869414.354404:0:5755:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94c818d1ec00/0x3d2d1916761d657e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869414.354408:0:5755:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94c818d1ec00/0x3d2d1916761d657e lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869414.354414:0:5755:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff94c803990100) 00010000:00010000:0.0:1788869414.354416:0:5755:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788869414.354417:0:5755:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94c818d1ec00/0x3d2d1916761d657e lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869414.354421:0:5755:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94c818d1ec00/0x3d2d1916761d657e lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869414.354450:0:5755:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94c818d1e600/0x3d2d1916761d6570 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0x375c010249035801 expref: 8 pid: 5755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869414.354460:0:5755:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94c818d1e200/0x3d2d1916761d6585 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0x375c010249035801 expref: 7 pid: 5755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869414.354465:0:5755:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff94c803990a00) 00010000:00010000:0.0:1788869414.354466:0:5755:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1788869414.354468:0:5755:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94c818d1e200, rc 0) 00000100:00100000:0.0:1788869414.354525:0:5755:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c810e68e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2125b9b3-626e-4cbe-be83-fb446e976ce2+7:9622:x1875765413035008:12345-192.168.201.39@tcp:101:touch.500 Request processed in 6863us (7000us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869414.354533:0:5755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 20 00000100:00100000:3.0:1788869414.356104:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1788869414.356154:0:5756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765413035264 00000100:00100000:2.0:1788869414.356162:0:5756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765413035264 00000100:00100000:2.0:1788869414.356204:0:5756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 21 00000100:00100000:2.0:1788869414.356213:0:5756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c82065c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2125b9b3-626e-4cbe-be83-fb446e976ce2+7:9622:x1875765413035264:12345-192.168.201.39@tcp:101:touch.500 00010000:00010000:2.0:1788869414.356229:0:5756:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788869414.356241:0:5756:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94c80153aa00/0x3d2d1916761d658c lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x375c010249035808 expref: -99 pid: 5756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869414.356485:0:5756:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94c80153b000/0x3d2d1916761d6593 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869414.356497:0:5756:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94c80153b000/0x3d2d1916761d6593 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869414.356514:0:5756:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94c80153b000/0x3d2d1916761d6593 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869414.356557:0:5756:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94c80153a400/0x3d2d1916761d659a lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0xe93be2da bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869414.356565:0:5756:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94c80153a400/0x3d2d1916761d659a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xe93be2da bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869414.356572:0:5756:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94c80153a400/0x3d2d1916761d659a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xe93be2da bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788869414.357228:0:5756:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x2:0x0], index 1: 0 00010000:00010000:2.0:1788869414.357480:0:5756:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94c805038800/0x3d2d1916761d65a1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869414.357490:0:5756:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94c805038800/0x3d2d1916761d65a1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869414.357497:0:5756:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94c805038800/0x3d2d1916761d65a1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869414.357526:0:5756:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94c80153b000/0x3d2d1916761d6593 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869414.357533:0:5756:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94c80153b000/0x3d2d1916761d6593 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869414.357539:0:5756:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94c80153b000/0x3d2d1916761d6593 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869414.357545:0:5756:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94c80153b000 already unused, calling callback (ffffffffc21124f0) 00010000:00010000:2.0:1788869414.357553:0:5756:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94c80153b000/0x3d2d1916761d6593 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869414.357560:0:5756:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94c80153b000/0x3d2d1916761d6593 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869414.357570:0:5756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff94c803990a00) 00010000:00010000:2.0:1788869414.357573:0:5756:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788869414.357576:0:5756:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94c80153b000/0x3d2d1916761d6593 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869414.357583:0:5756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94c80153b000/0x3d2d1916761d6593 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788869414.357593:0:5756:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000d4407fa6 reply state 00000000327fab6b transno 4294967300 ns: mdt-lustre-MDT0000_UUID lock: ffff94c80153a400/0x3d2d1916761d659a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xe93be2da bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788869414.357601:0:5756:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1788869414.357622:0:5756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94c80153aa00/0x3d2d1916761d658c lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0x375c010249035808 expref: 10 pid: 5756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869414.357634:0:5756:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94c805038800/0x3d2d1916761d65a1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0x375c010249035808 expref: 9 pid: 5756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869414.357642:0:5756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff94c802f3f400) 00010000:00010000:2.0:1788869414.357644:0:5756:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788869414.357646:0:5756:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94c805038800, rc 0) 00000100:00100000:2.0:1788869414.357693:0:5756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c82065c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2125b9b3-626e-4cbe-be83-fb446e976ce2+10:9622:x1875765413035264:12345-192.168.201.39@tcp:101:touch.500 Request processed in 1481us (1591us total) trans 4294967300 rc 0/0 00000100:00100000:2.0:1788869414.357699:0:5756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 21 00010000:00010000:2.0:1788869414.358409:0:3269:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94c80153a400/0x3d2d1916761d659a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xe93be2da bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869414.358419:0:3269:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94c80153a400/0x3d2d1916761d659a lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xe93be2da bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869414.358425:0:3269:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94c80153a400/0x3d2d1916761d659a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xe93be2da bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869414.358431:0:3269:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94c80153a400 already unused, calling callback (ffffffffc21124f0) 00010000:00010000:2.0:1788869414.358434:0:3269:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94c80153a400/0x3d2d1916761d659a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xe93be2da bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869414.358440:0:3269:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94c80153a400/0x3d2d1916761d659a lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xe93be2da bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869414.358449:0:3269:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0xe93be2da (ffff94c802f3f300) 00010000:00010000:2.0:1788869414.358451:0:3269:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788869414.358455:0:3269:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94c80153a400/0x3d2d1916761d659a lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0xe93be2da bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869414.358461:0:3269:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94c80153a400/0x3d2d1916761d659a lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0xe93be2da bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788869414.359243:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1788869414.359308:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765413035520 00000100:00100000:2.0:1788869414.359315:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765413035520 00000100:00100000:2.0:1788869414.359356:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 22 00000100:00100000:2.0:1788869414.359365:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c82065f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2125b9b3-626e-4cbe-be83-fb446e976ce2+9:9622:x1875765413035520:12345-192.168.201.39@tcp:36:touch.500 00010000:00010000:2.0:1788869414.359404:0:5786:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788869414.359418:0:5786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94c805038800/0x3d2d1916761d65a1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.39@tcp remote: 0x375c010249035808 expref: 9 pid: 5756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869414.359442:0:5786:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff94c802f3f400) 00010000:00010000:2.0:1788869414.359450:0:5786:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788869414.359472:0:5786:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94c805039a00/0x3d2d1916761d65af lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869414.359478:0:5786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94c805039a00/0x3d2d1916761d65af lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869414.359484:0:5786:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94c805039a00/0x3d2d1916761d65af lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788869414.359541:0:5786:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000354f986d reply state 0000000043b808af transno 4294967301 ns: mdt-lustre-MDT0000_UUID lock: ffff94c805039a00/0x3d2d1916761d65af lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788869414.359546:0:5786:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788869414.359584:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c82065f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2125b9b3-626e-4cbe-be83-fb446e976ce2+10:9622:x1875765413035520:12345-192.168.201.39@tcp:36:touch.500 Request processed in 222us (343us total) trans 4294967301 rc 0/0 00000100:00100000:2.0:1788869414.359589:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 22 00010000:00010000:2.0:1788869414.360109:0:3270:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94c805039a00/0x3d2d1916761d65af lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869414.360119:0:3270:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94c805039a00/0x3d2d1916761d65af lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869414.360126:0:3270:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94c805039a00/0x3d2d1916761d65af lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869414.360132:0:3270:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94c805039a00 already unused, calling callback (ffffffffc21124f0) 00010000:00010000:2.0:1788869414.360136:0:3270:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94c805039a00/0x3d2d1916761d65af lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869414.360152:0:3270:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94c805039a00/0x3d2d1916761d65af lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869414.360161:0:3270:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff94c802f3f900) 00010000:00010000:2.0:1788869414.360164:0:3270:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788869414.360167:0:3270:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94c805039a00/0x3d2d1916761d65af lrc: 2/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869414.360173:0:3270:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94c805039a00/0x3d2d1916761d65af lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788869414.360296:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1788869414.360331:0:5757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765413035648 00000100:00100000:0.0:1788869414.360337:0:5757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765413035648 00000100:00100000:0.0:1788869414.360376:0:5757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 23 00000100:00100000:0.0:1788869414.360383:0:5757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c82065c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2125b9b3-626e-4cbe-be83-fb446e976ce2+9:9622:x1875765413035648:12345-192.168.201.39@tcp:101:touch.500 00010000:00010000:0.0:1788869414.360397:0:5757:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788869414.360415:0:5757:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94c818d1fc00/0x3d2d1916761d65b6 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x375c01024903580f expref: -99 pid: 5757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869414.360448:0:5757:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94c818d1fc00/0x3d2d1916761d65b6 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.39@tcp remote: 0x375c01024903580f expref: 10 pid: 5757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869414.360459:0:5757:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94c818d1fc00/0x3d2d1916761d65b6 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.39@tcp remote: 0x375c01024903580f expref: 10 pid: 5757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869414.360474:0:5757:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff94c803990400) 00010000:00010000:0.0:1788869414.360477:0:5757:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788869414.360479:0:5757:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94c818d1fc00, rc 0) 00000100:00100000:0.0:1788869414.360510:0:5757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c82065c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2125b9b3-626e-4cbe-be83-fb446e976ce2+10:9622:x1875765413035648:12345-192.168.201.39@tcp:101:touch.500 Request processed in 126us (215us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869414.360516:0:5757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 23 00000100:00100000:1.0:1788869414.361638:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1788869414.361673:0:6547:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765413035776 00000100:00100000:3.0:1788869414.361677:0:6547:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765413035776 00000100:00100000:3.0:1788869414.361699:0:6547:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 14 00000100:00100000:3.0:1788869414.361703:0:6547:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c702348000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2344:x1875765413035776:12345-192.168.201.39@tcp:8:touch.500 00010000:00080000:3.0:1788869414.361722:0:6547:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0001: connection from 2125b9b3-626e-4cbe-be83-fb446e976ce2@192.168.201.39@tcp t0 exp 0000000000000000 cur 162 last 0 00000020:00000080:3.0:1788869414.361741:0:6547:0:(genops.c:1406:class_connect()) connect: client 2125b9b3-626e-4cbe-be83-fb446e976ce2, cookie 0x3d2d1916761d65bd 00002000:00100000:3.0:1788869414.361750:0:6547:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 2125b9b3-626e-4cbe-be83-fb446e976ce2/ffff94c835505800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113718 ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1788869414.361766:0:6547:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:3.0:1788869414.361943:0:6547:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1788869414.361964:0:6547:0:(import.c:65:import_set_state_nolock()) ffff94c835502800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788869414.361994:0:6547:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c702348000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2125b9b3-626e-4cbe-be83-fb446e976ce2+6:2344:x1875765413035776:12345-192.168.201.39@tcp:8:touch.500 Request processed in 291us (358us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869414.361999:0:6547:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 14 00000100:00100000:3.0:1788869414.362650:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1788869414.362683:0:7884:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765413035904 00000100:00100000:0.0:1788869414.362698:0:7884:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765413035904 00000100:00080000:3.0:1788869414.362736:0:5751:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788869414.362741:0:7884:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 15 00000100:00100000:0.0:1788869414.362750:0:7884:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c82065f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:2125b9b3-626e-4cbe-be83-fb446e976ce2+6:0:x1875765413035904:12345-192.168.201.39@tcp:2:touch.500 00000001:00080000:0.0:1788869414.372750:0:7458:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967299 is committed 00000001:00100000:0.0:1788869414.372767:0:7458:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 2125b9b3-626e-4cbe-be83-fb446e976ce2 00000100:00100000:2.0:1788869414.372857:0:7884:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c82065f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:2125b9b3-626e-4cbe-be83-fb446e976ce2+5:0:x1875765413035904:12345-192.168.201.39@tcp:2:touch.500 Request processed in 10101us (10199us total) trans 4294967299 rc 0/0 00000100:00100000:2.0:1788869414.372870:0:7884:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 15 00000100:00100000:0.0:1788869414.374362:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1788869414.374393:0:5759:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765413036160 00000100:00100000:2.0:1788869414.374400:0:5759:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765413036160 00000100:00100000:2.0:1788869414.374442:0:5759:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 2 00000100:00100000:2.0:1788869414.374448:0:5759:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c83fbb2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2125b9b3-626e-4cbe-be83-fb446e976ce2+10:9622:x1875765413036160:12345-192.168.201.39@tcp:35:touch.500 00000100:00100000:2.0:1788869414.374721:0:5759:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c83fbb2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2125b9b3-626e-4cbe-be83-fb446e976ce2+11:9622:x1875765413036160:12345-192.168.201.39@tcp:35:touch.500 Request processed in 272us (362us total) trans 4294967302 rc 0/0 00000100:00100000:2.0:1788869414.374726:0:5759:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 2 00000100:00100000:1.0:1788869414.379964:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1788869414.380007:0:5755:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765413036288 00000100:00100000:0.0:1788869414.380015:0:5755:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765413036288 00000100:00100000:0.0:1788869414.380063:0:5755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 24 00000100:00100000:0.0:1788869414.380074:0:5755:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c70234b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2125b9b3-626e-4cbe-be83-fb446e976ce2+11:9623:x1875765413036288:12345-192.168.201.39@tcp:101:rm.0 00010000:00010000:0.0:1788869414.380107:0:5755:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788869414.380123:0:5755:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94c818d1e600/0x3d2d1916761d65c4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x375c010249035816 expref: -99 pid: 5755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869414.380171:0:5755:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94c818d1ec00/0x3d2d1916761d65cb lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869414.380182:0:5755:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94c818d1ec00/0x3d2d1916761d65cb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869414.380189:0:5755:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94c818d1ec00/0x3d2d1916761d65cb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788869414.380239:0:5755:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00000004:00200000:0.0:1788869414.380243:0:5755:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:0.0:1788869414.380333:0:5755:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff94c818d1ec00/0x3d2d1916761d65cb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869414.380360:0:5755:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94c818d1e600/0x3d2d1916761d65c4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0x375c010249035816 expref: 13 pid: 5755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869414.380378:0:5755:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94c818d1ec00/0x3d2d1916761d65cb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0x375c010249035816 expref: 12 pid: 5755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869414.380386:0:5755:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff94c803990a00) 00010000:00010000:0.0:1788869414.380389:0:5755:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788869414.380392:0:5755:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94c818d1ec00, rc 0) 00000100:00100000:0.0:1788869414.380445:0:5755:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c70234b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2125b9b3-626e-4cbe-be83-fb446e976ce2+12:9623:x1875765413036288:12345-192.168.201.39@tcp:101:rm.0 Request processed in 373us (488us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869414.380450:0:5755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 24 00000100:00100000:3.0:1788869414.381664:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1788869414.381704:0:5757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765413036544 00000100:00100000:0.0:1788869414.381710:0:5757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765413036544 00000100:00100000:0.0:1788869414.381754:0:5757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 25 00000100:00100000:0.0:1788869414.381763:0:5757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c82065df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2125b9b3-626e-4cbe-be83-fb446e976ce2+12:9623:x1875765413036544:12345-192.168.201.39@tcp:101:rm.0 00010000:00010000:0.0:1788869414.381774:0:5757:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788869414.381785:0:5757:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94c818d1fa00/0x3d2d1916761d65d2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x375c01024903581d expref: -99 pid: 5757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788869414.381848:0:5757:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00010000:00010000:0.0:1788869414.381985:0:5757:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94c818d1fa00/0x3d2d1916761d65d2 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0x375c01024903581d expref: 14 pid: 5757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869414.381998:0:5757:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff94c803990b00) 00010000:00010000:0.0:1788869414.382001:0:5757:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788869414.382006:0:5757:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94c818d1fa00/0x3d2d1916761d65d2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.39@tcp remote: 0x375c01024903581d expref: 14 pid: 5757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869414.382017:0:5757:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94c818d1fa00, rc 0) 00000100:00100000:0.0:1788869414.382053:0:5757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c82065df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2125b9b3-626e-4cbe-be83-fb446e976ce2+13:9623:x1875765413036544:12345-192.168.201.39@tcp:101:rm.0 Request processed in 291us (389us total) trans 4294967303 rc 301/301 00000100:00100000:0.0:1788869414.382069:0:5757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 25 00000100:00100000:3.0:1788869414.383966:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1788869414.384010:0:5758:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765413036672 00000100:00100000:0.0:1788869414.384019:0:5758:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765413036672 00000100:00100000:0.0:1788869414.384072:0:5758:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 3 00000100:00100000:0.0:1788869414.384082:0:5758:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c82065ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2125b9b3-626e-4cbe-be83-fb446e976ce2+13:9623:x1875765413036672:12345-192.168.201.39@tcp:37:rm.0 00000100:00100000:0.0:1788869414.387535:0:5758:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c82065ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2125b9b3-626e-4cbe-be83-fb446e976ce2+13:9623:x1875765413036672:12345-192.168.201.39@tcp:37:rm.0 Request processed in 3447us (3564us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869414.387570:0:5758:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 3 00000100:00100000:3.0:1788869414.390339:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1788869414.390378:0:5759:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765413036928 00000100:00100000:2.0:1788869414.390387:0:5759:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765413036928 00000100:00100000:2.0:1788869414.390430:0:5759:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 4 00000100:00100000:2.0:1788869414.390439:0:5759:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c81876b050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2125b9b3-626e-4cbe-be83-fb446e976ce2+13:9623:x1875765413036928:12345-192.168.201.39@tcp:35:rm.0 00000100:00100000:2.0:1788869414.390625:0:5759:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c81876b050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2125b9b3-626e-4cbe-be83-fb446e976ce2+14:9623:x1875765413036928:12345-192.168.201.39@tcp:35:rm.0 Request processed in 187us (291us total) trans 4294967304 rc 0/0 00000100:00100000:2.0:1788869414.390640:0:5759:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 4 00000100:00100000:3.0:1788869414.391804:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1788869414.391853:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765413037184 00000100:00100000:2.0:1788869414.391859:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765413037184 00000100:00100000:2.0:1788869414.391903:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 26 00000100:00100000:2.0:1788869414.391914:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c82065c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2125b9b3-626e-4cbe-be83-fb446e976ce2+14:9623:x1875765413037184:12345-192.168.201.39@tcp:101:rm.0 00010000:00010000:2.0:1788869414.391934:0:5786:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788869414.391954:0:5786:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94c805039a00/0x3d2d1916761d65e0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x375c010249035824 expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869414.392044:0:5786:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff94c805038800/0x3d2d1916761d65e7 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869414.392058:0:5786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94c805038800/0x3d2d1916761d65e7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869414.392070:0:5786:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94c805038800/0x3d2d1916761d65e7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788869414.392083:0:5786:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00010000:00010000:2.0:1788869414.392176:0:5786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94c805039a00/0x3d2d1916761d65e0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0x375c010249035824 expref: 17 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869414.392188:0:5786:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94c805038800/0x3d2d1916761d65e7 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0x375c010249035824 expref: 16 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869414.392194:0:5786:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff94c803990a00) 00010000:00010000:2.0:1788869414.392196:0:5786:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1788869414.392199:0:5786:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94c805038800, rc 0) 00000100:00100000:2.0:1788869414.392231:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c82065c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2125b9b3-626e-4cbe-be83-fb446e976ce2+16:9623:x1875765413037184:12345-192.168.201.39@tcp:101:rm.0 Request processed in 321us (430us total) trans 4294967305 rc 0/0 00000100:00100000:2.0:1788869414.392236:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 26 00000100:00100000:1.0:1788869414.396158:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1788869414.396214:0:5756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765413037312 00000100:00100000:2.0:1788869414.396223:0:5756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765413037312 00000100:00100000:2.0:1788869414.396315:0:5756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 27 00000100:00100000:2.0:1788869414.396325:0:5756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c702349c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2125b9b3-626e-4cbe-be83-fb446e976ce2+16:9623:x1875765413037312:12345-192.168.201.39@tcp:41:rm.0 00000004:00000024:2.0:1788869414.396382:0:5756:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 7719616512 avail 7715422208 00000100:00100000:2.0:1788869414.396441:0:5756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c702349c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2125b9b3-626e-4cbe-be83-fb446e976ce2+16:9623:x1875765413037312:12345-192.168.201.39@tcp:41:rm.0 Request processed in 119us (294us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869414.396447:0:5756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 27 00000100:00100000:3.0:1788869414.399587:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1788869414.399644:0:5755:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765413037440 00000100:00100000:0.0:1788869414.399651:0:5755:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765413037440 00000100:00100000:0.0:1788869414.399693:0:5755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 28 00000100:00100000:0.0:1788869414.399700:0:5755:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c82065d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2125b9b3-626e-4cbe-be83-fb446e976ce2+16:9623:x1875765413037440:12345-192.168.201.39@tcp:101:rm.0 00010000:00010000:0.0:1788869414.399715:0:5755:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788869414.399729:0:5755:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94c818d1fa00/0x3d2d1916761d65f5 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x375c01024903582b expref: -99 pid: 5755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869414.399778:0:5755:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff94c818d1e600/0x3d2d1916761d65fc lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869414.399789:0:5755:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94c818d1e600/0x3d2d1916761d65fc lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869414.399797:0:5755:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94c818d1e600/0x3d2d1916761d65fc lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869414.399808:0:5755:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94c818d1e000/0x3d2d1916761d6603 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0xe93be2da bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869414.399813:0:5755:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94c818d1e000/0x3d2d1916761d6603 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xe93be2da bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869414.399816:0:5755:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94c818d1e000/0x3d2d1916761d6603 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xe93be2da bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869414.399929:0:5755:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94c81a582000/0x3d2d1916761d660a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869414.399953:0:5755:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94c81a582000/0x3d2d1916761d660a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869414.399960:0:5755:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94c81a582000/0x3d2d1916761d660a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788869414.399986:0:5755:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x2:0x0]: returning size 0 00000004:00200000:0.0:1788869414.399991:0:5755:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1788869414.400005:0:5755:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff94c81a582000/0x3d2d1916761d660a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869414.400014:0:5755:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94c81a582000/0x3d2d1916761d660a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869414.400021:0:5755:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff94c818d1e600/0x3d2d1916761d65fc lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869414.400025:0:5755:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94c818d1e600/0x3d2d1916761d65fc lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869414.400029:0:5755:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94c818d1e600/0x3d2d1916761d65fc lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869414.400032:0:5755:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94c818d1e600 already unused, calling callback (ffffffffc21124f0) 00010000:00010000:0.0:1788869414.400037:0:5755:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94c818d1e600/0x3d2d1916761d65fc lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869414.400043:0:5755:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94c818d1e600/0x3d2d1916761d65fc lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869414.400055:0:5755:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff94c803990a00) 00010000:00010000:0.0:1788869414.400058:0:5755:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788869414.400074:0:5755:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94c818d1e600/0x3d2d1916761d65fc lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869414.400079:0:5755:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94c818d1e600/0x3d2d1916761d65fc lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869414.400088:0:5755:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94c818d1e000/0x3d2d1916761d6603 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xe93be2da bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869414.400092:0:5755:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94c818d1e000/0x3d2d1916761d6603 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xe93be2da bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869414.400096:0:5755:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94c818d1e000/0x3d2d1916761d6603 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xe93be2da bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869414.400099:0:5755:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94c818d1e000 already unused, calling callback (ffffffffc21124f0) 00010000:00010000:0.0:1788869414.400100:0:5755:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94c818d1e000/0x3d2d1916761d6603 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xe93be2da bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869414.400109:0:5755:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94c818d1e000/0x3d2d1916761d6603 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xe93be2da bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869414.400114:0:5755:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0xe93be2da (ffff94c803990100) 00010000:00010000:0.0:1788869414.400115:0:5755:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788869414.400117:0:5755:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94c818d1e000/0x3d2d1916761d6603 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0xe93be2da bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869414.400120:0:5755:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94c818d1e000/0x3d2d1916761d6603 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0xe93be2da bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869414.400141:0:5755:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94c818d1fa00/0x3d2d1916761d65f5 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0x375c01024903582b expref: 18 pid: 5755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869414.400160:0:5755:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94c81a582000/0x3d2d1916761d660a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0x375c01024903582b expref: 17 pid: 5755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869414.400167:0:5755:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff94c803990400) 00010000:00010000:0.0:1788869414.400169:0:5755:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788869414.400171:0:5755:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94c81a582000, rc 0) 00000100:00100000:0.0:1788869414.400230:0:5755:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c82065d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2125b9b3-626e-4cbe-be83-fb446e976ce2+17:9623:x1875765413037440:12345-192.168.201.39@tcp:101:rm.0 Request processed in 530us (647us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869414.400236:0:5755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 28 00000100:00100000:3.0:1788869414.401982:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1788869414.402047:0:5756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765413037696 00000100:00100000:2.0:1788869414.402056:0:5756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765413037696 00000100:00100000:2.0:1788869414.402103:0:5756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 29 00000100:00100000:2.0:1788869414.402123:0:5756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c82065ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2125b9b3-626e-4cbe-be83-fb446e976ce2+17:9623:x1875765413037696:12345-192.168.201.39@tcp:36:rm.0 00010000:00010000:2.0:1788869414.402159:0:5756:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:2.0:1788869414.402176:0:5756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94c81a582000/0x3d2d1916761d660a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.39@tcp remote: 0x375c01024903582b expref: 17 pid: 5755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869414.402190:0:5756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94c818d1fc00/0x3d2d1916761d65b6 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.39@tcp remote: 0x375c01024903580f expref: 16 pid: 5757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869414.402197:0:5756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff94c803990400) 00010000:00010000:2.0:1788869414.402204:0:5756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94c818d1ec00/0x3d2d1916761d65cb lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.39@tcp remote: 0x375c010249035816 expref: 15 pid: 5755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869414.402210:0:5756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff94c803990a00) 00010000:00010000:2.0:1788869414.402216:0:5756:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788869414.402228:0:5756:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94c805039a00/0x3d2d1916761d6611 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869414.402235:0:5756:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94c805039a00/0x3d2d1916761d6611 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869414.402241:0:5756:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94c805039a00/0x3d2d1916761d6611 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869414.402289:0:5756:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94c805039e00/0x3d2d1916761d6618 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0xe93be2da bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869414.402297:0:5756:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94c805039e00/0x3d2d1916761d6618 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xe93be2da bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869414.402305:0:5756:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94c805039e00/0x3d2d1916761d6618 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xe93be2da bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869414.402429:0:5756:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94c805039600/0x3d2d1916761d661f lrc: 3/0,1 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869414.402437:0:5756:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94c805039600/0x3d2d1916761d661f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869414.402444:0:5756:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94c805039600/0x3d2d1916761d661f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788869414.403084:0:5756:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].2, 64 off8320 00000004:00080000:2.0:1788869414.403095:0:5756:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 162694844119ns, next at 163694841338ns, rc = 0 00010000:00010000:2.0:1788869414.403148:0:5756:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94c805038c00/0x3d2d1916761d6626 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869414.403166:0:5756:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94c805038c00/0x3d2d1916761d6626 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869414.403174:0:5756:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94c805038c00/0x3d2d1916761d6626 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869414.403182:0:5756:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94c805038c00/0x3d2d1916761d6626 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869414.403188:0:5756:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94c805038c00/0x3d2d1916761d6626 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869414.403195:0:5756:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94c805038c00/0x3d2d1916761d6626 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869414.403207:0:5756:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788869414.403223:0:5756:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94c805039600/0x3d2d1916761d661f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869414.403229:0:5756:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94c805039600/0x3d2d1916761d661f lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869414.403236:0:5756:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94c805039600/0x3d2d1916761d661f lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869414.403242:0:5756:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94c805039600 already unused, calling callback (ffffffffc21124f0) 00010000:00010000:2.0:1788869414.403282:0:5756:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94c805039600/0x3d2d1916761d661f lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869414.403290:0:5756:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94c805039600/0x3d2d1916761d661f lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869414.403311:0:5756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff94c802f3f400) 00010000:00010000:2.0:1788869414.403314:0:5756:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1788869414.403318:0:5756:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94c805039600/0x3d2d1916761d661f lrc: 2/0,0 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869414.403324:0:5756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94c805039600/0x3d2d1916761d661f lrc: 0/0,0 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869414.403342:0:5756:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94c805039a00/0x3d2d1916761d6611 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869414.403348:0:5756:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94c805039a00/0x3d2d1916761d6611 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869414.403354:0:5756:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94c805039a00/0x3d2d1916761d6611 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869414.403360:0:5756:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94c805039a00 already unused, calling callback (ffffffffc21124f0) 00010000:00010000:2.0:1788869414.403362:0:5756:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94c805039a00/0x3d2d1916761d6611 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869414.403368:0:5756:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94c805039a00/0x3d2d1916761d6611 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869414.403376:0:5756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff94c803990a00) 00010000:00010000:2.0:1788869414.403378:0:5756:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788869414.403381:0:5756:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94c805039a00/0x3d2d1916761d6611 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869414.403387:0:5756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94c805039a00/0x3d2d1916761d6611 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788869414.403407:0:5756:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000037c3f5a2 reply state 00000000db0af25f transno 4294967306 ns: mdt-lustre-MDT0000_UUID lock: ffff94c805039e00/0x3d2d1916761d6618 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xe93be2da bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788869414.403415:0:5756:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788869414.403490:0:5756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c82065ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2125b9b3-626e-4cbe-be83-fb446e976ce2+16:9623:x1875765413037696:12345-192.168.201.39@tcp:36:rm.0 Request processed in 1368us (1511us total) trans 4294967306 rc 0/0 00000100:00100000:2.0:1788869414.403498:0:5756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 29 00010000:00010000:1.0:1788869414.403641:0:7447:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788869414.403648:0:7447:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94c805038c00/0x3d2d1916761d6626 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869414.403663:0:7447:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94c805038c00 already unused, calling callback (ffffffffc1703220) 00010000:00010000:1.0:1788869414.403667:0:7447:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94c805038c00/0x3d2d1916761d6626 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869414.403673:0:7447:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94c805038c00/0x3d2d1916761d6626 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869414.403681:0:7447:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff94c802f3f400) 00010000:00010000:1.0:1788869414.403684:0:7447:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1788869414.403687:0:7447:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94c805038c00/0x3d2d1916761d6626 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869414.403692:0:7447:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94c805038c00/0x3d2d1916761d6626 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869414.403704:0:7447:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788869414.403706:0:7447:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788869414.403708:0:7447:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788869414.406125:0:3269:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94c805039e00/0x3d2d1916761d6618 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xe93be2da bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869414.406139:0:3269:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94c805039e00/0x3d2d1916761d6618 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xe93be2da bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869414.406146:0:3269:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94c805039e00/0x3d2d1916761d6618 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xe93be2da bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869414.406152:0:3269:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94c805039e00 already unused, calling callback (ffffffffc21124f0) 00010000:00010000:2.0:1788869414.406156:0:3269:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94c805039e00/0x3d2d1916761d6618 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xe93be2da bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869414.406163:0:3269:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94c805039e00/0x3d2d1916761d6618 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xe93be2da bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869414.406176:0:3269:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0xe93be2da (ffff94c802f3f900) 00010000:00010000:2.0:1788869414.406179:0:3269:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788869414.406182:0:3269:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94c805039e00/0x3d2d1916761d6618 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0xe93be2da bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869414.406188:0:3269:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94c805039e00/0x3d2d1916761d6618 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0xe93be2da bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788869414.407099:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1788869414.407371:0:5758:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765413037952 00000100:00100000:0.0:1788869414.407381:0:5758:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765413037952 00000100:00100000:0.0:1788869414.407465:0:5758:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 5 00000100:00100000:0.0:1788869414.407474:0:5758:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c83f9aa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2125b9b3-626e-4cbe-be83-fb446e976ce2+15:9623:x1875765413037952:12345-192.168.201.39@tcp:35:rm.0 00000100:00100000:0.0:1788869414.407702:0:5758:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c83f9aa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2125b9b3-626e-4cbe-be83-fb446e976ce2+16:9623:x1875765413037952:12345-192.168.201.39@tcp:35:rm.0 Request processed in 228us (606us total) trans 4294967307 rc 0/0 00000100:00100000:0.0:1788869414.407712:0:5758:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 5 00000100:00100000:1.0:1788869414.412568:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1788869414.412607:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765413038208 00000100:00100000:2.0:1788869414.412616:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765413038208 00000100:00100000:2.0:1788869414.412661:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 30 00000100:00100000:2.0:1788869414.412668:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c70234ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2125b9b3-626e-4cbe-be83-fb446e976ce2+16:9623:x1875765413038208:12345-192.168.201.39@tcp:36:rm.0 00010000:00010000:2.0:1788869414.412711:0:5786:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:2.0:1788869414.412731:0:5786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94c805038800/0x3d2d1916761d65e7 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.39@tcp remote: 0x375c010249035824 expref: 16 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869414.412745:0:5786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94c818d1e200/0x3d2d1916761d6585 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.39@tcp remote: 0x375c010249035801 expref: 15 pid: 5755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869414.412753:0:5786:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff94c803990a00) 00010000:00010000:2.0:1788869414.412762:0:5786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94c818d1fe00/0x3d2d1916761d6546 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.39@tcp remote: 0x375c0102490357f3 expref: 14 pid: 5757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869414.412766:0:5786:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff94c803990b00) 00010000:00010000:2.0:1788869414.412769:0:5786:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788869414.412794:0:5786:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94c805039a00/0x3d2d1916761d662d lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869414.412803:0:5786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94c805039a00/0x3d2d1916761d662d lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869414.412811:0:5786:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94c805039a00/0x3d2d1916761d662d lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869414.412818:0:5786:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94c805039600/0x3d2d1916761d6634 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869414.412833:0:5786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94c805039600/0x3d2d1916761d6634 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869414.412837:0:5786:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94c805039600/0x3d2d1916761d6634 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869414.413117:0:5786:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94c805038400/0x3d2d1916761d663b lrc: 3/0,1 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869414.413123:0:5786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94c805038400/0x3d2d1916761d663b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869414.413127:0:5786:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94c805038400/0x3d2d1916761d663b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788869414.413735:0:5786:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00010000:00010000:2.0:1788869414.413749:0:5786:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94c805038400/0x3d2d1916761d663b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869414.413756:0:5786:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94c805038400/0x3d2d1916761d663b lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869414.413762:0:5786:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94c805038400/0x3d2d1916761d663b lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869414.413768:0:5786:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94c805038400 already unused, calling callback (ffffffffc21124f0) 00010000:00010000:2.0:1788869414.413772:0:5786:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94c805038400/0x3d2d1916761d663b lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869414.413779:0:5786:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94c805038400/0x3d2d1916761d663b lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869414.413797:0:5786:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff94c802f3f600) 00010000:00010000:2.0:1788869414.413799:0:5786:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1788869414.413803:0:5786:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94c805038400/0x3d2d1916761d663b lrc: 2/0,0 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869414.413809:0:5786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94c805038400/0x3d2d1916761d663b lrc: 0/0,0 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869414.413826:0:5786:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94c805039a00/0x3d2d1916761d662d lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869414.413832:0:5786:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94c805039a00/0x3d2d1916761d662d lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869414.413837:0:5786:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94c805039a00/0x3d2d1916761d662d lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869414.413842:0:5786:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94c805039a00 already unused, calling callback (ffffffffc21124f0) 00010000:00010000:2.0:1788869414.413845:0:5786:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94c805039a00/0x3d2d1916761d662d lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869414.413850:0:5786:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94c805039a00/0x3d2d1916761d662d lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869414.413857:0:5786:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff94c802f3f300) 00010000:00010000:2.0:1788869414.413859:0:5786:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788869414.413862:0:5786:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94c805039a00/0x3d2d1916761d662d lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869414.413867:0:5786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94c805039a00/0x3d2d1916761d662d lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788869414.413888:0:5786:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000aca6487a reply state 000000004dbd1dcd transno 4294967308 ns: mdt-lustre-MDT0000_UUID lock: ffff94c805039600/0x3d2d1916761d6634 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788869414.413896:0:5786:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788869414.413970:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c70234ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2125b9b3-626e-4cbe-be83-fb446e976ce2+15:9623:x1875765413038208:12345-192.168.201.39@tcp:36:rm.0 Request processed in 1301us (1408us total) trans 4294967308 rc 0/0 00000100:00100000:2.0:1788869414.413978:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 30 00010000:00010000:2.0:1788869414.416937:0:3270:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94c805039600/0x3d2d1916761d6634 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869414.416949:0:3270:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94c805039600/0x3d2d1916761d6634 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869414.416954:0:3270:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94c805039600/0x3d2d1916761d6634 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869414.416957:0:3270:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94c805039600 already unused, calling callback (ffffffffc21124f0) 00010000:00010000:2.0:1788869414.416961:0:3270:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94c805039600/0x3d2d1916761d6634 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869414.416965:0:3270:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94c805039600/0x3d2d1916761d6634 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869414.416976:0:3270:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff94c802f3ff00) 00010000:00010000:2.0:1788869414.416978:0:3270:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788869414.416982:0:3270:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94c805039600/0x3d2d1916761d6634 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869414.416986:0:3270:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94c805039600/0x3d2d1916761d6634 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869415.324444:0:5742:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:3.0:1788869416.027476:0:7878:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 164319223053ns, next at 165319220380ns, rc = 0 00000100:00100000:3.0:1788869416.027499:0:3286:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788869416.027519:0:3286:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94c83f9aaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3286:1875765421451264:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788869416.027584:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869416.027656:0:6548:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765421451264 00000100:00100000:3.0:1788869416.027665:0:6548:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765421451264 00000100:00100000:3.0:1788869416.027719:0:6548:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1788869416.027728:0:6548:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c83f9a8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3286:x1875765421451264:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788869416.027771:0:6548:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788869416.027812:0:6548:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c83f9a8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3286:x1875765421451264:12345-0@lo:13:osp-pre-1-0.0 Request processed in 85us (227us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869416.027819:0:6548:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00080000:3.0:1788869416.027838:0:5751:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:3.0:1788869416.027865:0:3286:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff94c83f9aaa00 x1875765421451264/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788869432 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788869416.027882:0:3286:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94c83f9aaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3286:1875765421451264:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788869416.028282:0:3286:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94c83fbb1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:121cd5bc-7f07-4cf7-8e2e-4356c89c0696:3286:1875765421451392:0@lo:400:kworker.0 00000100:00100000:2.0:1788869416.028291:0:3283:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94c83fbb3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3283:1875765421451520:0@lo:400:kworker.0 00000100:00100000:0.0:1788869416.028311:0:3284:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94c83fbb0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3284:1875765421451648:0@lo:400:kworker.0 00000100:00100000:3.0:1788869416.028328:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869416.028328:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869416.028355:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869416.028367:0:3286:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94c83fbb0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3286:1875765421451904:0@lo:400:kworker.0 00000100:00100000:3.0:1788869416.028395:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869416.028395:0:3285:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94c83fbb1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3285:1875765421451776:0@lo:400:kworker.0 00000100:00100000:1.0:1788869416.028431:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869416.028474:0:5748:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765421451392 00000100:00100000:3.0:1788869416.028478:0:5748:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765421451392 00000100:00100000:3.0:1788869416.028516:0:5748:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 230 00000100:00100000:3.0:1788869416.028523:0:5748:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c81f0fcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:121cd5bc-7f07-4cf7-8e2e-4356c89c0696+19:3286:x1875765421451392:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788869416.028564:0:5748:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c81f0fcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:121cd5bc-7f07-4cf7-8e2e-4356c89c0696+19:3286:x1875765421451392:12345-0@lo:400:kworker.0 Request processed in 42us (238us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869416.028583:0:5748:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 230 00000100:00100000:1.0:1788869416.028591:0:3286:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94c83fbb1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:121cd5bc-7f07-4cf7-8e2e-4356c89c0696:3286:1875765421451392:0@lo:400:kworker.0 00000100:00100000:2.0:1788869416.030350:0:5757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765421451520 00000100:00100000:2.0:1788869416.030362:0:5757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765421451520 00000100:00100000:2.0:1788869416.030412:0:5757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765421451648 00000100:00100000:2.0:1788869416.030423:0:5757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765421451648 00000100:00100000:2.0:1788869416.030453:0:5757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765421451904 00000100:00100000:2.0:1788869416.030457:0:5757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765421451904 00000100:00100000:2.0:1788869416.030474:0:5757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00080000:1.0:1788869416.030497:0:5751:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788869416.030530:0:5757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c810e69f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3283:x1875765421451520:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788869416.030600:0:5757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c810e69f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3283:x1875765421451520:12345-0@lo:400:kworker.0 Request processed in 72us (2273us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869416.030652:0:3283:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94c83fbb3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3283:1875765421451520:0@lo:400:kworker.0 00000100:00100000:3.0:1788869416.032026:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1788869416.032033:0:5757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1788869416.032042:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c83fbb1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3284:x1875765421451648:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788869416.032060:0:5757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1788869416.032067:0:5757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c83f9aaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3286:x1875765421451904:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788869416.032108:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c83fbb1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3284:x1875765421451648:12345-0@lo:400:kworker.0 Request processed in 72us (3755us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869416.032115:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1788869416.032147:0:3284:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94c83fbb0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3284:1875765421451648:0@lo:400:kworker.0 00000100:00100000:2.0:1788869416.032147:0:5757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c83f9aaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3286:x1875765421451904:12345-0@lo:400:kworker.0 Request processed in 81us (3750us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869416.032154:0:5757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1788869416.032179:0:6546:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765421451776 00000100:00100000:2.0:1788869416.032184:0:6546:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765421451776 00000100:00100000:2.0:1788869416.032235:0:6546:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1788869416.032243:0:6546:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c702349500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3285:x1875765421451776:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788869416.032299:0:6546:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c702349500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3285:x1875765421451776:12345-0@lo:400:kworker.0 Request processed in 58us (3867us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869416.032306:0:6546:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00010000:00080000:2.0:1788869416.032353:0:3285:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff94c83fbb1180 x1875765421451776/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788869432 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788869416.032365:0:3285:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94c83fbb1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3285:1875765421451776:0@lo:400:kworker.0 00000100:00100000:1.0:1788869416.032609:0:3286:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94c83fbb0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3286:1875765421451904:0@lo:400:kworker.0 00000100:00080000:3.0:1788869416.032679:0:5751:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:02000400:2.0:1788869416.129528:0:11418:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: excepting tests: 6 7a 7b 23 35 33 00010000:00010000:3.0:1788869416.347391:0:5743:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1788869416.664113:0:11466:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffe7beeab90 20000000:00000080:2.0:1788869416.664131:0:11466:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff94c820780c00 uarg=0000000000000000 20000000:01000000:2.0:1788869416.664161:0:11466:0:(mgs_llog.c:6188:mgs_set_param2()) set_param2 fs='' device='lustre' param='mdt.lustre-MDT0000.hsm_control=enabled' 20000000:01000000:2.0:1788869416.664167:0:11466:0:(mgs_llog.c:4643:mgs_write_log_param2()) next param 'mdt.lustre-MDT0000.hsm_control=enabled' 20000000:01000000:2.0:1788869416.664171:0:11466:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/lustre/mdt.lustre-MDT0000.hsm_control=enabled del=0 00000040:00080000:1.0:1788869416.665328:0:11467:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 20000000:02000000:2.0:1788869416.665711:0:11466:0:(mgs_llog.c:4116:mgs_wlp_lcfg()) Setting parameter lustre.mdt.lustre-MDT0000.hsm_control=enabled in log params 00000040:00080000:2.0:1788869416.669309:0:11466:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9536 00000040:00080000:2.0:1788869416.669360:0:11466:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].8, 128 off9664 00000040:00080000:2.0:1788869416.669407:0:11466:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].9, 224 off9888 10000000:01000000:2.0:1788869416.669424:0:11466:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:2.0:1788869416.669442:0:11466:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff94c805038e00/0x3d2d1916761d6642 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869416.669459:0:11466:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff94c83504cc00/0x3d2d1916761d64eb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3d2d1916761d64e4 expref: 18 pid: 5748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869416.669468:0:11466:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff94c818d1f600/0x3d2d1916761d64f9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3d2d1916761d64f2 expref: 18 pid: 5749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869416.669475:0:11466:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff94c818d1f000/0x3d2d1916761d6507 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3d2d1916761d6500 expref: 18 pid: 5748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869416.669484:0:11466:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff94c83504ce00/0x3d2d1916761d650e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.201.39@tcp remote: 0x375c0102490357de expref: 12 pid: 5750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869416.669491:0:11466:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff94c8421f2800/0x3d2d1916761d6515 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.201.39@tcp remote: 0x375c0102490357e5 expref: 12 pid: 5750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869416.669506:0:11466:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff94c805038e00/0x3d2d1916761d6642 lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 11466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869416.669542:0:11466:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff94c8421f2800/0x3d2d1916761d6515 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.201.39@tcp remote: 0x375c0102490357e5 expref: 12 pid: 5750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869416.669557:0:11466:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff94c8421f2800/0x3d2d1916761d6515 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.201.39@tcp remote: 0x375c0102490357e5 expref: 12 pid: 5750 timeout: 264 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788869416.669571:0:11466:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94c810e6a680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11466:1875765421452032:192.168.201.39@tcp:104: 00010000:00010000:2.0:1788869416.669670:0:11466:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff94c83504ce00/0x3d2d1916761d650e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.201.39@tcp remote: 0x375c0102490357de expref: 12 pid: 5750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869416.669680:0:11466:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff94c83504ce00/0x3d2d1916761d650e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.201.39@tcp remote: 0x375c0102490357de expref: 12 pid: 5750 timeout: 264 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788869416.669690:0:11466:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94c810e6aa00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11466:1875765421452160:192.168.201.39@tcp:104: 00010000:00010000:2.0:1788869416.669718:0:11466:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff94c818d1f000/0x3d2d1916761d6507 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x3d2d1916761d6500 expref: 18 pid: 5748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869416.669727:0:11466:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff94c818d1f000/0x3d2d1916761d6507 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x3d2d1916761d6500 expref: 18 pid: 5748 timeout: 314 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788869416.669748:0:11466:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94c810e68a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11466:1875765421452288:0@lo:104: 00000100:00100000:2.0:1788869416.669785:0:11466:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788869416.669812:0:11466:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff94c818d1f600/0x3d2d1916761d64f9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x3d2d1916761d64f2 expref: 18 pid: 5749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788869416.669825:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765421452288 00000100:00100000:0.0:1788869416.669834:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765421452288 00010000:00010000:2.0:1788869416.669835:0:11466:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff94c818d1f600/0x3d2d1916761d64f9 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x3d2d1916761d64f2 expref: 18 pid: 5749 timeout: 314 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788869416.669847:0:11466:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94c810e6a300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11466:1875765421452416:0@lo:104: 00000100:00100000:2.0:1788869416.669871:0:11466:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869416.669895:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765421452416 00000100:00100000:0.0:1788869416.669907:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765421452416 00010000:00010000:2.0:1788869416.669910:0:11466:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff94c83504cc00/0x3d2d1916761d64eb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x3d2d1916761d64e4 expref: 18 pid: 5748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869416.669921:0:11466:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff94c83504cc00/0x3d2d1916761d64eb lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x3d2d1916761d64e4 expref: 18 pid: 5748 timeout: 314 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788869416.669932:0:11466:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94c810e6bb80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11466:1875765421452544:0@lo:104: 00000100:00100000:1.0:1788869416.669938:0:5738:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1788869416.669953:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1788869416.669961:0:11466:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869416.669961:0:5738:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c810e6b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:121cd5bc-7f07-4cf7-8e2e-4356c89c0696+4:11466:x1875765421452288:12345-0@lo:104: 00000100:00100000:0.0:1788869416.669968:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c810e69880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:121cd5bc-7f07-4cf7-8e2e-4356c89c0696+4:11466:x1875765421452416:12345-0@lo:104: 00000100:00100000:2.0:1788869416.669975:0:11466:0:(client.c:2702:ptlrpc_set_wait()) set ffff94c8357d5180 going to sleep for 11 seconds 00010000:00010000:1.0:1788869416.669978:0:5738:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.139@tcp lock: ffff94c83504c800/0x3d2d1916761d6500 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x3d2d1916761d6507 expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788869416.669979:0:5737:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00010000:00010000:0.0:1788869416.669980:0:5787:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.139@tcp lock: ffff94c83504ca00/0x3d2d1916761d64f2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x3d2d1916761d64f9 expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788869416.670006:0:5737:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 3 min 2 max 56 00000100:00100000:3.0:1788869416.670014:0:5737:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_003' 00010000:00010000:0.0:1788869416.670073:0:5787:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788869416.670080:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c810e69880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:121cd5bc-7f07-4cf7-8e2e-4356c89c0696+4:11466:x1875765421452416:12345-0@lo:104: Request processed in 119us (208us total) trans 0 rc 0/0 00010000:00010000:1.0:1788869416.670084:0:5738:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1788869416.670089:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1788869416.670095:0:5738:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c810e6b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:121cd5bc-7f07-4cf7-8e2e-4356c89c0696+4:11466:x1875765421452288:12345-0@lo:104: Request processed in 139us (306us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869416.670104:0:5738:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1788869416.670109:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765421452544 00000100:00100000:0.0:1788869416.670114:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765421452544 00010000:00010000:1.0:1788869416.670137:0:5742:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00000100:00100000:2.0:1788869416.670143:0:11466:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94c810e68a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11466:1875765421452288:0@lo:104: 00010000:00010000:1.0:1788869416.670145:0:5742:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.139@tcp lock: ffff94c83504ca00/0x3d2d1916761d64f2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x3d2d1916761d64f9 expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869416.670156:0:5742:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94c83504ca00 already unused, calling callback (ffffffffc1ce9c20) 00000100:00100000:0.0:1788869416.670156:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1788869416.670158:0:11466:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94c810e6a300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11466:1875765421452416:0@lo:104: 10000000:00010000:1.0:1788869416.670163:0:5742:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.139@tcp lock: ffff94c83504ca00/0x3d2d1916761d64f2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x3d2d1916761d64f9 expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869416.670173:0:5742:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.139@tcp lock: ffff94c83504ca00/0x3d2d1916761d64f2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x3d2d1916761d64f9 expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788869416.670180:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c82ce9f850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:121cd5bc-7f07-4cf7-8e2e-4356c89c0696+3:11466:x1875765421452544:12345-0@lo:104: 10000000:00010000:1.0:1788869416.670186:0:5742:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.139@tcp lock: ffff94c83504ca00/0x3d2d1916761d64f2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x3d2d1916761d64f9 expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869416.670190:0:5787:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.139@tcp lock: ffff94c8421f3c00/0x3d2d1916761d64e4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x3d2d1916761d64eb expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788869416.670198:0:5742:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1788869416.670247:0:5742:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.139@tcp lock: ffff94c83504ca00/0x3d2d1916761d64f2 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3d2d1916761d64f9 expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869416.670268:0:5787:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1788869416.670276:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c82ce9f850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:121cd5bc-7f07-4cf7-8e2e-4356c89c0696+3:11466:x1875765421452544:12345-0@lo:104: Request processed in 99us (317us total) trans 0 rc 0/0 00010000:00010000:1.0:1788869416.670281:0:5742:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:0.0:1788869416.670289:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1788869416.670292:0:11466:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94c810e6bb80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11466:1875765421452544:0@lo:104: 00010000:00010000:1.0:1788869416.670300:0:5742:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.139@tcp lock: ffff94c83504ca00/0x3d2d1916761d64f2 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3d2d1916761d64f9 expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869416.670314:0:5742:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.139@tcp lock: ffff94c83504ca00/0x3d2d1916761d64f2 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3d2d1916761d64f9 expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869416.670325:0:5742:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788869416.670327:0:5742:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.139@tcp lock: ffff94c83504c800/0x3d2d1916761d6500 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x3d2d1916761d6507 expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869416.670331:0:5742:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94c83504c800 already unused, calling callback (ffffffffc1ce9c20) 10000000:00010000:1.0:1788869416.670333:0:5742:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.139@tcp lock: ffff94c83504c800/0x3d2d1916761d6500 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x3d2d1916761d6507 expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869416.670337:0:5742:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.139@tcp lock: ffff94c83504c800/0x3d2d1916761d6500 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x3d2d1916761d6507 expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788869416.670341:0:5742:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.139@tcp lock: ffff94c83504c800/0x3d2d1916761d6500 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x3d2d1916761d6507 expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788869416.670344:0:5742:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1788869416.670360:0:5742:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.139@tcp lock: ffff94c83504c800/0x3d2d1916761d6500 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3d2d1916761d6507 expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869416.670364:0:5742:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788869416.670369:0:5742:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.139@tcp lock: ffff94c83504c800/0x3d2d1916761d6500 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3d2d1916761d6507 expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869416.670373:0:7447:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788869416.670374:0:5742:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.139@tcp lock: ffff94c83504c800/0x3d2d1916761d6500 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3d2d1916761d6507 expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869416.670382:0:7447:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.139@tcp lock: ffff94c8421f3c00/0x3d2d1916761d64e4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x3d2d1916761d64eb expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869416.670384:0:5742:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788869416.670389:0:5742:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788869416.670394:0:5742:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788869416.670395:0:7447:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94c8421f3c00 already unused, calling callback (ffffffffc1ce9c20) 10000000:00010000:0.0:1788869416.670399:0:7447:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.139@tcp lock: ffff94c8421f3c00/0x3d2d1916761d64e4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x3d2d1916761d64eb expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869416.670408:0:7447:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.139@tcp lock: ffff94c8421f3c00/0x3d2d1916761d64e4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x3d2d1916761d64eb expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788869416.670413:0:3283:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94c70234b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:121cd5bc-7f07-4cf7-8e2e-4356c89c0696:3283:1875765421452672:0@lo:103:ldlm_bl.0 10000000:00010000:0.0:1788869416.670417:0:7447:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.139@tcp lock: ffff94c8421f3c00/0x3d2d1916761d64e4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x3d2d1916761d64eb expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788869416.670435:0:7447:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00000100:00100000:1.0:1788869416.670447:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788869416.670464:0:7447:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.139@tcp lock: ffff94c8421f3c00/0x3d2d1916761d64e4 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3d2d1916761d64eb expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869416.670472:0:7447:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:1.0:1788869416.670482:0:3283:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788869416.670491:0:3283:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94c702348700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:121cd5bc-7f07-4cf7-8e2e-4356c89c0696:3283:1875765421452800:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788869416.670496:0:3285:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94c83fbb2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:121cd5bc-7f07-4cf7-8e2e-4356c89c0696:3285:1875765421452928:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788869416.670504:0:7447:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.139@tcp lock: ffff94c8421f3c00/0x3d2d1916761d64e4 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3d2d1916761d64eb expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788869416.670514:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788869416.670514:0:7447:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.139@tcp lock: ffff94c8421f3c00/0x3d2d1916761d64e4 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3d2d1916761d64eb expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869416.670535:0:7447:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788869416.670539:0:7447:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788869416.670542:0:7447:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788869416.670551:0:5743:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788869416.670552:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869416.670587:0:5741:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765421452672 00000100:00100000:1.0:1788869416.670592:0:5741:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765421452672 00010000:00010000:1.0:1788869416.670611:0:5741:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff94c818d1f600/0x3d2d1916761d64f9 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3d2d1916761d64f2 expref: 19 pid: 5749 timeout: 314 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788869416.670636:0:5741:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765421452800 00000100:00100000:1.0:1788869416.670639:0:5741:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765421452800 00010000:00010000:1.0:1788869416.670660:0:5741:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff94c818d1f000/0x3d2d1916761d6507 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3d2d1916761d6500 expref: 20 pid: 5748 timeout: 314 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788869416.670677:0:5741:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765421452928 00000100:00100000:1.0:1788869416.670680:0:5741:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765421452928 00010000:00010000:1.0:1788869416.670689:0:5741:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff94c83504cc00/0x3d2d1916761d64eb lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3d2d1916761d64e4 expref: 21 pid: 5748 timeout: 314 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788869416.670703:0:5741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1788869416.670719:0:5741:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c702349180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:121cd5bc-7f07-4cf7-8e2e-4356c89c0696+21:3283:x1875765421452672:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788869416.670728:0:5741:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788869416.670733:0:5741:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff94c818d1f600/0x3d2d1916761d64f9 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3d2d1916761d64f2 expref: 21 pid: 5749 timeout: 314 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869416.670741:0:5741:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff94c818d1f600/0x3d2d1916761d64f9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x3d2d1916761d64f2 expref: 21 pid: 5749 timeout: 314 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869416.670764:0:5741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff94c818d1f600/0x3d2d1916761d64f9 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x3d2d1916761d64f2 expref: 21 pid: 5749 timeout: 314 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869416.670775:0:5741:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788869416.670807:0:5741:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c702349180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:121cd5bc-7f07-4cf7-8e2e-4356c89c0696+20:3283:x1875765421452672:12345-0@lo:103:ldlm_bl.0 Request processed in 99us (361us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869416.670814:0:5741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1788869416.670832:0:3283:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94c70234b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:121cd5bc-7f07-4cf7-8e2e-4356c89c0696:3283:1875765421452672:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788869416.670833:0:5741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1788869416.670846:0:5741:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c702348e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:121cd5bc-7f07-4cf7-8e2e-4356c89c0696+19:3283:x1875765421452800:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788869416.670854:0:5741:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1788869416.670856:0:5739:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00010000:00010000:1.0:1788869416.670861:0:5741:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff94c818d1f000/0x3d2d1916761d6507 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3d2d1916761d6500 expref: 19 pid: 5748 timeout: 314 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788869416.670870:0:5739:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c810ef1c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:121cd5bc-7f07-4cf7-8e2e-4356c89c0696+19:3285:x1875765421452928:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788869416.670871:0:5741:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff94c818d1f000/0x3d2d1916761d6507 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x3d2d1916761d6500 expref: 19 pid: 5748 timeout: 314 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869416.670883:0:5739:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788869416.670886:0:5741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff94c818d1f000/0x3d2d1916761d6507 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x3d2d1916761d6500 expref: 19 pid: 5748 timeout: 314 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869416.670891:0:5739:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff94c83504cc00/0x3d2d1916761d64eb lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3d2d1916761d64e4 expref: 19 pid: 5748 timeout: 314 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869416.670897:0:5741:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788869416.670905:0:5739:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff94c83504cc00/0x3d2d1916761d64eb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x3d2d1916761d64e4 expref: 18 pid: 5748 timeout: 314 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869416.670917:0:5739:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff94c83504cc00/0x3d2d1916761d64eb lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x3d2d1916761d64e4 expref: 18 pid: 5748 timeout: 314 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869416.670929:0:5739:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788869416.670933:0:5741:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c702348e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:121cd5bc-7f07-4cf7-8e2e-4356c89c0696+17:3283:x1875765421452800:12345-0@lo:103:ldlm_bl.0 Request processed in 90us (420us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869416.670941:0:3283:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94c702348700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:121cd5bc-7f07-4cf7-8e2e-4356c89c0696:3283:1875765421452800:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788869416.670942:0:5741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1788869416.670980:0:5739:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c810ef1c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:121cd5bc-7f07-4cf7-8e2e-4356c89c0696+16:3285:x1875765421452928:12345-0@lo:103:ldlm_bl.0 Request processed in 114us (429us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869416.670995:0:5739:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1788869416.671003:0:3285:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94c83fbb2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:121cd5bc-7f07-4cf7-8e2e-4356c89c0696:3285:1875765421452928:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788869416.671522:0:11466:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94c810e6a680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11466:1875765421452032:192.168.201.39@tcp:104: 00000100:00100000:3.0:1788869416.672355:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1788869416.672457:0:5741:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765413038336 00000100:00100000:2.0:1788869416.672462:0:5741:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765413038336 00010000:00010000:2.0:1788869416.672488:0:5741:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff94c8421f2800/0x3d2d1916761d6515 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.201.39@tcp remote: 0x375c0102490357e5 expref: 13 pid: 5750 timeout: 264 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788869416.672518:0:5741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 33 00000100:00100000:2.0:1788869416.672526:0:5741:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c83f9ab800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3cca3acf-4935-4d0d-9982-d5d931f1c86b+13:2347:x1875765413038336:12345-192.168.201.39@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788869416.672535:0:5741:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788869416.672539:0:5741:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff94c8421f2800/0x3d2d1916761d6515 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.201.39@tcp remote: 0x375c0102490357e5 expref: 13 pid: 5750 timeout: 264 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869416.672549:0:5741:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff94c8421f2800/0x3d2d1916761d6515 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.201.39@tcp remote: 0x375c0102490357e5 expref: 13 pid: 5750 timeout: 264 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869416.672561:0:5741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff94c8421f2800/0x3d2d1916761d6515 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.201.39@tcp remote: 0x375c0102490357e5 expref: 13 pid: 5750 timeout: 264 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869416.672572:0:5741:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788869416.672605:0:5741:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c83f9ab800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3cca3acf-4935-4d0d-9982-d5d931f1c86b+12:2347:x1875765413038336:12345-192.168.201.39@tcp:103:ldlm_bl.0 Request processed in 80us (252us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869416.672613:0:5741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 33 00000100:00100000:3.0:1788869416.672848:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1788869416.672916:0:11466:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94c810e6aa00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11466:1875765421452160:192.168.201.39@tcp:104: 00000100:00100000:1.0:1788869416.672933:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765413038464 00000100:00100000:1.0:1788869416.672939:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765413038464 00010000:00010000:2.0:1788869416.672949:0:11466:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff94c805038e00/0x3d2d1916761d6642 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869416.672961:0:5788:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff94c83504ce00/0x3d2d1916761d650e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.201.39@tcp remote: 0x375c0102490357de expref: 12 pid: 5750 timeout: 264 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788869416.672991:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 34 00000100:00100000:1.0:1788869416.673007:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c83f9aa300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3cca3acf-4935-4d0d-9982-d5d931f1c86b+12:2347:x1875765413038464:12345-192.168.201.39@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788869416.673016:0:5788:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788869416.673021:0:5788:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff94c83504ce00/0x3d2d1916761d650e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.201.39@tcp remote: 0x375c0102490357de expref: 12 pid: 5750 timeout: 264 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869416.673032:0:5788:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff94c83504ce00/0x3d2d1916761d650e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.201.39@tcp remote: 0x375c0102490357de expref: 12 pid: 5750 timeout: 264 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869416.673043:0:5788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff94c83504ce00/0x3d2d1916761d650e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.201.39@tcp remote: 0x375c0102490357de expref: 12 pid: 5750 timeout: 264 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869416.673055:0:5788:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff94c805038e00/0x3d2d1916761d6642 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 11466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869416.673062:0:5788:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff94c805038e00/0x3d2d1916761d6642 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 11466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869416.673076:0:5788:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff94c805038e00/0x3d2d1916761d6642 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869416.673083:0:5788:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff94c805038e00/0x3d2d1916761d6642 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869416.673090:0:5788:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff94c805038e00/0x3d2d1916761d6642 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869416.673097:0:5788:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff94c805038e00/0x3d2d1916761d6642 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869416.673103:0:5788:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94c805038e00 already unused, calling callback (ffffffffc1703220) 00010000:00010000:1.0:1788869416.673107:0:5788:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff94c805038e00/0x3d2d1916761d6642 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869416.673120:0:5788:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff94c805038e00/0x3d2d1916761d6642 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 11466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869416.673149:0:5788:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff94c805038e00/0x3d2d1916761d6642 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869416.673158:0:5788:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788869416.673171:0:11466:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff94c805038e00/0x3d2d1916761d6642 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869416.673180:0:11466:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff94c805038e00/0x3d2d1916761d6642 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788869416.673190:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c83f9aa300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3cca3acf-4935-4d0d-9982-d5d931f1c86b+11:2347:x1875765413038464:12345-192.168.201.39@tcp:103:ldlm_bl.0 Request processed in 183us (340us total) trans 0 rc 0/0 00010000:00010000:2.0:1788869416.673220:0:11466:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff94c805038e00/0x3d2d1916761d6642 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788869416.673220:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 34 00010000:00010000:1.0:1788869417.371738:0:5742:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788869417.391073:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1788869417.391115:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1788869417.391124:0:5750:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765413038592 00000100:00100000:1.0:1788869417.391135:0:5750:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765413038592 00000100:00100000:0.0:1788869417.391166:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1788869417.391175:0:6544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765413038848 00000100:00100000:3.0:1788869417.391180:0:6544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765413038848 00000100:00100000:1.0:1788869417.391187:0:5750:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 231 00000100:00100000:1.0:1788869417.391211:0:5750:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c81f0ff050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3cca3acf-4935-4d0d-9982-d5d931f1c86b+11:2347:x1875765413038592:12345-192.168.201.39@tcp:400:kworker.0 00000100:00100000:3.0:1788869417.391240:0:6544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 32 00000100:00100000:3.0:1788869417.391246:0:6544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c83fbb0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2125b9b3-626e-4cbe-be83-fb446e976ce2+5:2347:x1875765413038848:12345-192.168.201.39@tcp:400:kworker.0 00000100:00100000:3.0:1788869417.391297:0:6544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c83fbb0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2125b9b3-626e-4cbe-be83-fb446e976ce2+5:2347:x1875765413038848:12345-192.168.201.39@tcp:400:kworker.0 Request processed in 50us (181us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869417.391297:0:5750:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c81f0ff050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3cca3acf-4935-4d0d-9982-d5d931f1c86b+11:2347:x1875765413038592:12345-192.168.201.39@tcp:400:kworker.0 Request processed in 102us (233us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869417.391306:0:6544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 32 00000100:00100000:1.0:1788869417.391306:0:5750:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 231 00000100:00100000:0.0:1788869417.391322:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00080000:3.0:1788869417.391329:0:5751:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788869417.391433:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765413038720 00000100:00100000:1.0:1788869417.391433:0:5757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765413038976 00000100:00100000:2.0:1788869417.391439:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765413038720 00000100:00100000:1.0:1788869417.391440:0:5757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765413038976 00000100:00080000:3.0:1788869417.391467:0:5751:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788869417.391493:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 60 00000100:00100000:1.0:1788869417.391501:0:5757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 61 00000100:00100000:1.0:1788869417.391511:0:5757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c83fbb0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:10cd6f3c-009b-4acc-9ca5-e50cb17e412c+5:2347:x1875765413038976:12345-192.168.201.39@tcp:400:kworker.0 00000100:00100000:1.0:1788869417.391548:0:5757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c83fbb0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:10cd6f3c-009b-4acc-9ca5-e50cb17e412c+5:2347:x1875765413038976:12345-192.168.201.39@tcp:400:kworker.0 Request processed in 39us (228us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869417.391559:0:5757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 61 00000100:00100000:2.0:1788869417.391561:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c83fbb2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2125b9b3-626e-4cbe-be83-fb446e976ce2+14:2347:x1875765413038720:12345-192.168.201.39@tcp:400:kworker.0 00000100:00100000:2.0:1788869417.391721:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c83fbb2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2125b9b3-626e-4cbe-be83-fb446e976ce2+14:2347:x1875765413038720:12345-192.168.201.39@tcp:400:kworker.0 Request processed in 219us (556us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869417.391729:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 60 00000100:00100000:3.0:1788869417.397735:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1788869417.397780:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1788869417.397912:0:6547:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765413039104 00000100:00100000:0.0:1788869417.397922:0:6547:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765413039104 00000100:00080000:3.0:1788869417.397985:0:5751:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788869417.397995:0:6547:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765413039232 00000100:00100000:0.0:1788869417.398000:0:6547:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765413039232 00000100:00080000:3.0:1788869417.398022:0:5751:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788869417.398033:0:6547:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 16 00000100:00100000:0.0:1788869417.398056:0:6547:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c83f9a9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:10cd6f3c-009b-4acc-9ca5-e50cb17e412c+5:2344:x1875765413039104:12345-192.168.201.39@tcp:9:kworker.0 00000020:00000080:0.0:1788869417.398085:0:6547:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x3d2d1916761d64cf 00000100:00080000:0.0:1788869417.398094:0:6547:0:(import.c:65:import_set_state_nolock()) ffff94c835500800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1788869417.398136:0:6547:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967298 00010000:00010000:3.0:1788869417.398137:0:7447:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788869417.398286:0:6546:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 17 00000100:00100000:2.0:1788869417.398300:0:6546:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c83f9abb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:10cd6f3c-009b-4acc-9ca5-e50cb17e412c+5:2344:x1875765413039232:12345-192.168.201.39@tcp:9:kworker.0 00000020:00000080:2.0:1788869417.398316:0:6546:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x3d2d1916761d64d6 00000100:00080000:2.0:1788869417.398322:0:6546:0:(import.c:65:import_set_state_nolock()) ffff94c835501800 : changing import state from FULL to CLOSED 00010000:00010000:3.0:1788869417.398360:0:5743:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00000004:2.0:1788869417.398368:0:6546:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967299 00000100:00100000:2.0:1788869417.398639:0:6546:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c83f9abb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:10cd6f3c-009b-4acc-9ca5-e50cb17e412c+2:2344:x1875765413039232:12345-192.168.201.39@tcp:9:kworker.0 Request processed in 345us (858us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869417.398646:0:6546:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 17 00000100:00100000:0.0:1788869417.399554:0:6547:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c83f9a9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:10cd6f3c-009b-4acc-9ca5-e50cb17e412c+2:2344:x1875765413039104:12345-192.168.201.39@tcp:9:kworker.0 Request processed in 1498us (1824us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869417.399564:0:6547:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 16 00000100:00100000:0.0:1788869418.075532:0:3286:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94c83f9a8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3286:1875765421453056:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788869418.075601:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869418.075741:0:6548:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765421453056 00000100:00100000:3.0:1788869418.075749:0:6548:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765421453056 00000100:00100000:3.0:1788869418.075861:0:6548:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1788869418.075872:0:6548:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c83fbb1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3286:x1875765421453056:12345-0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1788869418.076138:0:5751:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00000024:3.0:1788869418.077012:0:6548:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788869418.077091:0:6548:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c83fbb1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3286:x1875765421453056:12345-0@lo:13:osp-pre-0-0.0 Request processed in 1221us (1488us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869418.077099:0:6548:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00010000:00080000:0.0:1788869418.077191:0:3286:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff94c83f9a8380 x1875765421453056/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788869434 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788869418.078425:0:3286:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94c83f9a8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3286:1875765421453056:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788869418.094066:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1788869418.094132:0:5748:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765413039360 00000100:00100000:0.0:1788869418.094140:0:5748:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765413039360 00000100:00100000:0.0:1788869418.094212:0:5748:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 232 00000100:00100000:0.0:1788869418.094223:0:5748:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c81f0fc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3cca3acf-4935-4d0d-9982-d5d931f1c86b+11:5555:x1875765413039360:12345-192.168.201.39@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788869418.094278:0:5748:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788869418.094295:0:5748:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff94c81a582c00/0x3d2d1916761d6649 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x375c010249035832 expref: -99 pid: 5748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869418.094316:0:5748:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff94c81a582c00/0x3d2d1916761d6649 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.201.39@tcp remote: 0x375c010249035832 expref: 12 pid: 5748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869418.094324:0:5748:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff94c81a582c00/0x3d2d1916761d6649 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.201.39@tcp remote: 0x375c010249035832 expref: 12 pid: 5748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869418.094331:0:5748:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94c81a582c00, rc 0) 00000100:00100000:0.0:1788869418.094376:0:5748:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c81f0fc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3cca3acf-4935-4d0d-9982-d5d931f1c86b+12:5555:x1875765413039360:12345-192.168.201.39@tcp:101:ll_cfg_requeue.0 Request processed in 155us (318us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869418.094382:0:5748:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 232 00000100:00100000:3.0:1788869418.100146:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1788869418.100499:0:5749:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765413039488 00000100:00100000:1.0:1788869418.100510:0:5749:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765413039488 00000100:00100000:1.0:1788869418.100569:0:5749:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 233 00000100:00100000:1.0:1788869418.100579:0:5749:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c81f0fd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3cca3acf-4935-4d0d-9982-d5d931f1c86b+12:5555:x1875765413039488:12345-192.168.201.39@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788869418.100836:0:5749:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c81f0fd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3cca3acf-4935-4d0d-9982-d5d931f1c86b+12:5555:x1875765413039488:12345-192.168.201.39@tcp:501:ll_cfg_requeue.0 Request processed in 257us (699us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869418.100848:0:5749:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 233 00000100:00100000:3.0:1788869418.104514:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1788869418.104612:0:5750:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765413039616 00000100:00100000:1.0:1788869418.104622:0:5750:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765413039616 00000100:00100000:1.0:1788869418.104682:0:5750:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 234 00000100:00100000:1.0:1788869418.104692:0:5750:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c81f0fc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3cca3acf-4935-4d0d-9982-d5d931f1c86b+12:5555:x1875765413039616:12345-192.168.201.39@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788869418.104902:0:5750:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c81f0fc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3cca3acf-4935-4d0d-9982-d5d931f1c86b+12:5555:x1875765413039616:12345-192.168.201.39@tcp:503:ll_cfg_requeue.0 Request processed in 211us (396us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869418.104911:0:5750:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 234 00000100:00100000:3.0:1788869418.119200:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1788869418.119350:0:5748:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765413039744 00000100:00100000:0.0:1788869418.119359:0:5748:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765413039744 00000100:00100000:0.0:1788869418.119419:0:5748:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 235 00000100:00100000:0.0:1788869418.119429:0:5748:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c81f0f9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3cca3acf-4935-4d0d-9982-d5d931f1c86b+12:9893:x1875765413039744:12345-192.168.201.39@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788869418.119769:0:5748:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c81f0f9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3cca3acf-4935-4d0d-9982-d5d931f1c86b+12:9893:x1875765413039744:12345-192.168.201.39@tcp:502:llog_process_th.0 Request processed in 338us (588us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869418.119778:0:5748:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 235 00000100:00100000:3.0:1788869418.129522:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1788869418.131338:0:5750:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765413039872 00000100:00100000:1.0:1788869418.131352:0:5750:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765413039872 00000100:00100000:1.0:1788869418.131419:0:5750:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 236 00000100:00100000:1.0:1788869418.131430:0:5750:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c81f0fa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3cca3acf-4935-4d0d-9982-d5d931f1c86b+12:9893:x1875765413039872:12345-192.168.201.39@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788869418.131681:0:5750:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c81f0fa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3cca3acf-4935-4d0d-9982-d5d931f1c86b+12:9893:x1875765413039872:12345-192.168.201.39@tcp:502:llog_process_th.0 Request processed in 253us (2167us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869418.131690:0:5750:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 236 00000100:00100000:3.0:1788869418.136535:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1788869418.138315:0:5749:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765413040000 00000100:00100000:2.0:1788869418.138329:0:5749:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765413040000 00000100:00100000:2.0:1788869418.138392:0:5749:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 237 00000100:00100000:2.0:1788869418.138403:0:5749:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c81f0fbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3cca3acf-4935-4d0d-9982-d5d931f1c86b+12:5555:x1875765413040000:12345-192.168.201.39@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788869418.138422:0:5749:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788869418.138439:0:5749:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff94c805038e00/0x3d2d1916761d6650 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x375c010249035839 expref: -99 pid: 5749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869418.138482:0:5749:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff94c805038e00/0x3d2d1916761d6650 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.201.39@tcp remote: 0x375c010249035839 expref: 13 pid: 5749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869418.138494:0:5749:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff94c805038e00/0x3d2d1916761d6650 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.201.39@tcp remote: 0x375c010249035839 expref: 13 pid: 5749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869418.138503:0:5749:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94c805038e00, rc 0) 00000100:00100000:2.0:1788869418.138570:0:5749:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c81f0fbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3cca3acf-4935-4d0d-9982-d5d931f1c86b+13:5555:x1875765413040000:12345-192.168.201.39@tcp:101:ll_cfg_requeue.0 Request processed in 168us (2044us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869418.138577:0:5749:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 237 00000100:00100000:3.0:1788869418.145862:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1788869418.145972:0:5750:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765413040128 00000100:00100000:1.0:1788869418.145980:0:5750:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765413040128 00000100:00100000:1.0:1788869418.146031:0:5750:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 238 00000100:00100000:1.0:1788869418.146040:0:5750:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c81f0fa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3cca3acf-4935-4d0d-9982-d5d931f1c86b+13:5555:x1875765413040128:12345-192.168.201.39@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788869418.146437:0:5750:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c81f0fa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3cca3acf-4935-4d0d-9982-d5d931f1c86b+13:5555:x1875765413040128:12345-192.168.201.39@tcp:501:ll_cfg_requeue.0 Request processed in 396us (757us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869418.146445:0:5750:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 238 00000100:00100000:3.0:1788869418.148385:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1788869418.148454:0:5749:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765413040256 00000100:00100000:2.0:1788869418.148464:0:5749:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765413040256 00000100:00100000:2.0:1788869418.148526:0:5749:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 239 00000100:00100000:2.0:1788869418.148536:0:5749:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c81f0fac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3cca3acf-4935-4d0d-9982-d5d931f1c86b+13:5555:x1875765413040256:12345-192.168.201.39@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788869418.148767:0:5749:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c81f0fac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3cca3acf-4935-4d0d-9982-d5d931f1c86b+13:5555:x1875765413040256:12345-192.168.201.39@tcp:503:ll_cfg_requeue.0 Request processed in 232us (387us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869418.148780:0:5749:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 239 00000100:00100000:3.0:1788869418.152558:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1788869418.152713:0:5750:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765413040384 00000100:00100000:1.0:1788869418.152723:0:5750:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765413040384 00000100:00100000:1.0:1788869418.152778:0:5750:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 240 00000100:00100000:1.0:1788869418.152787:0:5750:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c81f0fb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3cca3acf-4935-4d0d-9982-d5d931f1c86b+13:9896:x1875765413040384:12345-192.168.201.39@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788869418.153061:0:5750:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c81f0fb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3cca3acf-4935-4d0d-9982-d5d931f1c86b+13:9896:x1875765413040384:12345-192.168.201.39@tcp:502:llog_process_th.0 Request processed in 274us (510us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869418.153069:0:5750:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 240 00000100:00100000:3.0:1788869418.161690:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1788869418.161862:0:5749:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765413040512 00000100:00100000:2.0:1788869418.161872:0:5749:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765413040512 00000100:00100000:2.0:1788869418.162189:0:5749:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 241 00000100:00100000:2.0:1788869418.162199:0:5749:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c81f0fb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3cca3acf-4935-4d0d-9982-d5d931f1c86b+13:9896:x1875765413040512:12345-192.168.201.39@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788869418.162479:0:5749:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c81f0fb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3cca3acf-4935-4d0d-9982-d5d931f1c86b+13:9896:x1875765413040512:12345-192.168.201.39@tcp:502:llog_process_th.0 Request processed in 280us (797us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869418.162487:0:5749:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 241 00010000:00010000:1.0:1788869418.395535:0:5742:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1788869418.459385:0:5752:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1788869418.459409:0:5752:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff94c83f970800 from 7 10000000:01000000:2.0:1788869418.459415:0:5752:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788869418.459459:0:5752:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.139@tcp lock: ffff94c805038200/0x3d2d1916761d6657 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869418.459484:0:5752:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.139@tcp lock: ffff94c805038200/0x3d2d1916761d6657 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869418.459496:0:5752:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.139@tcp lock: ffff94c805038200/0x3d2d1916761d6657 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788869418.459523:0:5752:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94c810e6aa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:121cd5bc-7f07-4cf7-8e2e-4356c89c0696:5752:1875765421453184:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788869418.459592:0:5752:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869418.459661:0:5752:0:(client.c:2702:ptlrpc_set_wait()) set ffff94c8357d5f00 going to sleep for 11 seconds 00000100:00100000:1.0:1788869418.459869:0:5750:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765421453184 00000100:00100000:1.0:1788869418.459876:0:5750:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765421453184 00000100:00100000:1.0:1788869418.459926:0:5750:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 242 00000100:00100000:1.0:1788869418.459934:0:5750:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c81f0f9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:121cd5bc-7f07-4cf7-8e2e-4356c89c0696+16:5752:x1875765421453184:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788869418.459948:0:5750:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788869418.459962:0:5750:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff94c8421f2800/0x3d2d1916761d665e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x3d2d1916761d6657 expref: -99 pid: 5750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869418.460060:0:5750:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff94c8421f2800/0x3d2d1916761d665e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3d2d1916761d6657 expref: 17 pid: 5750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869418.460072:0:5750:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff94c8421f2800/0x3d2d1916761d665e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3d2d1916761d6657 expref: 17 pid: 5750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869418.460080:0:5750:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94c8421f2800, rc 0) 00000100:00100000:1.0:1788869418.460129:0:5750:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c81f0f9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:121cd5bc-7f07-4cf7-8e2e-4356c89c0696+17:5752:x1875765421453184:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 196us (537us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869418.460144:0:5750:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 242 00000100:00100000:2.0:1788869418.460331:0:5752:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94c810e6aa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:121cd5bc-7f07-4cf7-8e2e-4356c89c0696:5752:1875765421453184:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788869418.460345:0:5752:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.139@tcp lock: ffff94c805038200/0x3d2d1916761d6657 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3d2d1916761d665e expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869418.460355:0:5752:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.139@tcp lock: ffff94c805038200/0x3d2d1916761d6657 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x3d2d1916761d665e expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788869418.460407:0:5752:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94c810e6aa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:121cd5bc-7f07-4cf7-8e2e-4356c89c0696:5752:1875765421453312:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788869418.460434:0:5752:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869418.460476:0:5752:0:(client.c:2702:ptlrpc_set_wait()) set ffff94c8357d5f00 going to sleep for 11 seconds 00000100:00100000:1.0:1788869418.460577:0:5749:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765421453312 00000100:00100000:1.0:1788869418.460581:0:5749:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765421453312 00000100:00100000:1.0:1788869418.460655:0:5749:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 243 00000100:00100000:1.0:1788869418.460663:0:5749:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c81f0fa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:121cd5bc-7f07-4cf7-8e2e-4356c89c0696+17:5752:x1875765421453312:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788869418.460900:0:5749:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c81f0fa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:121cd5bc-7f07-4cf7-8e2e-4356c89c0696+17:5752:x1875765421453312:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 238us (465us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869418.460907:0:5749:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 243 00000100:00100000:2.0:1788869418.460964:0:5752:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94c810e6aa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:121cd5bc-7f07-4cf7-8e2e-4356c89c0696:5752:1875765421453312:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788869418.464490:0:5752:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94c810e6aa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:121cd5bc-7f07-4cf7-8e2e-4356c89c0696:5752:1875765421453440:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788869418.464584:0:5752:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869418.465267:0:5752:0:(client.c:2702:ptlrpc_set_wait()) set ffff94c8357d5f00 going to sleep for 11 seconds 00000100:00100000:3.0:1788869418.465329:0:5750:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765421453440 00000100:00100000:3.0:1788869418.465337:0:5750:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765421453440 00000100:00100000:3.0:1788869418.465380:0:5750:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 244 00000100:00100000:3.0:1788869418.465389:0:5750:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c81f0f8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:121cd5bc-7f07-4cf7-8e2e-4356c89c0696+17:5752:x1875765421453440:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788869418.465725:0:5750:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c81f0f8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:121cd5bc-7f07-4cf7-8e2e-4356c89c0696+17:5752:x1875765421453440:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 336us (1139us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869418.465743:0:5750:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 244 00000100:00100000:2.0:1788869418.465871:0:5752:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94c810e6aa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:121cd5bc-7f07-4cf7-8e2e-4356c89c0696:5752:1875765421453440:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788869418.466359:0:11480:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94c702349f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:121cd5bc-7f07-4cf7-8e2e-4356c89c0696:11480:1875765421453568:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788869418.466401:0:11480:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869418.466432:0:11480:0:(client.c:2702:ptlrpc_set_wait()) set ffff94c83c6f69c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788869418.467204:0:5748:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765421453568 00000100:00100000:0.0:1788869418.467211:0:5748:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765421453568 00000100:00100000:0.0:1788869418.467286:0:5748:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 245 00000100:00100000:0.0:1788869418.467297:0:5748:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c81f0fb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:121cd5bc-7f07-4cf7-8e2e-4356c89c0696+17:11480:x1875765421453568:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788869418.467492:0:5748:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c81f0fb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:121cd5bc-7f07-4cf7-8e2e-4356c89c0696+17:11480:x1875765421453568:12345-0@lo:502:llog_process_th.0 Request processed in 198us (1090us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869418.467506:0:5748:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 245 00000100:00100000:1.0:1788869418.467883:0:11480:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94c702349f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:121cd5bc-7f07-4cf7-8e2e-4356c89c0696:11480:1875765421453568:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788869418.467915:0:11480:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788869418.467924:0:11480:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788869418.467927:0:11480:0:(obd_config.c:1561:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1788869418.467933:0:11480:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff94c83f970800 00000020:00000080:1.0:1788869418.467935:0:11480:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1788869418.468032:0:11480:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94c702349f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:121cd5bc-7f07-4cf7-8e2e-4356c89c0696:11480:1875765421453696:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788869418.468071:0:11480:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869418.468103:0:11480:0:(client.c:2702:ptlrpc_set_wait()) set ffff94c83c6f69c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788869418.468159:0:5749:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765421453696 00000100:00100000:0.0:1788869418.468163:0:5749:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765421453696 00000100:00100000:0.0:1788869418.468207:0:5749:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 246 00000100:00100000:0.0:1788869418.468215:0:5749:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c81f0f8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:121cd5bc-7f07-4cf7-8e2e-4356c89c0696+17:11480:x1875765421453696:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788869418.468359:0:5749:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c81f0f8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:121cd5bc-7f07-4cf7-8e2e-4356c89c0696+17:11480:x1875765421453696:12345-0@lo:502:llog_process_th.0 Request processed in 144us (287us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869418.468366:0:5749:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 246 00000100:00100000:1.0:1788869418.468650:0:11480:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94c702349f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:121cd5bc-7f07-4cf7-8e2e-4356c89c0696:11480:1875765421453696:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788869418.468668:0:11480:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788869418.468673:0:11480:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788869418.468674:0:11480:0:(obd_config.c:1561:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:1.0:1788869418.468678:0:11480:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:3.0:1788869418.468769:0:5752:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:3.0:1788869418.468797:0:5752:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.139@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788869418.468809:0:5752:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.139@tcp lock: ffff94c805038200/0x3d2d1916761d6657 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3d2d1916761d665e expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869418.468826:0:5752:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.139@tcp lock: ffff94c805038200/0x3d2d1916761d6657 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3d2d1916761d665e expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788869418.468837:0:5752:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1788869418.468840:0:5752:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff94c839dd4000 from 7 10000000:01000000:3.0:1788869418.468843:0:5752:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788869418.468868:0:5752:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.139@tcp lock: ffff94c83504d000/0x3d2d1916761d6665 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869418.468877:0:5752:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.139@tcp lock: ffff94c83504d000/0x3d2d1916761d6665 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869418.468886:0:5752:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.139@tcp lock: ffff94c83504d000/0x3d2d1916761d6665 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788869418.468901:0:5752:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94c83f9a8000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:121cd5bc-7f07-4cf7-8e2e-4356c89c0696:5752:1875765421453824:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788869418.468936:0:5752:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869418.468970:0:5752:0:(client.c:2702:ptlrpc_set_wait()) set ffff94c83fd696c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788869418.471195:0:5748:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765421453824 00000100:00100000:0.0:1788869418.471205:0:5748:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765421453824 00000100:00100000:0.0:1788869418.471280:0:5748:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 247 00000100:00100000:0.0:1788869418.471289:0:5748:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c81f0f9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:121cd5bc-7f07-4cf7-8e2e-4356c89c0696+17:5752:x1875765421453824:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788869418.471305:0:5748:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788869418.471321:0:5748:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff94c81a582600/0x3d2d1916761d666c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x3d2d1916761d6665 expref: -99 pid: 5748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869418.471345:0:5748:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff94c81a582600/0x3d2d1916761d666c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3d2d1916761d6665 expref: 18 pid: 5748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869418.471356:0:5748:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff94c81a582600/0x3d2d1916761d666c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3d2d1916761d6665 expref: 18 pid: 5748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869418.471365:0:5748:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94c81a582600, rc 0) 00000100:00100000:0.0:1788869418.471444:0:5748:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c81f0f9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:121cd5bc-7f07-4cf7-8e2e-4356c89c0696+18:5752:x1875765421453824:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 156us (2507us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869418.471451:0:5748:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 247 00000100:00100000:2.0:1788869418.474364:0:5752:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94c83f9a8000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:121cd5bc-7f07-4cf7-8e2e-4356c89c0696:5752:1875765421453824:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788869418.475523:0:5752:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.139@tcp lock: ffff94c83504d000/0x3d2d1916761d6665 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x3d2d1916761d666c expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869418.475536:0:5752:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.139@tcp lock: ffff94c83504d000/0x3d2d1916761d6665 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x3d2d1916761d666c expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788869418.475610:0:5752:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94c810e6aa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:121cd5bc-7f07-4cf7-8e2e-4356c89c0696:5752:1875765421453952:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788869418.475666:0:5752:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869418.475708:0:5752:0:(client.c:2702:ptlrpc_set_wait()) set ffff94c8357d5f00 going to sleep for 11 seconds 00000100:00100000:1.0:1788869418.475787:0:5750:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765421453952 00000100:00100000:1.0:1788869418.475801:0:5750:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765421453952 00000100:00100000:1.0:1788869418.475851:0:5750:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 248 00000100:00100000:1.0:1788869418.475860:0:5750:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c81f0f8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:121cd5bc-7f07-4cf7-8e2e-4356c89c0696+18:5752:x1875765421453952:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788869418.476083:0:5750:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c81f0f8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:121cd5bc-7f07-4cf7-8e2e-4356c89c0696+18:5752:x1875765421453952:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 224us (417us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869418.476090:0:5750:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 248 00000100:00100000:2.0:1788869418.476162:0:5752:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94c810e6aa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:121cd5bc-7f07-4cf7-8e2e-4356c89c0696:5752:1875765421453952:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788869418.476200:0:5752:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94c810e6aa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:121cd5bc-7f07-4cf7-8e2e-4356c89c0696:5752:1875765421454080:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788869418.476233:0:5752:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869418.476314:0:5752:0:(client.c:2702:ptlrpc_set_wait()) set ffff94c8357d5f00 going to sleep for 11 seconds 00000100:00100000:1.0:1788869418.490631:0:5749:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765421454080 00000100:00100000:1.0:1788869418.490647:0:5749:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765421454080 00000100:00100000:1.0:1788869418.490700:0:5749:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 249 00000100:00100000:1.0:1788869418.490710:0:5749:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c81f0f9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:121cd5bc-7f07-4cf7-8e2e-4356c89c0696+18:5752:x1875765421454080:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788869418.490939:0:5749:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c81f0f9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:121cd5bc-7f07-4cf7-8e2e-4356c89c0696+18:5752:x1875765421454080:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 231us (14704us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869418.490947:0:5749:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 249 00000100:00100000:0.0:1788869418.491083:0:5752:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94c810e6aa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:121cd5bc-7f07-4cf7-8e2e-4356c89c0696:5752:1875765421454080:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788869418.491485:0:11483:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94c83fbb0700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:121cd5bc-7f07-4cf7-8e2e-4356c89c0696:11483:1875765421454208:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788869418.491519:0:11483:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869418.491546:0:11483:0:(client.c:2702:ptlrpc_set_wait()) set ffff94c835166f00 going to sleep for 11 seconds 00000100:00100000:1.0:1788869418.491672:0:5749:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765421454208 00000100:00100000:1.0:1788869418.491676:0:5749:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765421454208 00000100:00100000:1.0:1788869418.491699:0:5749:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 250 00000100:00100000:1.0:1788869418.491704:0:5749:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c81f0f8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:121cd5bc-7f07-4cf7-8e2e-4356c89c0696+18:11483:x1875765421454208:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788869418.491799:0:5749:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c81f0f8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:121cd5bc-7f07-4cf7-8e2e-4356c89c0696+18:11483:x1875765421454208:12345-0@lo:502:llog_process_th.0 Request processed in 95us (279us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869418.491804:0:5749:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 250 00000100:00100000:0.0:1788869418.491854:0:11483:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94c83fbb0700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:121cd5bc-7f07-4cf7-8e2e-4356c89c0696:11483:1875765421454208:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788869418.491870:0:11483:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788869418.491876:0:11483:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788869418.491878:0:11483:0:(obd_config.c:1561:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1788869418.491882:0:11483:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff94c839dd4000 00000020:00000080:0.0:1788869418.491883:0:11483:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1788869418.491940:0:11483:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94c83fbb0700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:121cd5bc-7f07-4cf7-8e2e-4356c89c0696:11483:1875765421454336:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788869418.491963:0:11483:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869418.491975:0:11483:0:(client.c:2702:ptlrpc_set_wait()) set ffff94c835166f00 going to sleep for 11 seconds 00000100:00100000:1.0:1788869418.492019:0:5749:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765421454336 00000100:00100000:1.0:1788869418.492023:0:5749:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765421454336 00000100:00100000:1.0:1788869418.492051:0:5749:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 251 00000100:00100000:1.0:1788869418.492057:0:5749:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c8061d9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:121cd5bc-7f07-4cf7-8e2e-4356c89c0696+18:11483:x1875765421454336:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788869418.492154:0:5749:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c8061d9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:121cd5bc-7f07-4cf7-8e2e-4356c89c0696+18:11483:x1875765421454336:12345-0@lo:502:llog_process_th.0 Request processed in 97us (190us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869418.492168:0:5749:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 251 00000100:00100000:0.0:1788869418.492487:0:11483:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94c83fbb0700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:121cd5bc-7f07-4cf7-8e2e-4356c89c0696:11483:1875765421454336:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788869418.492505:0:11483:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788869418.492510:0:11483:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788869418.492511:0:11483:0:(obd_config.c:1561:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:0.0:1788869418.492515:0:11483:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:0.0:1788869418.492613:0:5752:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:0.0:1788869418.492635:0:5752:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.139@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788869418.492643:0:5752:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.139@tcp lock: ffff94c83504d000/0x3d2d1916761d6665 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x3d2d1916761d666c expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869418.492652:0:5752:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.139@tcp lock: ffff94c83504d000/0x3d2d1916761d6665 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x3d2d1916761d666c expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788869418.492659:0:5752:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1788869418.492660:0:5752:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff94c805125000 from 7 10000000:01000000:0.0:1788869418.492667:0:5752:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788869418.492686:0:5752:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.139@tcp lock: ffff94c81a583a00/0x3d2d1916761d6673 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869418.492691:0:5752:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.139@tcp lock: ffff94c81a583a00/0x3d2d1916761d6673 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869418.492698:0:5752:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.139@tcp lock: ffff94c81a583a00/0x3d2d1916761d6673 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788869418.492707:0:5752:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94c83fbb0700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:121cd5bc-7f07-4cf7-8e2e-4356c89c0696:5752:1875765421454464:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788869418.492726:0:5752:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869418.492737:0:5752:0:(client.c:2702:ptlrpc_set_wait()) set ffff94c835166f00 going to sleep for 11 seconds 00000100:00100000:0.0:1788869418.492750:0:5749:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765421454464 00000100:00100000:0.0:1788869418.492753:0:5749:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765421454464 00000100:00100000:0.0:1788869418.492768:0:5749:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 252 00000100:00100000:0.0:1788869418.492772:0:5749:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c8061da050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:121cd5bc-7f07-4cf7-8e2e-4356c89c0696+18:5752:x1875765421454464:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788869418.492778:0:5749:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788869418.492787:0:5749:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff94c81a582000/0x3d2d1916761d667a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x3d2d1916761d6673 expref: -99 pid: 5749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869418.492802:0:5749:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff94c81a582000/0x3d2d1916761d667a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3d2d1916761d6673 expref: 19 pid: 5749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869418.492809:0:5749:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff94c81a582000/0x3d2d1916761d667a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3d2d1916761d6673 expref: 19 pid: 5749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869418.492815:0:5749:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94c81a582000, rc 0) 00000100:00100000:0.0:1788869418.492839:0:5749:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c8061da050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:121cd5bc-7f07-4cf7-8e2e-4356c89c0696+19:5752:x1875765421454464:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 65us (111us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869418.492855:0:5749:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 252 00000100:00100000:0.0:1788869418.492884:0:5752:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94c83fbb0700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:121cd5bc-7f07-4cf7-8e2e-4356c89c0696:5752:1875765421454464:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788869418.492895:0:5752:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.139@tcp lock: ffff94c81a583a00/0x3d2d1916761d6673 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x3d2d1916761d667a expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869418.492904:0:5752:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.139@tcp lock: ffff94c81a583a00/0x3d2d1916761d6673 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x3d2d1916761d667a expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788869418.492936:0:5752:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94c83fbb0700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:121cd5bc-7f07-4cf7-8e2e-4356c89c0696:5752:1875765421454592:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788869418.492956:0:5752:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869418.492969:0:5752:0:(client.c:2702:ptlrpc_set_wait()) set ffff94c835166f00 going to sleep for 11 seconds 00000100:00100000:0.0:1788869418.492979:0:5749:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765421454592 00000100:00100000:0.0:1788869418.492983:0:5749:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765421454592 00000100:00100000:0.0:1788869418.493002:0:5749:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 253 00000100:00100000:0.0:1788869418.493008:0:5749:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c810e10050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:121cd5bc-7f07-4cf7-8e2e-4356c89c0696+19:5752:x1875765421454592:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788869418.493171:0:5749:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c810e10050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:121cd5bc-7f07-4cf7-8e2e-4356c89c0696+19:5752:x1875765421454592:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 164us (214us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869418.493192:0:5749:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 253 00000100:00100000:0.0:1788869418.493226:0:5752:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94c83fbb0700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:121cd5bc-7f07-4cf7-8e2e-4356c89c0696:5752:1875765421454592:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788869418.493247:0:5752:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94c83fbb0700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:121cd5bc-7f07-4cf7-8e2e-4356c89c0696:5752:1875765421454720:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788869418.493297:0:5752:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869418.493316:0:5752:0:(client.c:2702:ptlrpc_set_wait()) set ffff94c835166f00 going to sleep for 11 seconds 00000100:00100000:0.0:1788869418.493325:0:5749:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765421454720 00000100:00100000:0.0:1788869418.493328:0:5749:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765421454720 00000100:00100000:0.0:1788869418.493357:0:5749:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 254 00000100:00100000:0.0:1788869418.493481:0:5749:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c810e11050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:121cd5bc-7f07-4cf7-8e2e-4356c89c0696+19:5752:x1875765421454720:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788869418.493591:0:5749:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c810e11050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:121cd5bc-7f07-4cf7-8e2e-4356c89c0696+19:5752:x1875765421454720:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 222us (293us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869418.493598:0:5749:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 254 00000100:00100000:2.0:1788869418.493620:0:5752:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94c83fbb0700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:121cd5bc-7f07-4cf7-8e2e-4356c89c0696:5752:1875765421454720:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788869418.494146:0:11484:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94c702349f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:121cd5bc-7f07-4cf7-8e2e-4356c89c0696:11484:1875765421454848:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788869418.494194:0:11484:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869418.494221:0:11484:0:(client.c:2702:ptlrpc_set_wait()) set ffff94c83c6f6f00 going to sleep for 11 seconds 00000100:00100000:2.0:1788869418.494366:0:5748:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765421454848 00000100:00100000:2.0:1788869418.494482:0:5748:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765421454848 00000100:00100000:2.0:1788869418.494545:0:5748:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 255 00000100:00100000:2.0:1788869418.494553:0:5748:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c810e10450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:121cd5bc-7f07-4cf7-8e2e-4356c89c0696+19:11484:x1875765421454848:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788869418.494707:0:5748:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c810e10450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:121cd5bc-7f07-4cf7-8e2e-4356c89c0696+19:11484:x1875765421454848:12345-0@lo:502:llog_process_th.0 Request processed in 155us (511us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869418.494714:0:5748:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 255 00000100:00100000:1.0:1788869418.494776:0:11484:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94c702349f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:121cd5bc-7f07-4cf7-8e2e-4356c89c0696:11484:1875765421454848:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788869418.494797:0:11484:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788869418.494804:0:11484:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788869418.494806:0:11484:0:(obd_config.c:1561:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1788869418.494812:0:11484:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff94c805125000 00000020:00000080:1.0:1788869418.494815:0:11484:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1788869418.495068:0:11484:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94c702349f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:121cd5bc-7f07-4cf7-8e2e-4356c89c0696:11484:1875765421454976:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788869418.495100:0:11484:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869418.499533:0:11484:0:(client.c:2702:ptlrpc_set_wait()) set ffff94c83c6f6f00 going to sleep for 11 seconds 00000100:00100000:0.0:1788869418.499631:0:5750:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765421454976 00000100:00100000:0.0:1788869418.499640:0:5750:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765421454976 00000100:00100000:0.0:1788869418.499691:0:5750:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 256 00000100:00100000:0.0:1788869418.499701:0:5750:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c81f14e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:121cd5bc-7f07-4cf7-8e2e-4356c89c0696+19:11484:x1875765421454976:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788869418.500289:0:5750:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c81f14e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:121cd5bc-7f07-4cf7-8e2e-4356c89c0696+19:11484:x1875765421454976:12345-0@lo:502:llog_process_th.0 Request processed in 589us (5186us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869418.500298:0:5750:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 256 00000040:00080000:2.0:1788869418.502246:0:11485:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1788869418.502573:0:11484:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94c702349f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:121cd5bc-7f07-4cf7-8e2e-4356c89c0696:11484:1875765421454976:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788869418.502699:0:11484:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788869418.502708:0:11484:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788869418.502711:0:11484:0:(obd_config.c:1561:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:0.0:1788869418.502715:0:11484:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:2.0:1788869418.502849:0:5752:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:2.0:1788869418.502875:0:5752:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.139@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788869418.502886:0:5752:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.139@tcp lock: ffff94c81a583a00/0x3d2d1916761d6673 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x3d2d1916761d667a expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869418.503157:0:5752:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.139@tcp lock: ffff94c81a583a00/0x3d2d1916761d6673 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x3d2d1916761d667a expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00100000:0.0:1788869419.107408:0:6571:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 10cd6f3c-009b-4acc-9ca5-e50cb17e412c 00000020:00000080:0.0:1788869419.107418:0:6571:0:(genops.c:906:class_export_put()) final put ffff94c835501000/10cd6f3c-009b-4acc-9ca5-e50cb17e412c 00000020:00000080:3.0:1788869419.107449:0:472:0:(genops.c:865:class_export_destroy()) destroying export ffff94c835501000/10cd6f3c-009b-4acc-9ca5-e50cb17e412c for lustre-OST0000 00000020:00000080:3.0:1788869419.107499:0:472:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff94c835500800 for lustre-OST0000 00010000:00010000:3.0:1788869419.419417:0:7447:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788869419.547785:0:11485:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000001:00080000:0.0:1788869419.648360:0:5777:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967307 is committed 00000001:00080000:0.0:1788869419.648385:0:5777:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967308 is committed 00000004:00080000:0.0:1788869419.648393:0:5777:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2 committed 00000004:00080000:0.0:1788869419.648421:0:5777:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3 committed 00000100:00100000:3.0:1788869419.648752:0:3283:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94c83f9ab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3283:1875765421455104:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1788869419.648824:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869419.648910:0:6546:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765421455104 00000100:00100000:3.0:1788869419.648918:0:6546:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765421455104 00000100:00100000:3.0:1788869419.648976:0:6546:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1788869419.648984:0:6546:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c83f9a9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3283:x1875765421455104:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:3.0:1788869419.649067:0:6546:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:2 count 1 00002000:00010000:3.0:1788869419.649102:0:6546:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x2:0x0] initial LVB size: 0, mtime: 0x6a9ffb25, atime: 0x6a9ffb25, ctime: 0x6a9ffb25, blocks: 0x1 00010000:00010000:3.0:1788869419.649110:0:6546:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ff0131d3/0x3d2d1916761d6681 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6546 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869419.649126:0:6546:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=167s v=(0 0) 00010000:00010000:3.0:1788869419.649131:0:6546:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788869419.649138:0:6546:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ff0131d3/0x3d2d1916761d6681 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6546 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869419.649163:0:6546:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ff0131d3/0x3d2d1916761d6681 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6546 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869419.649175:0:6546:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ff0131d3/0x3d2d1916761d6681 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6546 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869419.649184:0:6546:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ff0131d3/0x3d2d1916761d6681 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6546 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869419.649201:0:6546:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1788869419.649989:0:6546:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c83f9a9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3283:x1875765421455104:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1004us (1164us total) trans 4294967300 rc 0/0 00000100:00100000:3.0:1788869419.650052:0:6546:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00080000:3.0:1788869419.650089:0:5751:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:3.0:1788869419.650104:0:5743:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788869419.650111:0:5743:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ff0131d3/0x3d2d1916761d6681 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6546 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869419.650120:0:5743:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94c83504c200 already unused, calling callback (ffffffffc1703220) 00010000:00010000:3.0:1788869419.650125:0:5743:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ff0131d3/0x3d2d1916761d6681 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6546 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1788869419.650125:0:3283:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94c83f9ab480/2, rc 0, transno 4294967300 00000100:00100000:0.0:1788869419.650137:0:3283:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94c83f9ab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3283:1875765421455104:0@lo:6:osp-syn-1-0.0 00010000:00010000:3.0:1788869419.650139:0:5743:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ff0131d3/0x3d2d1916761d6681 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6546 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869419.650171:0:5743:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ff0131d3/0x3d2d1916761d6681 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6546 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869419.650179:0:5743:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ff0131d3/0x3d2d1916761d6681 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6546 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869419.650194:0:5743:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788869419.650196:0:5743:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788869419.650197:0:5743:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1788869419.651629:0:7458:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 10cd6f3c-009b-4acc-9ca5-e50cb17e412c 00000020:00000080:3.0:1788869419.651635:0:7458:0:(genops.c:906:class_export_put()) final put ffff94c835503000/10cd6f3c-009b-4acc-9ca5-e50cb17e412c 00000020:00000080:2.0:1788869419.652053:0:472:0:(genops.c:865:class_export_destroy()) destroying export ffff94c835503000/10cd6f3c-009b-4acc-9ca5-e50cb17e412c for lustre-OST0001 00000020:00000080:2.0:1788869419.652099:0:472:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff94c835501800 for lustre-OST0001 00010000:00010000:1.0:1788869420.443559:0:5742:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788869421.147492:0:3283:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788869421.147520:0:3283:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94c83f9aad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3283:1875765421455232:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788869421.147591:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869421.147674:0:3283:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94c70234aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3283:1875765421455616:0@lo:400:kworker.0 00000100:00100000:2.0:1788869421.147705:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869421.147721:0:3285:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94c702349f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:121cd5bc-7f07-4cf7-8e2e-4356c89c0696:3285:1875765421455360:0@lo:400:kworker.0 00000100:00100000:2.0:1788869421.147739:0:3283:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788869421.147751:0:3283:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94c702348a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3283:1875765421455744:0@lo:400:kworker.0 00000100:00100000:1.0:1788869421.147765:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869421.147797:0:3285:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94c70234b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3285:1875765421455872:0@lo:400:kworker.0 00000100:00100000:2.0:1788869421.147805:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869421.147834:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869421.147860:0:5756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765421455616 00000100:00100000:1.0:1788869421.147860:0:3285:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788869421.147868:0:3285:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94c70234a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3285:1875765421455488:0@lo:400:kworker.0 00000100:00100000:2.0:1788869421.147872:0:5756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765421455616 00000100:00100000:1.0:1788869421.147893:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869421.147935:0:5756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765421455872 00000100:00100000:2.0:1788869421.147939:0:5756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765421455872 00000100:00100000:2.0:1788869421.147955:0:5756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765421455488 00000100:00100000:2.0:1788869421.147958:0:5756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765421455488 00000100:00100000:2.0:1788869421.147975:0:5756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1788869421.147984:0:5756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c810e6bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3283:x1875765421455616:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788869421.148036:0:5756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c810e6bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3283:x1875765421455616:12345-0@lo:400:kworker.0 Request processed in 53us (330us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869421.148044:0:5756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1788869421.148065:0:6549:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765421455232 00000100:00100000:0.0:1788869421.148071:0:6549:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765421455232 00000100:00100000:2.0:1788869421.148087:0:5756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1788869421.148100:0:5756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c70234a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3285:x1875765421455872:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788869421.148109:0:6549:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1788869421.148119:0:6549:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c810e6a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3283:x1875765421455232:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788869421.148158:0:5756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c70234a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3285:x1875765421455872:12345-0@lo:400:kworker.0 Request processed in 61us (324us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869421.148168:0:5756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00002000:00000024:0.0:1788869421.148170:0:6549:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788869421.148188:0:5756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1788869421.148198:0:5756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c702349880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3285:x1875765421455488:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788869421.148215:0:6549:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c810e6a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3283:x1875765421455232:12345-0@lo:13:osp-pre-1-0.0 Request processed in 98us (623us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869421.148222:0:6549:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1788869421.148241:0:5756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c702349880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3285:x1875765421455488:12345-0@lo:400:kworker.0 Request processed in 45us (347us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869421.148277:0:5756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1788869421.148301:0:5748:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765421455360 00000100:00100000:2.0:1788869421.148304:0:5748:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765421455360 00000100:00100000:2.0:1788869421.148331:0:5748:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 257 00000100:00100000:2.0:1788869421.148337:0:5748:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c81f14ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:121cd5bc-7f07-4cf7-8e2e-4356c89c0696+19:3285:x1875765421455360:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788869421.148365:0:5748:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c81f14ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:121cd5bc-7f07-4cf7-8e2e-4356c89c0696+19:3285:x1875765421455360:12345-0@lo:400:kworker.0 Request processed in 28us (601us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869421.148370:0:5748:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 257 00000100:00100000:2.0:1788869421.148395:0:6544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765421455744 00000100:00100000:2.0:1788869421.148398:0:6544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765421455744 00000100:00100000:2.0:1788869421.148431:0:6544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1788869421.148439:0:6544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c835221050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3283:x1875765421455744:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788869421.148459:0:3285:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94c70234a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3285:1875765421455488:0@lo:400:kworker.0 00000100:00100000:2.0:1788869421.148475:0:6544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c835221050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3283:x1875765421455744:12345-0@lo:400:kworker.0 Request processed in 36us (673us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869421.148478:0:3285:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94c702349f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:121cd5bc-7f07-4cf7-8e2e-4356c89c0696:3285:1875765421455360:0@lo:400:kworker.0 00000100:00100000:2.0:1788869421.148490:0:6544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1788869421.148495:0:3285:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94c70234b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3285:1875765421455872:0@lo:400:kworker.0 00010000:00080000:0.0:1788869421.148559:0:3283:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff94c702348a80 x1875765421455744/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788869437 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788869421.148572:0:3283:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94c702348a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3283:1875765421455744:0@lo:400:kworker.0 00000100:00100000:0.0:1788869421.148586:0:3283:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94c70234aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3283:1875765421455616:0@lo:400:kworker.0 00000100:00100000:0.0:1788869421.148610:0:3283:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94c83f9aad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3283:1875765421455232:0@lo:13:osp-pre-1-0.0 00000100:00080000:3.0:1788869421.148742:0:5751:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788869421.148747:0:5751:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788869421.148750:0:5751:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1788869421.467494:0:7447:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788869422.491429:0:5743:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788869422.511368:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1788869422.511430:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1788869422.511490:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1788869422.511499:0:5749:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765413040640 00000100:00100000:0.0:1788869422.511515:0:5749:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765413040640 00000100:00100000:2.0:1788869422.511566:0:6546:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765413040896 00000100:00100000:2.0:1788869422.511571:0:6546:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765413040896 00000100:00100000:0.0:1788869422.511593:0:5749:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 258 00000100:00100000:0.0:1788869422.511603:0:5749:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c81f14f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3cca3acf-4935-4d0d-9982-d5d931f1c86b+13:2347:x1875765413040640:12345-192.168.201.39@tcp:400:kworker.0 00000100:00100000:2.0:1788869422.511611:0:6546:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 34 00000100:00100000:2.0:1788869422.511631:0:6546:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c83f9ab100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2125b9b3-626e-4cbe-be83-fb446e976ce2+5:2347:x1875765413040896:12345-192.168.201.39@tcp:400:kworker.0 00000100:00100000:1.0:1788869422.511740:0:5755:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765413040768 00000100:00100000:1.0:1788869422.511750:0:5755:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765413040768 00000100:00100000:1.0:1788869422.511807:0:5755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 65 00000100:00100000:1.0:1788869422.511825:0:5755:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c83f9a9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2125b9b3-626e-4cbe-be83-fb446e976ce2+5:2347:x1875765413040768:12345-192.168.201.39@tcp:400:kworker.0 00000100:00100000:0.0:1788869422.511968:0:5749:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c81f14f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3cca3acf-4935-4d0d-9982-d5d931f1c86b+13:2347:x1875765413040640:12345-192.168.201.39@tcp:400:kworker.0 Request processed in 363us (610us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869422.511978:0:5749:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 258 00000100:00080000:0.0:1788869422.512035:0:5751:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788869422.512040:0:5751:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788869422.514196:0:6546:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c83f9ab100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2125b9b3-626e-4cbe-be83-fb446e976ce2+5:2347:x1875765413040896:12345-192.168.201.39@tcp:400:kworker.0 Request processed in 2558us (2697us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869422.514208:0:6546:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 34 00000100:00100000:1.0:1788869422.515378:0:5755:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c83f9a9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2125b9b3-626e-4cbe-be83-fb446e976ce2+5:2347:x1875765413040768:12345-192.168.201.39@tcp:400:kworker.0 Request processed in 3544us (3936us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869422.515395:0:5755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 65 00000100:00100000:3.0:1788869422.521029:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1788869422.521114:0:5757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765413041024 00000100:00100000:0.0:1788869422.521128:0:5757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765413041024 00000100:00100000:0.0:1788869422.521208:0:5757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 66 00000100:00100000:0.0:1788869422.521217:0:5757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c83f9a8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:10cd6f3c-009b-4acc-9ca5-e50cb17e412c+5:2347:x1875765413041024:12345-192.168.201.39@tcp:400:kworker.0 00000100:00100000:0.0:1788869422.521306:0:5757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c83f9a8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:10cd6f3c-009b-4acc-9ca5-e50cb17e412c+5:2347:x1875765413041024:12345-192.168.201.39@tcp:400:kworker.0 Request processed in 89us (290us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869422.521313:0:5757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 66 00000100:00080000:0.0:1788869422.521335:0:5751:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788869423.195558:0:3286:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94c83f9a9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3286:1875765421456000:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788869423.195677:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869423.195740:0:6549:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765421456000 00000100:00100000:0.0:1788869423.195765:0:6549:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765421456000 00000100:00080000:3.0:1788869423.195830:0:5751:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788869423.195859:0:6549:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1788869423.195873:0:6549:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c70234bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3286:x1875765421456000:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788869423.195940:0:6549:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788869423.196059:0:6549:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c70234bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3286:x1875765421456000:12345-0@lo:13:osp-pre-0-0.0 Request processed in 189us (381us total) trans 0 rc 0/0 00010000:00080000:1.0:1788869423.196351:0:3286:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff94c83f9a9180 x1875765421456000/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788869439 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788869423.196387:0:3286:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94c83f9a9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3286:1875765421456000:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788869423.196517:0:6549:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00010000:00010000:1.0:1788869423.515513:0:5742:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788869424.540924:0:7447:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1788869424.758627:0:7458:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967300 is committed 00010000:00010000:3.0:1788869425.564102:0:5743:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788869426.267589:0:3284:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94c810e6a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3284:1875765421456256:0@lo:400:kworker.0 00000100:00100000:3.0:1788869426.267610:0:3285:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94c810e68a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3285:1875765421456384:0@lo:400:kworker.0 00000100:00100000:0.0:1788869426.267734:0:3283:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94c810e6ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:121cd5bc-7f07-4cf7-8e2e-4356c89c0696:3283:1875765421456128:0@lo:400:kworker.0 00000100:00100000:2.0:1788869426.267786:0:3286:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94c810e68380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3286:1875765421456512:0@lo:400:kworker.0 00000100:00100000:1.0:1788869426.268751:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869426.268819:0:3284:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94c810e6b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3284:1875765421456768:0@lo:400:kworker.0 00000100:00100000:1.0:1788869426.268846:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869426.268922:0:5756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765421456256 00000100:00100000:1.0:1788869426.268931:0:5756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765421456256 00000100:00100000:3.0:1788869426.268977:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869426.268988:0:5756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1788869426.268999:0:5756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c70234aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3284:x1875765421456256:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788869426.269062:0:3285:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94c810e69c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3285:1875765421456896:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788869426.269075:0:5756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c70234aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3284:x1875765421456256:12345-0@lo:400:kworker.0 Request processed in 76us (325us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869426.269084:0:5756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1788869426.269097:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869426.269102:0:5756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765421456384 00000100:00100000:1.0:1788869426.269105:0:5756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765421456384 00000100:00100000:1.0:1788869426.269149:0:5756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1788869426.269155:0:5756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c83f9a8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3285:x1875765421456384:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788869426.269192:0:6548:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765421456896 00000100:00100000:3.0:1788869426.269197:0:6548:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765421456896 00000100:00100000:1.0:1788869426.269209:0:5756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c83f9a8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3285:x1875765421456384:12345-0@lo:400:kworker.0 Request processed in 53us (232us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869426.269216:0:5756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1788869426.269239:0:6548:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1788869426.269286:0:3284:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94c810e6a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3284:1875765421456256:0@lo:400:kworker.0 00000100:00100000:3.0:1788869426.269316:0:6548:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c83f9a9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3285:x1875765421456896:12345-0@lo:13:osp-pre-1-0.0 00000100:00080000:1.0:1788869426.269329:0:5751:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788869426.269337:0:5751:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00002000:00000024:3.0:1788869426.269355:0:6548:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788869426.269356:0:6544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765421456768 00000100:00100000:1.0:1788869426.269362:0:6544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765421456768 00000100:00100000:3.0:1788869426.269398:0:6548:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c83f9a9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3285:x1875765421456896:12345-0@lo:13:osp-pre-1-0.0 Request processed in 150us (300us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869426.269398:0:6544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1788869426.269411:0:6548:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1788869426.269412:0:6544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c702348a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3284:x1875765421456768:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788869426.269451:0:6544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c702348a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3284:x1875765421456768:12345-0@lo:400:kworker.0 Request processed in 44us (604us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869426.269457:0:6544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1788869426.269481:0:3284:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967300 gen 2 00000004:00080000:1.0:1788869426.269487:0:3284:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94c83f9ab480, transno 4294967300 00000100:00100000:1.0:1788869426.271454:0:3284:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94c810e6b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3284:1875765421456768:0@lo:400:kworker.0 00000100:00100000:3.0:1788869426.271479:0:3285:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94c810e69c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3285:1875765421456896:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788869426.271498:0:3285:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94c810e68a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3285:1875765421456384:0@lo:400:kworker.0 00000100:00100000:2.0:1788869426.272859:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869426.272859:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869426.272927:0:3283:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94c810e68000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3283:1875765421456640:0@lo:400:kworker.0 00000100:00100000:3.0:1788869426.272937:0:7884:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765421456512 00000100:00100000:3.0:1788869426.272947:0:7884:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765421456512 00000100:00100000:0.0:1788869426.272967:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869426.273037:0:7884:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1788869426.273061:0:7884:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c810e68a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3286:x1875765421456512:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788869426.273101:0:5757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765421456640 00000100:00100000:2.0:1788869426.273106:0:5757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765421456640 00000100:00100000:3.0:1788869426.273133:0:7884:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c810e68a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3286:x1875765421456512:12345-0@lo:400:kworker.0 Request processed in 73us (281us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869426.273148:0:5757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1788869426.273153:0:7884:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1788869426.273160:0:5757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c83fbb3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3283:x1875765421456640:12345-0@lo:400:kworker.0 00000100:00080000:3.0:1788869426.273197:0:5751:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788869426.273204:0:5751:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788869426.273207:0:5757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c83fbb3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3283:x1875765421456640:12345-0@lo:400:kworker.0 Request processed in 49us (239us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869426.273216:0:5757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00010000:00080000:3.0:1788869426.273244:0:3286:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff94c810e68380 x1875765421456512/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788869442 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788869426.273291:0:3286:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94c810e68380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3286:1875765421456512:0@lo:400:kworker.0 00000100:00100000:1.0:1788869426.273687:0:5750:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765421456128 00000100:00100000:1.0:1788869426.273693:0:5750:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765421456128 00000100:00100000:1.0:1788869426.273731:0:5750:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 259 00000100:00100000:1.0:1788869426.273738:0:5750:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c81f14f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:121cd5bc-7f07-4cf7-8e2e-4356c89c0696+19:3283:x1875765421456128:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788869426.273780:0:5750:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c81f14f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:121cd5bc-7f07-4cf7-8e2e-4356c89c0696+19:3283:x1875765421456128:12345-0@lo:400:kworker.0 Request processed in 42us (924us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869426.273787:0:5750:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 259 00000100:00100000:0.0:1788869426.274333:0:3283:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94c810e6ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:121cd5bc-7f07-4cf7-8e2e-4356c89c0696:3283:1875765421456128:0@lo:400:kworker.0 00000100:00100000:0.0:1788869426.274351:0:3283:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94c810e68000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3283:1875765421456640:0@lo:400:kworker.0 00010000:00010000:1.0:1788869426.587696:0:5742:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788869427.611367:0:7447:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788869427.628224:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1788869427.628295:0:5748:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765413041152 00000100:00100000:0.0:1788869427.628306:0:5748:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765413041152 00000100:00100000:3.0:1788869427.628307:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1788869427.628346:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1788869427.628377:0:5748:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 260 00000100:00100000:3.0:1788869427.628391:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1788869427.628402:0:5748:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c81f14dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3cca3acf-4935-4d0d-9982-d5d931f1c86b+13:2347:x1875765413041152:12345-192.168.201.39@tcp:400:kworker.0 00000100:00100000:0.0:1788869427.628498:0:5748:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c81f14dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3cca3acf-4935-4d0d-9982-d5d931f1c86b+13:2347:x1875765413041152:12345-192.168.201.39@tcp:400:kworker.0 Request processed in 107us (279us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869427.628517:0:5748:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 260 00000100:00100000:1.0:1788869427.630106:0:5755:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765413041280 00000100:00100000:1.0:1788869427.630115:0:5755:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765413041280 00000100:00100000:1.0:1788869427.630176:0:5755:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765413041536 00000100:00100000:1.0:1788869427.630179:0:5755:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765413041536 00000100:00080000:3.0:1788869427.630189:0:5751:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788869427.630212:0:5755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 70 00000100:00100000:1.0:1788869427.630222:0:5755:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c83f9ab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2125b9b3-626e-4cbe-be83-fb446e976ce2+5:2348:x1875765413041280:12345-192.168.201.39@tcp:400:kworker.0 00000100:00100000:2.0:1788869427.630228:0:5757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 71 00000100:00100000:0.0:1788869427.630286:0:6544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765413041408 00000100:00100000:2.0:1788869427.630287:0:5757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c83f9a9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:10cd6f3c-009b-4acc-9ca5-e50cb17e412c+5:2348:x1875765413041536:12345-192.168.201.39@tcp:400:kworker.0 00000100:00100000:0.0:1788869427.630291:0:6544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765413041408 00000100:00100000:1.0:1788869427.630314:0:5755:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c83f9ab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2125b9b3-626e-4cbe-be83-fb446e976ce2+5:2348:x1875765413041280:12345-192.168.201.39@tcp:400:kworker.0 Request processed in 92us (2005us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869427.630323:0:5755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 70 00000100:00080000:3.0:1788869427.630339:0:5751:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788869427.630340:0:6544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 37 00000100:00100000:2.0:1788869427.630355:0:5757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c83f9a9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:10cd6f3c-009b-4acc-9ca5-e50cb17e412c+5:2348:x1875765413041536:12345-192.168.201.39@tcp:400:kworker.0 Request processed in 112us (2005us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869427.630355:0:6544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c83f9aad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2125b9b3-626e-4cbe-be83-fb446e976ce2+5:2347:x1875765413041408:12345-192.168.201.39@tcp:400:kworker.0 00000100:00100000:2.0:1788869427.630369:0:5757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 71 00000100:00100000:0.0:1788869427.630390:0:6544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c83f9aad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2125b9b3-626e-4cbe-be83-fb446e976ce2+5:2347:x1875765413041408:12345-192.168.201.39@tcp:400:kworker.0 Request processed in 39us (1999us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869427.630399:0:6544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 37 00000100:00100000:2.0:1788869428.320620:0:3286:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94c83f9abb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3286:1875765421457024:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788869428.320694:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869428.320839:0:6549:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765421457024 00000100:00100000:1.0:1788869428.320847:0:6549:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765421457024 00000100:00100000:1.0:1788869428.320912:0:6549:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1788869428.320921:0:6549:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c810e69c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3286:x1875765421457024:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788869428.320954:0:6549:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788869428.321044:0:6549:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c810e69c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3286:x1875765421457024:12345-0@lo:13:osp-pre-0-0.0 Request processed in 123us (349us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869428.321052:0:6549:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00010000:00080000:0.0:1788869428.321061:0:3286:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff94c83f9abb80 x1875765421457024/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788869444 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788869428.321079:0:3286:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94c83f9abb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3286:1875765421457024:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1788869428.321239:0:5751:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1788869428.635549:0:5743:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788869429.661125:0:5742:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788869429.787944:0:11485:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1788869430.684021:0:7447:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788869431.387844:0:3283:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94c810e6b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3283:1875765421457152:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788869431.387925:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869431.388008:0:6549:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765421457152 00000100:00100000:2.0:1788869431.388017:0:6549:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765421457152 00000100:00100000:2.0:1788869431.388132:0:6549:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1788869431.388143:0:6549:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c83fbb1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1875765421457152:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788869431.388195:0:6549:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788869431.388246:0:6549:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c83fbb1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1875765421457152:12345-0@lo:13:osp-pre-1-0.0 Request processed in 105us (320us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869431.388275:0:6549:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00080000:0.0:1788869431.388349:0:5751:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788869431.388384:0:3283:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94c810e6b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3283:1875765421457152:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788869431.388644:0:3284:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94c702348000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:121cd5bc-7f07-4cf7-8e2e-4356c89c0696:3284:1875765421457280:0@lo:400:kworker.0 00000100:00100000:2.0:1788869431.388644:0:3285:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94c702349500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3285:1875765421457408:0@lo:400:kworker.0 00000100:00100000:2.0:1788869431.388675:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869431.388676:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869431.388726:0:3286:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94c70234b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3286:1875765421457536:0@lo:400:kworker.0 00000100:00100000:3.0:1788869431.388752:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869431.388761:0:5756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765421457408 00000100:00100000:0.0:1788869431.388765:0:5756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765421457408 00000100:00100000:3.0:1788869431.388777:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765421457536 00000100:00100000:3.0:1788869431.388780:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765421457536 00000100:00100000:0.0:1788869431.388795:0:5756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1788869431.388801:0:5756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c810e6a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3285:x1875765421457408:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788869431.388818:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1788869431.388825:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c83f9a9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3286:x1875765421457536:12345-0@lo:400:kworker.0 00000100:00080000:2.0:1788869431.389303:0:5751:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788869431.389349:0:5750:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765421457280 00000100:00100000:2.0:1788869431.389354:0:5750:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765421457280 00000100:00100000:2.0:1788869431.389383:0:5750:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 261 00000100:00100000:2.0:1788869431.389390:0:5750:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c81f14e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:121cd5bc-7f07-4cf7-8e2e-4356c89c0696+19:3284:x1875765421457280:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788869431.389499:0:3284:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94c70234a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3284:1875765421457792:0@lo:400:kworker.0 00000100:00100000:0.0:1788869431.391266:0:5756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c810e6a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3285:x1875765421457408:12345-0@lo:400:kworker.0 Request processed in 2445us (2570us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869431.391279:0:5756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1788869431.391282:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c83f9a9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3286:x1875765421457536:12345-0@lo:400:kworker.0 Request processed in 2457us (2529us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869431.391289:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1788869431.391336:0:3283:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94c702349f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3283:1875765421457664:0@lo:400:kworker.0 00000100:00100000:3.0:1788869431.391353:0:3286:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94c70234b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3286:1875765421457536:0@lo:400:kworker.0 00000100:00100000:0.0:1788869431.391382:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869431.391396:0:3285:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94c702349500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3285:1875765421457408:0@lo:400:kworker.0 00000100:00100000:3.0:1788869431.391420:0:7884:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765421457664 00000100:00100000:3.0:1788869431.391427:0:7884:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765421457664 00000100:00100000:0.0:1788869431.391508:0:7884:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1788869431.391518:0:7884:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c83fbb2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3283:x1875765421457664:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788869431.391563:0:7884:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c83fbb2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3283:x1875765421457664:12345-0@lo:400:kworker.0 Request processed in 48us (182us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869431.391569:0:7884:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00010000:00080000:0.0:1788869431.391598:0:3283:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff94c702349f80 x1875765421457664/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788869447 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788869431.391609:0:3283:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94c702349f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3283:1875765421457664:0@lo:400:kworker.0 00000100:00080000:3.0:1788869431.391640:0:5751:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788869431.391797:0:5750:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c81f14e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:121cd5bc-7f07-4cf7-8e2e-4356c89c0696+19:3284:x1875765421457280:12345-0@lo:400:kworker.0 Request processed in 2406us (3117us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869431.391805:0:5750:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 261 00000100:00100000:1.0:1788869431.391963:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869431.392700:0:3284:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94c702348000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:121cd5bc-7f07-4cf7-8e2e-4356c89c0696:3284:1875765421457280:0@lo:400:kworker.0 00000100:00100000:2.0:1788869431.393897:0:5757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765421457792 00000100:00100000:2.0:1788869431.393908:0:5757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765421457792 00000100:00100000:2.0:1788869431.395171:0:5757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1788869431.395184:0:5757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c702349180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3284:x1875765421457792:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788869431.395311:0:5757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c702349180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3284:x1875765421457792:12345-0@lo:400:kworker.0 Request processed in 129us (3346us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869431.395375:0:5757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00080000:3.0:1788869431.395454:0:5751:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788869431.397204:0:3284:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94c70234a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3284:1875765421457792:0@lo:400:kworker.0 00010000:00010000:0.0:1788869431.707459:0:5743:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788869432.732546:0:5742:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788869432.755202:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1788869432.755279:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1788869432.755304:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1788869432.755330:0:5749:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765413041664 00000100:00100000:1.0:1788869432.755338:0:5749:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765413041664 00000100:00100000:0.0:1788869432.755339:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1788869432.755369:0:6547:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765413041920 00000100:00100000:0.0:1788869432.755373:0:6547:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765413041920 00000100:00100000:1.0:1788869432.755391:0:5749:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 262 00000100:00100000:1.0:1788869432.755400:0:5749:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c81f14cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3cca3acf-4935-4d0d-9982-d5d931f1c86b+13:2346:x1875765413041664:12345-192.168.201.39@tcp:400:kworker.0 00000100:00100000:0.0:1788869432.755419:0:6547:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 39 00000100:00100000:0.0:1788869432.755429:0:6547:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c83fbb3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2125b9b3-626e-4cbe-be83-fb446e976ce2+5:2346:x1875765413041920:12345-192.168.201.39@tcp:400:kworker.0 00000100:00100000:0.0:1788869432.755468:0:6547:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c83fbb3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2125b9b3-626e-4cbe-be83-fb446e976ce2+5:2346:x1875765413041920:12345-192.168.201.39@tcp:400:kworker.0 Request processed in 42us (129us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869432.755475:0:6547:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 39 00000100:00080000:0.0:1788869432.755496:0:5751:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788869432.755530:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765413041792 00000100:00100000:3.0:1788869432.755537:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765413041792 00000100:00100000:1.0:1788869432.755537:0:5749:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c81f14cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3cca3acf-4935-4d0d-9982-d5d931f1c86b+13:2346:x1875765413041664:12345-192.168.201.39@tcp:400:kworker.0 Request processed in 139us (257us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869432.755562:0:5749:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 262 00000100:00100000:3.0:1788869432.755579:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765413042048 00000100:00100000:3.0:1788869432.755583:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765413042048 00000100:00100000:3.0:1788869432.755618:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 75 00000100:00080000:0.0:1788869432.755620:0:5751:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788869432.755629:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c83fbb0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2125b9b3-626e-4cbe-be83-fb446e976ce2+5:2345:x1875765413041792:12345-192.168.201.39@tcp:400:kworker.0 00000100:00100000:0.0:1788869432.755649:0:5755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 76 00000100:00100000:0.0:1788869432.755665:0:5755:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c83fbb2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:10cd6f3c-009b-4acc-9ca5-e50cb17e412c+5:2345:x1875765413042048:12345-192.168.201.39@tcp:400:kworker.0 00000100:00100000:3.0:1788869432.755673:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c83fbb0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2125b9b3-626e-4cbe-be83-fb446e976ce2+5:2345:x1875765413041792:12345-192.168.201.39@tcp:400:kworker.0 Request processed in 46us (478us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869432.755682:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 75 00000100:00100000:0.0:1788869432.755700:0:5755:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c83fbb2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:10cd6f3c-009b-4acc-9ca5-e50cb17e412c+5:2345:x1875765413042048:12345-192.168.201.39@tcp:400:kworker.0 Request processed in 36us (393us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869432.755708:0:5755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 76 00000100:00100000:0.0:1788869433.439725:0:3286:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788869433.439748:0:3286:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94c83f9a9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3286:1875765421457920:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788869433.439817:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869433.439893:0:6549:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765421457920 00000100:00100000:1.0:1788869433.439908:0:6549:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765421457920 00000100:00080000:3.0:1788869433.439981:0:5751:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788869433.439987:0:6549:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1788869433.440000:0:6549:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c83fbb0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3286:x1875765421457920:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788869433.440034:0:6549:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788869433.440102:0:6549:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c83fbb0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3286:x1875765421457920:12345-0@lo:13:osp-pre-0-0.0 Request processed in 105us (284us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869433.440109:0:6549:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00010000:00080000:0.0:1788869433.440343:0:3286:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff94c83f9a9c00 x1875765421457920/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788869449 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788869433.440360:0:3286:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94c83f9a9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3286:1875765421457920:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1788869433.755575:0:7447:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788869434.779423:0:5743:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788869435.805478:0:5742:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788869436.507479:0:3286:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94c810e6aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3286:1875765421458048:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788869436.507565:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869436.507676:0:6548:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765421458048 00000100:00100000:2.0:1788869436.507687:0:6548:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765421458048 00000100:00100000:2.0:1788869436.507756:0:6548:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00080000:3.0:1788869436.507774:0:5751:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788869436.507781:0:6548:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c810e68700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3286:x1875765421458048:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788869436.507818:0:6548:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788869436.507883:0:6548:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c810e68700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3286:x1875765421458048:12345-0@lo:13:osp-pre-1-0.0 Request processed in 105us (317us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869436.507889:0:6548:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1788869436.507973:0:3286:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94c810e6aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3286:1875765421458048:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788869436.508203:0:3283:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94c83fbb0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:121cd5bc-7f07-4cf7-8e2e-4356c89c0696:3283:1875765421458176:0@lo:400:kworker.0 00000100:00100000:2.0:1788869436.508238:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869436.508331:0:5750:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765421458176 00000100:00100000:1.0:1788869436.508336:0:5750:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765421458176 00000100:00100000:1.0:1788869436.508370:0:5750:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 263 00000100:00100000:1.0:1788869436.508377:0:5750:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c81f14f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:121cd5bc-7f07-4cf7-8e2e-4356c89c0696+19:3283:x1875765421458176:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788869436.508388:0:3284:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94c803fbb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3284:1875765421458304:0@lo:400:kworker.0 00000100:00100000:3.0:1788869436.508431:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869436.508462:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765421458304 00000100:00100000:3.0:1788869436.508466:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765421458304 00000100:00100000:3.0:1788869436.508492:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1788869436.508497:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c83f9a8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3284:x1875765421458304:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788869436.508529:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c83f9a8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3284:x1875765421458304:12345-0@lo:400:kworker.0 Request processed in 32us (98us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869436.508544:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1788869436.508571:0:3284:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94c803fbb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3284:1875765421458304:0@lo:400:kworker.0 00000100:00100000:0.0:1788869436.508859:0:3284:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788869436.508879:0:3284:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94c803fb9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3284:1875765421458688:0@lo:400:kworker.0 00000100:00100000:0.0:1788869436.508905:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869436.508980:0:3285:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94c803fb9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3285:1875765421458432:0@lo:400:kworker.0 00000100:00100000:3.0:1788869436.509007:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869436.509032:0:3285:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788869436.509037:0:3285:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94c803fbaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3285:1875765421458560:0@lo:400:kworker.0 00000100:00100000:3.0:1788869436.509061:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869436.509096:0:5757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765421458688 00000100:00100000:3.0:1788869436.509100:0:5757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765421458688 00000100:00100000:3.0:1788869436.509124:0:5757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765421458432 00000100:00100000:3.0:1788869436.509136:0:5757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765421458432 00000100:00100000:3.0:1788869436.509156:0:5757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1788869436.509162:0:5757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c803fb8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3284:x1875765421458688:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788869436.509195:0:5757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c803fb8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3284:x1875765421458688:12345-0@lo:400:kworker.0 Request processed in 33us (288us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869436.509201:0:5757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1788869436.509214:0:5757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1788869436.509220:0:5757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c83f9a8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3285:x1875765421458432:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788869436.509267:0:5757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c83f9a8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3285:x1875765421458432:12345-0@lo:400:kworker.0 Request processed in 30us (241us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869436.509273:0:5757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00080000:3.0:1788869436.509290:0:5751:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788869436.509310:0:3285:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94c803fb9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3285:1875765421458432:0@lo:400:kworker.0 00000100:00100000:0.0:1788869436.509513:0:7884:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765421458560 00000100:00100000:0.0:1788869436.509517:0:7884:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765421458560 00000100:00100000:0.0:1788869436.509561:0:7884:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1788869436.509569:0:7884:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c83f9a9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3285:x1875765421458560:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788869436.509606:0:7884:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c83f9a9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3285:x1875765421458560:12345-0@lo:400:kworker.0 Request processed in 39us (544us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869436.509612:0:7884:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1788869436.509640:0:3284:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94c803fb9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3284:1875765421458688:0@lo:400:kworker.0 00010000:00080000:0.0:1788869436.509662:0:3285:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff94c803fbaa00 x1875765421458560/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788869452 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788869436.509673:0:3285:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94c803fbaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3285:1875765421458560:0@lo:400:kworker.0 00000100:00080000:3.0:1788869436.509735:0:5751:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788869436.520573:0:5750:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c81f14f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:121cd5bc-7f07-4cf7-8e2e-4356c89c0696+19:3283:x1875765421458176:12345-0@lo:400:kworker.0 Request processed in 12184us (12322us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869436.520591:0:5750:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 263 00000100:00100000:2.0:1788869436.520619:0:3283:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94c83fbb0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:121cd5bc-7f07-4cf7-8e2e-4356c89c0696:3283:1875765421458176:0@lo:400:kworker.0 00010000:00010000:3.0:1788869436.827379:0:7447:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788869437.851606:0:5743:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788869437.867921:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1788869437.867972:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1788869437.868317:0:5757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765413042304 00000100:00100000:3.0:1788869437.868327:0:5757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765413042304 00000100:00100000:3.0:1788869437.868397:0:5757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 80 00000100:00100000:3.0:1788869437.868407:0:5757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c803fbaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2125b9b3-626e-4cbe-be83-fb446e976ce2+5:2346:x1875765413042304:12345-192.168.201.39@tcp:400:kworker.0 00000100:00100000:3.0:1788869437.868477:0:5757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c803fbaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2125b9b3-626e-4cbe-be83-fb446e976ce2+5:2346:x1875765413042304:12345-192.168.201.39@tcp:400:kworker.0 Request processed in 71us (504us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869437.868484:0:5757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 80 00000100:00080000:3.0:1788869437.868503:0:5751:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788869437.868697:0:5749:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765413042176 00000100:00100000:1.0:1788869437.868702:0:5749:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765413042176 00000100:00100000:1.0:1788869437.868738:0:5749:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 264 00000100:00100000:1.0:1788869437.868745:0:5749:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c81f14c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3cca3acf-4935-4d0d-9982-d5d931f1c86b+13:2346:x1875765413042176:12345-192.168.201.39@tcp:400:kworker.0 00000100:00100000:1.0:1788869437.868777:0:5749:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c81f14c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3cca3acf-4935-4d0d-9982-d5d931f1c86b+13:2346:x1875765413042176:12345-192.168.201.39@tcp:400:kworker.0 Request processed in 33us (866us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869437.868784:0:5749:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 264 00000100:00100000:0.0:1788869437.874996:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1788869437.875046:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1788869437.875133:0:6547:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765413042432 00000100:00100000:1.0:1788869437.875135:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765413042560 00000100:00100000:3.0:1788869437.875143:0:6547:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765413042432 00000100:00100000:1.0:1788869437.875148:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765413042560 00000100:00080000:0.0:1788869437.875197:0:5751:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788869437.875202:0:5751:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788869437.875224:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 81 00000100:00100000:3.0:1788869437.875225:0:6547:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 19 00000100:00100000:1.0:1788869437.875240:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c803fba300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:10cd6f3c-009b-4acc-9ca5-e50cb17e412c+5:2345:x1875765413042560:12345-192.168.201.39@tcp:400:kworker.0 00000100:00100000:3.0:1788869437.875241:0:6547:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c803fb9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2125b9b3-626e-4cbe-be83-fb446e976ce2+5:2344:x1875765413042432:12345-192.168.201.39@tcp:9:kworker.0 00000020:00000080:3.0:1788869437.875303:0:6547:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x3d2d1916761d65bd 00000100:00080000:3.0:1788869437.875312:0:6547:0:(import.c:65:import_set_state_nolock()) ffff94c835502800 : changing import state from FULL to CLOSED 00000100:00100000:1.0:1788869437.875337:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c803fba300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:10cd6f3c-009b-4acc-9ca5-e50cb17e412c+5:2345:x1875765413042560:12345-192.168.201.39@tcp:400:kworker.0 Request processed in 101us (289us total) trans 0 rc 0/0 00010000:00010000:0.0:1788869437.875338:0:5742:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788869437.875348:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 81 00000001:00000004:3.0:1788869437.875353:0:6547:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967300 00000100:00100000:3.0:1788869437.875695:0:6547:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c803fb9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2125b9b3-626e-4cbe-be83-fb446e976ce2+2:2344:x1875765413042432:12345-192.168.201.39@tcp:9:kworker.0 Request processed in 458us (708us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869437.875703:0:6547:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 19 00000100:00100000:1.0:1788869438.555468:0:3284:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94c803fb9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3284:1875765421458816:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788869438.555539:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869438.555593:0:6548:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765421458816 00000100:00100000:2.0:1788869438.555602:0:6548:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765421458816 00000100:00100000:2.0:1788869438.555672:0:6548:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1788869438.555683:0:6548:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c702348000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3284:x1875765421458816:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788869438.555715:0:6548:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788869438.555782:0:6548:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c702348000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3284:x1875765421458816:12345-0@lo:13:osp-pre-0-0.0 Request processed in 101us (241us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869438.555789:0:6548:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00010000:00080000:1.0:1788869438.555819:0:3284:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff94c803fb9f80 x1875765421458816/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788869454 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788869438.555850:0:3284:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94c803fb9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3284:1875765421458816:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1788869438.555853:0:5751:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:02000400:1.0:1788869438.803039:0:11654:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1a: Test manual lfs pcc attach with manual HSM restore ========================================================== 08:10:36 (1788869436) 00010000:00010000:3.0:1788869438.875452:0:7447:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788869439.003981:0:11485:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1788869439.692360:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1788869439.692436:0:5757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765413042688 00000100:00100000:3.0:1788869439.692446:0:5757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765413042688 00000100:00100000:3.0:1788869439.692528:0:5757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 31 00000100:00100000:3.0:1788869439.692540:0:5757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c803fbb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2125b9b3-626e-4cbe-be83-fb446e976ce2+5:10164:x1875765413042688:12345-192.168.201.39@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788869439.692560:0:5757:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788869439.692584:0:5757:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504c200/0x3d2d1916761d6688 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x375c010249035840 expref: -99 pid: 5757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869439.693921:0:5757:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504c400/0x3d2d1916761d668f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869439.693939:0:5757:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504c400/0x3d2d1916761d668f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869439.693951:0:5757:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504c400/0x3d2d1916761d668f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5757 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788869439.694125:0:5757:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:3.0:1788869439.694129:0:5757:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:3.0:1788869439.694212:0:5757:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504c400/0x3d2d1916761d668f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869439.694239:0:5757:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504c200/0x3d2d1916761d6688 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0x375c010249035840 expref: 7 pid: 5757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869439.694271:0:5757:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504c400/0x3d2d1916761d668f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0x375c010249035840 expref: 6 pid: 5757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869439.694279:0:5757:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff94c819394d00) 00010000:00010000:3.0:1788869439.694282:0:5757:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788869439.694285:0:5757:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94c83504c400, rc 0) 00000100:00100000:3.0:1788869439.694357:0:5757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c803fbb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2125b9b3-626e-4cbe-be83-fb446e976ce2+6:10164:x1875765413042688:12345-192.168.201.39@tcp:101:lhsmtool_posix.0 Request processed in 1819us (2005us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869439.694365:0:5757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 31 00000100:00080000:0.0:1788869439.694468:0:5751:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788869439.700339:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1788869439.700395:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765413042816 00000100:00100000:3.0:1788869439.700403:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765413042816 00000100:00100000:3.0:1788869439.700460:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 32 00000100:00100000:3.0:1788869439.700467:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c702348e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2125b9b3-626e-4cbe-be83-fb446e976ce2+6:10165:x1875765413042816:12345-192.168.201.39@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788869439.700494:0:5786:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788869439.700514:0:5786:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504c200/0x3d2d1916761d6696 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x375c010249035847 expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869439.700571:0:5786:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504d800/0x3d2d1916761d669d lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869439.700581:0:5786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504d800/0x3d2d1916761d669d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869439.700589:0:5786:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504d800/0x3d2d1916761d669d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869439.700598:0:5786:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504c000/0x3d2d1916761d66a4 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869439.700602:0:5786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504c000/0x3d2d1916761d66a4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869439.700606:0:5786:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504c000/0x3d2d1916761d66a4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869439.700986:0:5786:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504dc00/0x3d2d1916761d66ab lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869439.700995:0:5786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504dc00/0x3d2d1916761d66ab lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869439.701009:0:5786:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504dc00/0x3d2d1916761d66ab lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788869439.701103:0:5786:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 6656 00000004:00200000:3.0:1788869439.701107:0:5786:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:3.0:1788869439.701172:0:5786:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504dc00/0x3d2d1916761d66ab lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869439.701184:0:5786:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504d800/0x3d2d1916761d669d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869439.701190:0:5786:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504d800/0x3d2d1916761d669d lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869439.701196:0:5786:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504d800/0x3d2d1916761d669d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869439.701202:0:5786:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94c83504d800 already unused, calling callback (ffffffffc21124f0) 00010000:00010000:3.0:1788869439.701205:0:5786:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504d800/0x3d2d1916761d669d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869439.701212:0:5786:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504d800/0x3d2d1916761d669d lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869439.701223:0:5786:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff94c819394d00) 00010000:00010000:3.0:1788869439.701226:0:5786:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788869439.701230:0:5786:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504d800/0x3d2d1916761d669d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869439.701236:0:5786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504d800/0x3d2d1916761d669d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869439.701284:0:5786:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504c000/0x3d2d1916761d66a4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869439.701303:0:5786:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504c000/0x3d2d1916761d66a4 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869439.701310:0:5786:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504c000/0x3d2d1916761d66a4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869439.701316:0:5786:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94c83504c000 already unused, calling callback (ffffffffc21124f0) 00010000:00010000:3.0:1788869439.701320:0:5786:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504c000/0x3d2d1916761d66a4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869439.701326:0:5786:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504c000/0x3d2d1916761d66a4 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869439.701335:0:5786:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff94c819394100) 00010000:00010000:3.0:1788869439.701337:0:5786:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788869439.701340:0:5786:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504c000/0x3d2d1916761d66a4 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869439.701346:0:5786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504c000/0x3d2d1916761d66a4 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869439.701375:0:5786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504c200/0x3d2d1916761d6696 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0x375c010249035847 expref: 8 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869439.701392:0:5786:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504dc00/0x3d2d1916761d66ab lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0x375c010249035847 expref: 7 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869439.701400:0:5786:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff94c819394f00) 00010000:00010000:3.0:1788869439.701403:0:5786:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788869439.701411:0:5786:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94c83504dc00, rc 0) 00000100:00100000:3.0:1788869439.701470:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c702348e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2125b9b3-626e-4cbe-be83-fb446e976ce2+7:10165:x1875765413042816:12345-192.168.201.39@tcp:101:lhsmtool_posix.0 Request processed in 1002us (1139us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869439.701477:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 32 00000100:00100000:2.0:1788869439.703526:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1788869439.703570:0:5757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765413043072 00000100:00100000:3.0:1788869439.703579:0:5757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765413043072 00000100:00100000:3.0:1788869439.703631:0:5757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 33 00000100:00100000:3.0:1788869439.703641:0:5757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c810e69500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2125b9b3-626e-4cbe-be83-fb446e976ce2+7:10165:x1875765413043072:12345-192.168.201.39@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788869439.703656:0:5757:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788869439.703670:0:5757:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504d200/0x3d2d1916761d66b2 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x375c01024903584e expref: -99 pid: 5757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869439.703721:0:5757:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504c600/0x3d2d1916761d66b9 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869439.703730:0:5757:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504c600/0x3d2d1916761d66b9 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869439.703737:0:5757:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504c600/0x3d2d1916761d66b9 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869439.703747:0:5757:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504ce00/0x3d2d1916761d66c0 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869439.703752:0:5757:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504ce00/0x3d2d1916761d66c0 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869439.703755:0:5757:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504ce00/0x3d2d1916761d66c0 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869439.704215:0:5757:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504cc00/0x3d2d1916761d66c7 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869439.704228:0:5757:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504cc00/0x3d2d1916761d66c7 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869439.704236:0:5757:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504cc00/0x3d2d1916761d66c7 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5757 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788869439.704246:0:5757:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 6656 00010000:00010000:3.0:1788869439.704462:0:5757:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504c600/0x3d2d1916761d66b9 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869439.704468:0:5757:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504c600/0x3d2d1916761d66b9 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869439.704472:0:5757:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504c600/0x3d2d1916761d66b9 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869439.704476:0:5757:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94c83504c600 already unused, calling callback (ffffffffc21124f0) 00010000:00010000:3.0:1788869439.704479:0:5757:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504c600/0x3d2d1916761d66b9 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869439.704484:0:5757:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504c600/0x3d2d1916761d66b9 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869439.704495:0:5757:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff94c819394f00) 00010000:00010000:3.0:1788869439.704498:0:5757:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788869439.704501:0:5757:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504c600/0x3d2d1916761d66b9 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869439.704507:0:5757:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504c600/0x3d2d1916761d66b9 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869439.704519:0:5757:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504ce00/0x3d2d1916761d66c0 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869439.704530:0:5757:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504ce00/0x3d2d1916761d66c0 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869439.704535:0:5757:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504ce00/0x3d2d1916761d66c0 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869439.704540:0:5757:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94c83504ce00 already unused, calling callback (ffffffffc21124f0) 00010000:00010000:3.0:1788869439.704544:0:5757:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504ce00/0x3d2d1916761d66c0 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869439.704550:0:5757:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504ce00/0x3d2d1916761d66c0 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869439.704557:0:5757:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff94c819394300) 00010000:00010000:3.0:1788869439.704560:0:5757:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788869439.704562:0:5757:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504ce00/0x3d2d1916761d66c0 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869439.704568:0:5757:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504ce00/0x3d2d1916761d66c0 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869439.704894:0:5757:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504d200/0x3d2d1916761d66b2 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0x375c01024903584e expref: 10 pid: 5757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869439.704909:0:5757:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504cc00/0x3d2d1916761d66c7 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0x375c01024903584e expref: 9 pid: 5757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869439.704916:0:5757:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff94c819394200) 00010000:00010000:3.0:1788869439.704918:0:5757:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788869439.704926:0:5757:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94c83504cc00, rc 0) 00000100:00100000:3.0:1788869439.704991:0:5757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c810e69500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2125b9b3-626e-4cbe-be83-fb446e976ce2+9:10165:x1875765413043072:12345-192.168.201.39@tcp:101:lhsmtool_posix.0 Request processed in 1349us (1469us total) trans 4294967309 rc 0/0 00000100:00100000:3.0:1788869439.704999:0:5757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 33 00000100:00100000:0.0:1788869439.707085:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1788869439.707144:0:5756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765413043200 00000100:00100000:1.0:1788869439.707151:0:5756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765413043200 00000100:00100000:1.0:1788869439.707196:0:5756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 34 00000100:00100000:1.0:1788869439.707203:0:5756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c803fb9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2125b9b3-626e-4cbe-be83-fb446e976ce2+9:10165:x1875765413043200:12345-192.168.201.39@tcp:59:lhsmtool_posix.0 00000100:00100000:1.0:1788869439.707309:0:5756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c803fb9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2125b9b3-626e-4cbe-be83-fb446e976ce2+9:10165:x1875765413043200:12345-192.168.201.39@tcp:59:lhsmtool_posix.0 Request processed in 106us (230us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869439.707314:0:5756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 34 00010000:00010000:0.0:1788869439.903129:0:5743:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788869440.029887:0:11485:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000001:00080000:1.0:1788869440.113836:0:5777:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967309 is committed 00000001:00100000:2.0:1788869440.124089:0:7458:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 2125b9b3-626e-4cbe-be83-fb446e976ce2 00000020:00000080:2.0:1788869440.124102:0:7458:0:(genops.c:906:class_export_put()) final put ffff94c835505800/2125b9b3-626e-4cbe-be83-fb446e976ce2 00000020:00000080:3.0:1788869440.124420:0:472:0:(genops.c:865:class_export_destroy()) destroying export ffff94c835505800/2125b9b3-626e-4cbe-be83-fb446e976ce2 for lustre-OST0001 00000020:00000080:3.0:1788869440.124471:0:472:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff94c835502800 for lustre-OST0001 00000100:00100000:1.0:1788869440.716892:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1788869440.717822:0:5755:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765413043328 00000100:00100000:0.0:1788869440.717833:0:5755:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765413043328 00000100:00100000:0.0:1788869440.717932:0:5755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 35 00000100:00100000:0.0:1788869440.717941:0:5755:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c702348700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2125b9b3-626e-4cbe-be83-fb446e976ce2+8:10207:x1875765413043328:12345-192.168.201.39@tcp:101:lfs.0 00010000:00010000:0.0:1788869440.717962:0:5755:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788869440.717982:0:5755:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94c81a582200/0x3d2d1916761d66d5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x375c010249035855 expref: -99 pid: 5755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869440.718037:0:5755:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff94c81a583000/0x3d2d1916761d66dc lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869440.718048:0:5755:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94c81a583000/0x3d2d1916761d66dc lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869440.718057:0:5755:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94c81a583000/0x3d2d1916761d66dc lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869440.718067:0:5755:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94c81a583400/0x3d2d1916761d66e3 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869440.718079:0:5755:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94c81a583400/0x3d2d1916761d66e3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869440.718086:0:5755:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94c81a583400/0x3d2d1916761d66e3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869440.718293:0:5755:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff94c81a583000/0x3d2d1916761d66dc lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869440.718300:0:5755:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94c81a583000/0x3d2d1916761d66dc lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869440.718304:0:5755:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94c81a583000/0x3d2d1916761d66dc lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869440.718307:0:5755:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94c81a583000 already unused, calling callback (ffffffffc21124f0) 00010000:00010000:0.0:1788869440.718310:0:5755:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94c81a583000/0x3d2d1916761d66dc lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869440.718316:0:5755:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94c81a583000/0x3d2d1916761d66dc lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869440.718327:0:5755:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff94c819394d00) 00010000:00010000:0.0:1788869440.718330:0:5755:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788869440.718334:0:5755:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94c81a583000/0x3d2d1916761d66dc lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869440.718340:0:5755:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94c81a583000/0x3d2d1916761d66dc lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869440.718351:0:5755:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94c81a583400/0x3d2d1916761d66e3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869440.718362:0:5755:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94c81a583400/0x3d2d1916761d66e3 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869440.718369:0:5755:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94c81a583400/0x3d2d1916761d66e3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869440.718374:0:5755:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94c81a583400 already unused, calling callback (ffffffffc21124f0) 00010000:00010000:0.0:1788869440.718378:0:5755:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94c81a583400/0x3d2d1916761d66e3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869440.718384:0:5755:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94c81a583400/0x3d2d1916761d66e3 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869440.718392:0:5755:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff94c803990200) 00010000:00010000:0.0:1788869440.718395:0:5755:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788869440.718398:0:5755:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94c81a583400/0x3d2d1916761d66e3 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869440.718404:0:5755:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94c81a583400/0x3d2d1916761d66e3 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869440.718434:0:5755:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94c81a582200/0x3d2d1916761d66d5 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0x375c010249035855 expref: 9 pid: 5755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869440.718441:0:5755:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff94c819394d00) 00010000:00010000:0.0:1788869440.718442:0:5755:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788869440.718445:0:5755:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94c81a582200/0x3d2d1916761d66d5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.39@tcp remote: 0x375c010249035855 expref: 9 pid: 5755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869440.718451:0:5755:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94c81a582200, rc 0) 00000100:00100000:0.0:1788869440.718504:0:5755:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c702348700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2125b9b3-626e-4cbe-be83-fb446e976ce2+8:10207:x1875765413043328:12345-192.168.201.39@tcp:101:lfs.0 Request processed in 564us (1618us total) trans 0 rc 301/301 00000100:00100000:0.0:1788869440.718509:0:5755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 35 00000100:00100000:2.0:1788869440.729420:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1788869440.729514:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765413043584 00000100:00100000:1.0:1788869440.729523:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765413043584 00000100:00100000:1.0:1788869440.729611:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 36 00000100:00100000:1.0:1788869440.729629:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c810e6b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2125b9b3-626e-4cbe-be83-fb446e976ce2+8:10207:x1875765413043584:12345-192.168.201.39@tcp:36:lfs.0 00010000:00010000:1.0:1788869440.729685:0:5786:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788869440.729710:0:5786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504c400/0x3d2d1916761d668f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.39@tcp remote: 0x375c010249035840 expref: 8 pid: 5757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869440.729725:0:5786:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff94c819394d00) 00010000:00010000:1.0:1788869440.729735:0:5786:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788869440.730007:0:5786:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94c8421f3a00/0x3d2d1916761d66ea lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869440.730021:0:5786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94c8421f3a00/0x3d2d1916761d66ea lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869440.730031:0:5786:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94c8421f3a00/0x3d2d1916761d66ea lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869440.730043:0:5786:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94c8421f3400/0x3d2d1916761d66f1 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869440.730050:0:5786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94c8421f3400/0x3d2d1916761d66f1 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869440.730057:0:5786:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94c8421f3400/0x3d2d1916761d66f1 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788869440.731424:0:5786:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00010000:00010000:1.0:1788869440.731438:0:5786:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94c8421f3a00/0x3d2d1916761d66ea lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869440.731448:0:5786:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94c8421f3a00/0x3d2d1916761d66ea lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869440.731467:0:5786:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94c8421f3a00/0x3d2d1916761d66ea lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869440.731473:0:5786:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94c8421f3a00 already unused, calling callback (ffffffffc21124f0) 00010000:00010000:1.0:1788869440.731478:0:5786:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94c8421f3a00/0x3d2d1916761d66ea lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869440.731487:0:5786:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94c8421f3a00/0x3d2d1916761d66ea lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869440.731502:0:5786:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff94c81a585400) 00010000:00010000:1.0:1788869440.731506:0:5786:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788869440.731510:0:5786:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94c8421f3a00/0x3d2d1916761d66ea lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869440.731516:0:5786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94c8421f3a00/0x3d2d1916761d66ea lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788869440.731539:0:5786:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000006a365ac reply state 00000000c666ddaa transno 4294967310 ns: mdt-lustre-MDT0000_UUID lock: ffff94c8421f3400/0x3d2d1916761d66f1 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788869440.731549:0:5786:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788869440.731650:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c810e6b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2125b9b3-626e-4cbe-be83-fb446e976ce2+9:10207:x1875765413043584:12345-192.168.201.39@tcp:36:lfs.0 Request processed in 2020us (2237us total) trans 4294967310 rc 0/0 00000100:00100000:1.0:1788869440.731659:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 36 00010000:00010000:2.0:1788869440.733786:0:3269:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94c8421f3400/0x3d2d1916761d66f1 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869440.733812:0:3269:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94c8421f3400/0x3d2d1916761d66f1 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869440.733826:0:3269:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94c8421f3400/0x3d2d1916761d66f1 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869440.733832:0:3269:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94c8421f3400 already unused, calling callback (ffffffffc21124f0) 00010000:00010000:2.0:1788869440.733837:0:3269:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94c8421f3400/0x3d2d1916761d66f1 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869440.733845:0:3269:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94c8421f3400/0x3d2d1916761d66f1 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869440.733869:0:3269:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff94c81a585c00) 00010000:00010000:2.0:1788869440.733872:0:3269:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788869440.733877:0:3269:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94c8421f3400/0x3d2d1916761d66f1 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869440.733884:0:3269:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94c8421f3400/0x3d2d1916761d66f1 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788869440.794809:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1788869440.794869:0:5757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765413043712 00000100:00100000:3.0:1788869440.794878:0:5757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765413043712 00000100:00100000:3.0:1788869440.794940:0:5757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 37 00000100:00100000:3.0:1788869440.794951:0:5757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c810e69880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2125b9b3-626e-4cbe-be83-fb446e976ce2+8:10215:x1875765413043712:12345-192.168.201.39@tcp:101:lctl.0 00010000:00010000:3.0:1788869440.794974:0:5757:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788869440.794998:0:5757:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504ce00/0x3d2d1916761d66f8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x375c01024903585c expref: -99 pid: 5757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869440.795060:0:5757:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504d200/0x3d2d1916761d66ff lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869440.795074:0:5757:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504d200/0x3d2d1916761d66ff lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869440.795087:0:5757:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504d200/0x3d2d1916761d66ff lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5757 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788869440.795146:0:5757:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:3.0:1788869440.795150:0:5757:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:3.0:1788869440.795191:0:5757:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504d200/0x3d2d1916761d66ff lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869440.795214:0:5757:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504ce00/0x3d2d1916761d66f8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0x375c01024903585c expref: 10 pid: 5757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869440.795312:0:5757:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504d200/0x3d2d1916761d66ff lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0x375c01024903585c expref: 9 pid: 5757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869440.795333:0:5757:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff94c819394300) 00010000:00010000:3.0:1788869440.795335:0:5757:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788869440.795339:0:5757:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94c83504d200, rc 0) 00000100:00100000:3.0:1788869440.795400:0:5757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c810e69880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2125b9b3-626e-4cbe-be83-fb446e976ce2+9:10215:x1875765413043712:12345-192.168.201.39@tcp:101:lctl.0 Request processed in 451us (598us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869440.795409:0:5757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 37 00000100:00100000:1.0:1788869440.835969:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1788869440.836044:0:5756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765413043840 00000100:00100000:0.0:1788869440.836054:0:5756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765413043840 00000100:00100000:0.0:1788869440.836109:0:5756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 38 00000100:00100000:0.0:1788869440.836118:0:5756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c70234b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2125b9b3-626e-4cbe-be83-fb446e976ce2+9:10221:x1875765413043840:12345-192.168.201.39@tcp:101:bash.0 00010000:00010000:0.0:1788869440.836148:0:5756:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788869440.836169:0:5756:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94c81a582200/0x3d2d1916761d6706 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x375c010249035863 expref: -99 pid: 5756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869440.836228:0:5756:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff94c81a583400/0x3d2d1916761d670d lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869440.836242:0:5756:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94c81a583400/0x3d2d1916761d670d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869440.836284:0:5756:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94c81a583400/0x3d2d1916761d670d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869440.836301:0:5756:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94c81a583000/0x3d2d1916761d6714 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869440.836310:0:5756:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94c81a583000/0x3d2d1916761d6714 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869440.836318:0:5756:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94c81a583000/0x3d2d1916761d6714 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869440.836475:0:5756:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94c8421f3a00/0x3d2d1916761d671b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869440.836497:0:5756:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94c8421f3a00/0x3d2d1916761d671b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869440.836524:0:5756:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94c8421f3a00/0x3d2d1916761d671b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788869440.836558:0:5756:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00000004:00200000:1.0:1788869440.836562:0:5756:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1788869440.836611:0:5756:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff94c8421f3a00/0x3d2d1916761d671b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869440.836625:0:5756:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff94c81a583400/0x3d2d1916761d670d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869440.836631:0:5756:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94c81a583400/0x3d2d1916761d670d lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869440.836638:0:5756:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94c81a583400/0x3d2d1916761d670d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869440.836657:0:5756:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94c81a583400 already unused, calling callback (ffffffffc21124f0) 00010000:00010000:1.0:1788869440.836662:0:5756:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94c81a583400/0x3d2d1916761d670d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869440.836670:0:5756:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94c81a583400/0x3d2d1916761d670d lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869440.836691:0:5756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff94c819394300) 00010000:00010000:1.0:1788869440.836693:0:5756:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788869440.836698:0:5756:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94c81a583400/0x3d2d1916761d670d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869440.836705:0:5756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94c81a583400/0x3d2d1916761d670d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869440.836730:0:5756:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94c81a583000/0x3d2d1916761d6714 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869440.836737:0:5756:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94c81a583000/0x3d2d1916761d6714 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869440.836743:0:5756:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94c81a583000/0x3d2d1916761d6714 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869440.836748:0:5756:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94c81a583000 already unused, calling callback (ffffffffc21124f0) 00010000:00010000:1.0:1788869440.836751:0:5756:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94c81a583000/0x3d2d1916761d6714 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869440.836757:0:5756:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94c81a583000/0x3d2d1916761d6714 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869440.836764:0:5756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff94c803990200) 00010000:00010000:1.0:1788869440.836766:0:5756:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788869440.836769:0:5756:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94c81a583000/0x3d2d1916761d6714 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869440.836775:0:5756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94c81a583000/0x3d2d1916761d6714 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869440.836824:0:5756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94c81a582200/0x3d2d1916761d6706 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0x375c010249035863 expref: 11 pid: 5756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869440.836839:0:5756:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94c8421f3a00/0x3d2d1916761d671b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0x375c010249035863 expref: 10 pid: 5756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869440.836856:0:5756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff94c81a585400) 00010000:00010000:1.0:1788869440.836858:0:5756:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1788869440.836860:0:5756:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94c8421f3a00, rc 0) 00000100:00100000:1.0:1788869440.836933:0:5756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c70234b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2125b9b3-626e-4cbe-be83-fb446e976ce2+10:10221:x1875765413043840:12345-192.168.201.39@tcp:101:bash.0 Request processed in 815us (970us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869440.836940:0:5756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 38 00000100:00100000:2.0:1788869440.840119:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1788869440.840179:0:5757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765413044096 00000100:00100000:3.0:1788869440.840189:0:5757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765413044096 00000100:00100000:3.0:1788869440.840266:0:5757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 39 00000100:00100000:3.0:1788869440.840283:0:5757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c810e6b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2125b9b3-626e-4cbe-be83-fb446e976ce2+10:10221:x1875765413044096:12345-192.168.201.39@tcp:101:bash.0 00010000:00010000:3.0:1788869440.840301:0:5757:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788869440.840319:0:5757:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504ce00/0x3d2d1916761d6722 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x375c01024903586a expref: -99 pid: 5757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869440.840434:0:5757:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504c600/0x3d2d1916761d6729 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869440.840444:0:5757:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504c600/0x3d2d1916761d6729 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869440.840452:0:5757:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504c600/0x3d2d1916761d6729 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869440.840502:0:5757:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504c200/0x3d2d1916761d6730 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869440.840517:0:5757:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504c200/0x3d2d1916761d6730 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869440.840522:0:5757:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504c200/0x3d2d1916761d6730 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5757 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1788869440.840967:0:5757:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x2:0x0], index 0: 0 00010000:00010000:3.0:1788869440.841102:0:5757:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504c000/0x3d2d1916761d6737 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869440.841112:0:5757:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504c000/0x3d2d1916761d6737 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869440.841119:0:5757:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504c000/0x3d2d1916761d6737 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869440.841149:0:5757:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504c600/0x3d2d1916761d6729 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869440.841156:0:5757:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504c600/0x3d2d1916761d6729 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869440.841163:0:5757:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504c600/0x3d2d1916761d6729 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869440.841168:0:5757:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94c83504c600 already unused, calling callback (ffffffffc21124f0) 00010000:00010000:3.0:1788869440.841172:0:5757:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504c600/0x3d2d1916761d6729 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869440.841180:0:5757:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504c600/0x3d2d1916761d6729 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869440.841201:0:5757:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff94c81a585400) 00010000:00010000:3.0:1788869440.841204:0:5757:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788869440.841208:0:5757:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504c600/0x3d2d1916761d6729 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869440.841213:0:5757:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504c600/0x3d2d1916761d6729 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5757 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788869440.841225:0:5757:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000f00d12b7 reply state 000000002dee134f transno 4294967311 ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504c200/0x3d2d1916761d6730 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5757 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788869440.841234:0:5757:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1788869440.841287:0:5757:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504ce00/0x3d2d1916761d6722 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0x375c01024903586a expref: 13 pid: 5757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869440.841300:0:5757:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504c000/0x3d2d1916761d6737 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0x375c01024903586a expref: 12 pid: 5757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869440.841308:0:5757:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff94c819394e00) 00010000:00010000:3.0:1788869440.841310:0:5757:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788869440.841313:0:5757:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94c83504c000, rc 0) 00000100:00100000:3.0:1788869440.841375:0:5757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c810e6b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2125b9b3-626e-4cbe-be83-fb446e976ce2+13:10221:x1875765413044096:12345-192.168.201.39@tcp:101:bash.0 Request processed in 1100us (1262us total) trans 4294967311 rc 0/0 00000100:00100000:3.0:1788869440.841383:0:5757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 39 00010000:00010000:1.0:1788869440.843305:0:3270:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504c200/0x3d2d1916761d6730 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869440.843319:0:3270:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504c200/0x3d2d1916761d6730 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869440.843327:0:3270:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504c200/0x3d2d1916761d6730 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869440.843334:0:3270:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94c83504c200 already unused, calling callback (ffffffffc21124f0) 00010000:00010000:1.0:1788869440.843338:0:3270:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504c200/0x3d2d1916761d6730 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869440.843346:0:3270:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504c200/0x3d2d1916761d6730 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869440.843359:0:3270:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff94c819394600) 00010000:00010000:1.0:1788869440.843362:0:3270:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788869440.843367:0:3270:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504c200/0x3d2d1916761d6730 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869440.843374:0:3270:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504c200/0x3d2d1916761d6730 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5757 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788869440.844552:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1788869440.844609:0:7884:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765413044224 00000100:00100000:0.0:1788869440.844619:0:7884:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765413044224 00000100:00100000:0.0:1788869440.844674:0:7884:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 20 00000100:00100000:0.0:1788869440.844682:0:7884:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c810e6aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2344:x1875765413044224:12345-192.168.201.39@tcp:8:bash.0 00010000:00080000:0.0:1788869440.844714:0:7884:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0000: connection from 2125b9b3-626e-4cbe-be83-fb446e976ce2@192.168.201.39@tcp t0 exp 0000000000000000 cur 189 last 0 00000020:00000080:0.0:1788869440.844754:0:7884:0:(genops.c:1406:class_connect()) connect: client 2125b9b3-626e-4cbe-be83-fb446e976ce2, cookie 0x3d2d1916761d6745 00002000:00100000:0.0:1788869440.844885:0:7884:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 2125b9b3-626e-4cbe-be83-fb446e976ce2/ffff94c810db2800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113718 ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1788869440.844911:0:7884:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:0.0:1788869440.845152:0:7884:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1788869440.845178:0:7884:0:(import.c:65:import_set_state_nolock()) ffff94c810db1800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788869440.845241:0:7884:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c810e6aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:2125b9b3-626e-4cbe-be83-fb446e976ce2+6:2344:x1875765413044224:12345-192.168.201.39@tcp:8:bash.0 Request processed in 558us (693us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869440.845274:0:7884:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 20 00000100:00100000:2.0:1788869440.846623:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1788869440.846662:0:6547:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765413044352 00000100:00100000:3.0:1788869440.846671:0:6547:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765413044352 00000100:00080000:0.0:1788869440.846736:0:5751:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788869440.846747:0:6547:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 21 00000100:00100000:3.0:1788869440.846758:0:6547:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c810e6b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2125b9b3-626e-4cbe-be83-fb446e976ce2+6:0:x1875765413044352:12345-192.168.201.39@tcp:101:bash.0 00010000:00010000:3.0:1788869440.846800:0:6547:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788869440.846822:0:6547:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002376f634/0x3d2d1916761d674c lrc: 2/0,0 mode: --/PR res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x375c010249035871 expref: -99 pid: 6547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788869440.846848:0:6547:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788869440.846864:0:6547:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=189s v=(0 0) 00010000:00010000:3.0:1788869440.846869:0:6547:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788869440.846879:0:6547:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002376f634/0x3d2d1916761d674c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.39@tcp remote: 0x375c010249035871 expref: 7 pid: 6547 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869440.846902:0:6547:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000002376f634/0x3d2d1916761d674c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.39@tcp remote: 0x375c010249035871 expref: 7 pid: 6547 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869440.846916:0:6547:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94c83504d800, rc 0) 00000100:00100000:3.0:1788869440.846963:0:6547:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c810e6b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2125b9b3-626e-4cbe-be83-fb446e976ce2+7:0:x1875765413044352:12345-192.168.201.39@tcp:101:bash.0 Request processed in 208us (345us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869440.846971:0:6547:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 21 00000100:00100000:1.0:1788869440.850205:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1788869440.850289:0:6546:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765413044480 00000100:00100000:2.0:1788869440.850298:0:6546:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765413044480 00000100:00100000:2.0:1788869440.850348:0:6546:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 22 00000100:00100000:2.0:1788869440.850358:0:6546:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c70234a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2125b9b3-626e-4cbe-be83-fb446e976ce2+7:10221:x1875765413044480:12345-192.168.201.39@tcp:101:bash.0 00010000:00010000:2.0:1788869440.850375:0:6546:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788869440.850393:0:6546:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a1bb1fc7/0x3d2d1916761d6753 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x375c010249035878 expref: -99 pid: 6546 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869440.850435:0:6546:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000002376f634/0x3d2d1916761d674c lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.39@tcp remote: 0x375c010249035871 expref: 8 pid: 6547 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869440.850443:0:6546:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788869440.850455:0:6546:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788869440.850464:0:6546:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a1bb1fc7/0x3d2d1916761d6753 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.201.39@tcp remote: 0x375c010249035878 expref: 8 pid: 6546 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869440.850493:0:6546:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000002376f634/0x3d2d1916761d674c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.39@tcp remote: 0x375c010249035871 expref: 8 pid: 6547 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869440.850504:0:6546:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000002376f634/0x3d2d1916761d674c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.39@tcp remote: 0x375c010249035871 expref: 8 pid: 6547 timeout: 289 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788869440.850517:0:6546:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94c810e68000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6546:1875765421458944:192.168.201.39@tcp:104: 00000100:00100000:2.0:1788869440.850598:0:6546:0:(client.c:2702:ptlrpc_set_wait()) set ffff94c83c6f6480 going to sleep for 11 seconds 00000100:00100000:0.0:1788869440.852024:0:6546:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94c810e68000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6546:1875765421458944:192.168.201.39@tcp:104: 00010000:00010000:0.0:1788869440.852060:0:6546:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000a1bb1fc7/0x3d2d1916761d6753 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.39@tcp remote: 0x375c010249035878 expref: 8 pid: 6546 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869440.852089:0:6546:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94c805039600, rc 0) 00000100:00100000:0.0:1788869440.852159:0:6546:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c70234a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2125b9b3-626e-4cbe-be83-fb446e976ce2+8:10221:x1875765413044480:12345-192.168.201.39@tcp:101:bash.0 Request processed in 1800us (1958us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869440.852169:0:6546:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 22 00000100:00100000:1.0:1788869440.852230:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1788869440.853912:0:5741:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765413044608 00000100:00100000:3.0:1788869440.853923:0:5741:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765413044608 00010000:00010000:3.0:1788869440.853966:0:5741:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000002376f634/0x3d2d1916761d674c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.39@tcp remote: 0x375c010249035871 expref: 8 pid: 6547 timeout: 289 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788869440.854005:0:5741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 35 00000100:00100000:3.0:1788869440.854015:0:5741:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c702349f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2125b9b3-626e-4cbe-be83-fb446e976ce2+8:2348:x1875765413044608:12345-192.168.201.39@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788869440.854030:0:5741:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788869440.854052:0:5741:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000002376f634/0x3d2d1916761d674c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.39@tcp remote: 0x375c010249035871 expref: 8 pid: 6547 timeout: 289 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869440.854079:0:5741:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000002376f634/0x3d2d1916761d674c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.39@tcp remote: 0x375c010249035871 expref: 8 pid: 6547 timeout: 289 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869440.854105:0:5741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002376f634/0x3d2d1916761d674c lrc: 0/0,0 mode: --/PR res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.39@tcp remote: 0x375c010249035871 expref: 8 pid: 6547 timeout: 289 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869440.854121:0:5741:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788869440.854126:0:5741:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788869440.854133:0:5741:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000a1bb1fc7/0x3d2d1916761d6753 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.39@tcp remote: 0x375c010249035878 expref: 7 pid: 6546 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869440.854144:0:5741:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a1bb1fc7/0x3d2d1916761d6753 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.39@tcp remote: 0x375c010249035878 expref: 7 pid: 6546 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869440.854179:0:5741:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000a1bb1fc7/0x3d2d1916761d6753 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.39@tcp remote: 0x375c010249035878 expref: 7 pid: 6546 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788869440.854193:0:5741:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94c83f9abb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:5741:1875765421459072:192.168.201.39@tcp:105: 00000100:00100000:3.0:1788869440.854315:0:5741:0:(client.c:2702:ptlrpc_set_wait()) set ffff94c807dff480 going to sleep for 11 seconds 00000100:00100000:1.0:1788869440.858375:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1788869440.858654:0:5741:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94c83f9abb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:5741:1875765421459072:192.168.201.39@tcp:105: 00010000:00010000:3.0:1788869440.858677:0:5741:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788869440.858732:0:5741:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c702349f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2125b9b3-626e-4cbe-be83-fb446e976ce2+7:2348:x1875765413044608:12345-192.168.201.39@tcp:103:ldlm_bl.0 Request processed in 4718us (6503us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869440.858743:0:5741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 35 00000100:00100000:0.0:1788869440.859877:0:5758:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765413044864 00000100:00100000:0.0:1788869440.859886:0:5758:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765413044864 00000100:00100000:0.0:1788869440.859945:0:5758:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 6 00000100:00100000:0.0:1788869440.859956:0:5758:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c702349500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2125b9b3-626e-4cbe-be83-fb446e976ce2+12:10221:x1875765413044864:12345-192.168.201.39@tcp:35:bash.0 00000100:00100000:0.0:1788869440.860320:0:5758:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c702349500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2125b9b3-626e-4cbe-be83-fb446e976ce2+13:10221:x1875765413044864:12345-192.168.201.39@tcp:35:bash.0 Request processed in 365us (1951us total) trans 4294967312 rc 0/0 00000100:00100000:0.0:1788869440.860336:0:5758:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 6 00000100:00100000:1.0:1788869440.899765:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1788869440.899862:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765413045120 00000100:00100000:3.0:1788869440.899872:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765413045120 00000100:00100000:3.0:1788869440.899937:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 40 00000100:00100000:3.0:1788869440.899947:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c70234b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2125b9b3-626e-4cbe-be83-fb446e976ce2+13:10231:x1875765413045120:12345-192.168.201.39@tcp:101:lfs.0 00010000:00010000:3.0:1788869440.899970:0:5786:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788869440.899988:0:5786:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504d800/0x3d2d1916761d675a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x375c01024903587f expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788869440.900100:0:5786:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00010000:00010000:3.0:1788869440.900198:0:5786:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504d800/0x3d2d1916761d675a lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0x375c01024903587f expref: 15 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869440.900209:0:5786:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff94c819394300) 00010000:00010000:3.0:1788869440.900211:0:5786:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788869440.900214:0:5786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504d800/0x3d2d1916761d675a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.39@tcp remote: 0x375c01024903587f expref: 15 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869440.900223:0:5786:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94c83504d800, rc 0) 00000100:00100000:3.0:1788869440.900346:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c70234b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2125b9b3-626e-4cbe-be83-fb446e976ce2+14:10231:x1875765413045120:12345-192.168.201.39@tcp:101:lfs.0 Request processed in 401us (589us total) trans 4294967313 rc 301/301 00000100:00100000:3.0:1788869440.900351:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 40 00000100:00100000:2.0:1788869440.901844:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1788869440.901899:0:5759:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765413045376 00000100:00100000:0.0:1788869440.901906:0:5759:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765413045376 00000100:00100000:0.0:1788869440.901949:0:5759:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 7 00000100:00100000:0.0:1788869440.901960:0:5759:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c810e6ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2125b9b3-626e-4cbe-be83-fb446e976ce2+14:10231:x1875765413045376:12345-192.168.201.39@tcp:35:lfs.0 00000100:00100000:0.0:1788869440.902179:0:5759:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c810e6ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2125b9b3-626e-4cbe-be83-fb446e976ce2+15:10231:x1875765413045376:12345-192.168.201.39@tcp:35:lfs.0 Request processed in 221us (335us total) trans 4294967314 rc 0/0 00000100:00100000:0.0:1788869440.902185:0:5759:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 7 00010000:00010000:0.0:1788869440.926189:0:5742:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788869440.941308:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1788869440.941379:0:5757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765413045504 00000100:00100000:3.0:1788869440.941390:0:5757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765413045504 00000100:00100000:3.0:1788869440.941452:0:5757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 41 00000100:00100000:3.0:1788869440.941462:0:5757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c810e68380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2125b9b3-626e-4cbe-be83-fb446e976ce2+15:10237:x1875765413045504:12345-192.168.201.39@tcp:101:lfs.0 00010000:00010000:3.0:1788869440.941485:0:5757:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788869440.941506:0:5757:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504d800/0x3d2d1916761d6768 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x375c010249035886 expref: -99 pid: 5757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869440.941579:0:5757:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504ce00/0x3d2d1916761d676f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869440.941591:0:5757:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504ce00/0x3d2d1916761d676f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869440.941602:0:5757:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504ce00/0x3d2d1916761d676f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5757 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788869440.941665:0:5757:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00000004:00200000:3.0:1788869440.941669:0:5757:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:3.0:1788869440.941689:0:5757:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504ce00/0x3d2d1916761d676f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869440.941713:0:5757:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504d800/0x3d2d1916761d6768 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0x375c010249035886 expref: 17 pid: 5757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869440.941731:0:5757:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504ce00/0x3d2d1916761d676f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0x375c010249035886 expref: 16 pid: 5757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869440.941737:0:5757:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff94c81a585400) 00010000:00010000:3.0:1788869440.941739:0:5757:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788869440.941741:0:5757:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94c83504ce00, rc 0) 00000100:00100000:3.0:1788869440.941829:0:5757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c810e68380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2125b9b3-626e-4cbe-be83-fb446e976ce2+16:10237:x1875765413045504:12345-192.168.201.39@tcp:101:lfs.0 Request processed in 369us (544us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869440.941834:0:5757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 41 00000100:00100000:1.0:1788869440.944559:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1788869440.944848:0:5756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765413045760 00000100:00100000:2.0:1788869440.944858:0:5756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765413045760 00000100:00100000:2.0:1788869440.944961:0:5756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 42 00000100:00100000:2.0:1788869440.944972:0:5756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c810730e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2125b9b3-626e-4cbe-be83-fb446e976ce2+16:10237:x1875765413045760:12345-192.168.201.39@tcp:101:lfs.0 00010000:00010000:2.0:1788869440.944992:0:5756:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788869440.945013:0:5756:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94c805039800/0x3d2d1916761d6776 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x375c01024903588d expref: -99 pid: 5756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869440.945147:0:5756:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94c805038000/0x3d2d1916761d677d lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869440.945163:0:5756:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504c000/0x3d2d1916761d6737 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0x375c01024903586a expref: 17 pid: 5757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869440.945173:0:5756:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff94c805038000/0x3d2d1916761d677d lrc: 4/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869440.945206:0:5756:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504c000/0x3d2d1916761d6737 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.39@tcp remote: 0x375c01024903586a expref: 17 pid: 5757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869440.945219:0:5756:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504c000/0x3d2d1916761d6737 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.39@tcp remote: 0x375c01024903586a expref: 17 pid: 5757 timeout: 289 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788869440.945232:0:5756:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94c810e68000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5756:1875765421459200:192.168.201.39@tcp:104: 00000100:00100000:2.0:1788869440.945341:0:5756:0:(client.c:2702:ptlrpc_set_wait()) set ffff94c83c6f6900 going to sleep for 11 seconds 00000100:00100000:1.0:1788869440.949283:0:5756:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94c810e68000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5756:1875765421459200:192.168.201.39@tcp:104: 00010000:00010000:1.0:1788869440.949314:0:5756:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff94c805038000/0x3d2d1916761d677d lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788869440.950290:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1788869440.950357:0:5740:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765413045888 00000100:00100000:2.0:1788869440.950363:0:5740:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765413045888 00010000:00010000:2.0:1788869440.950391:0:5740:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504c000/0x3d2d1916761d6737 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.39@tcp remote: 0x375c01024903586a expref: 18 pid: 5757 timeout: 289 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788869440.950418:0:5740:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 36 00000100:00100000:2.0:1788869440.950424:0:5740:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c810731f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2125b9b3-626e-4cbe-be83-fb446e976ce2+18:2347:x1875765413045888:12345-192.168.201.39@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788869440.950435:0:5740:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788869440.950439:0:5740:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504c000/0x3d2d1916761d6737 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.39@tcp remote: 0x375c01024903586a expref: 18 pid: 5757 timeout: 289 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869440.950458:0:5740:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504c000/0x3d2d1916761d6737 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.39@tcp remote: 0x375c01024903586a expref: 18 pid: 5757 timeout: 289 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869440.950474:0:5740:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504c000/0x3d2d1916761d6737 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.39@tcp remote: 0x375c01024903586a expref: 18 pid: 5757 timeout: 289 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869440.950485:0:5740:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff94c819394e00) 00010000:00010000:2.0:1788869440.950488:0:5740:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff94c805038000/0x3d2d1916761d677d lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869440.950494:0:5740:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff94c805038000/0x3d2d1916761d677d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869440.950499:0:5740:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94c805038000/0x3d2d1916761d677d lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869440.950515:0:5740:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788869440.950606:0:5740:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c810731f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2125b9b3-626e-4cbe-be83-fb446e976ce2+17:2347:x1875765413045888:12345-192.168.201.39@tcp:103:ldlm_bl.0 Request processed in 182us (319us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869440.950611:0:5740:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 36 00010000:00010000:3.0:1788869440.950686:0:5756:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff94c805038000/0x3d2d1916761d677d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869440.950698:0:5756:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94c805038000/0x3d2d1916761d677d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788869440.950715:0:5756:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:3.0:1788869440.950853:0:5756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94c805039800/0x3d2d1916761d6776 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0x375c01024903588d expref: 18 pid: 5756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869440.950868:0:5756:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94c805038000/0x3d2d1916761d677d lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0x375c01024903588d expref: 17 pid: 5756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869440.950875:0:5756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff94c819394e00) 00010000:00010000:3.0:1788869440.950878:0:5756:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1788869440.950880:0:5756:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94c805038000, rc 0) 00000100:00100000:3.0:1788869440.950902:0:5756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c810730e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2125b9b3-626e-4cbe-be83-fb446e976ce2+17:10237:x1875765413045760:12345-192.168.201.39@tcp:101:lfs.0 Request processed in 5934us (6351us total) trans 4294967315 rc 0/0 00000100:00100000:3.0:1788869440.950909:0:5756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 42 00000100:00100000:2.0:1788869440.955739:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1788869440.956062:0:5755:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765413046144 00000100:00100000:0.0:1788869440.956072:0:5755:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765413046144 00000100:00100000:0.0:1788869440.956139:0:5755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 43 00000100:00100000:0.0:1788869440.956151:0:5755:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c810e68000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2125b9b3-626e-4cbe-be83-fb446e976ce2+17:10237:x1875765413046144:12345-192.168.201.39@tcp:101:lfs.0 00010000:00010000:0.0:1788869440.956176:0:5755:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788869440.956180:0:5755:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1788869440.956205:0:5755:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94c805038000/0x3d2d1916761d677d lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.39@tcp remote: 0x375c01024903588d expref: 17 pid: 5756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869440.956230:0:5755:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff94c819394e00) 00010000:00010000:0.0:1788869440.956239:0:5755:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788869440.956289:0:5755:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94c81a583e00/0x3d2d1916761d678b lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x375c010249035894 expref: -99 pid: 5755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869440.956380:0:5755:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94c81a582a00/0x3d2d1916761d6792 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869440.956392:0:5755:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94c81a582a00/0x3d2d1916761d6792 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869440.956415:0:5755:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94c81a582a00/0x3d2d1916761d6792 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788869440.956426:0:5755:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:0.0:1788869440.956549:0:5755:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94c81a583e00/0x3d2d1916761d678b lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0x375c010249035894 expref: 19 pid: 5755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869440.956564:0:5755:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94c81a582a00/0x3d2d1916761d6792 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0x375c010249035894 expref: 18 pid: 5755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869440.956572:0:5755:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff94c803990d00) 00010000:00010000:0.0:1788869440.956583:0:5755:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1788869440.956586:0:5755:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94c81a582a00, rc 0) 00000100:00100000:0.0:1788869440.956632:0:5755:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c810e68000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2125b9b3-626e-4cbe-be83-fb446e976ce2+18:10237:x1875765413046144:12345-192.168.201.39@tcp:101:lfs.0 Request processed in 485us (903us total) trans 4294967316 rc 0/0 00000100:00100000:0.0:1788869440.956637:0:5755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 43 00000100:00100000:0.0:1788869440.961522:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1788869440.961570:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765413046272 00000100:00100000:3.0:1788869440.961581:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765413046272 00000100:00100000:3.0:1788869440.961642:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 44 00000100:00100000:3.0:1788869440.961661:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c83c6f0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2125b9b3-626e-4cbe-be83-fb446e976ce2+18:10237:x1875765413046272:12345-192.168.201.39@tcp:101:lfs.0 00010000:00010000:3.0:1788869440.961737:0:5786:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788869440.961758:0:5786:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504d800/0x3d2d1916761d67a0 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x375c01024903589b expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869440.961836:0:5786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504d800/0x3d2d1916761d67a0 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.39@tcp remote: 0x375c01024903589b expref: 19 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869440.961863:0:5786:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504d800/0x3d2d1916761d67a0 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.39@tcp remote: 0x375c01024903589b expref: 19 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869440.961880:0:5786:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff94c803990d00) 00010000:00010000:3.0:1788869440.961882:0:5786:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788869440.961886:0:5786:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94c83504d800, rc 0) 00000100:00100000:3.0:1788869440.961944:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c83c6f0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2125b9b3-626e-4cbe-be83-fb446e976ce2+19:10237:x1875765413046272:12345-192.168.201.39@tcp:101:lfs.0 Request processed in 287us (427us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869440.961949:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 44 00000100:00100000:1.0:1788869440.966355:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1788869440.966422:0:6547:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765413046400 00000100:00100000:3.0:1788869440.966432:0:6547:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765413046400 00000100:00100000:3.0:1788869440.966487:0:6547:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 23 00000100:00100000:3.0:1788869440.966496:0:6547:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c810732680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2125b9b3-626e-4cbe-be83-fb446e976ce2+7:2347:x1875765413046400:12345-192.168.201.39@tcp:1:lfs.0 00010000:00010000:3.0:1788869440.966534:0:6547:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001f200784/0x3d2d1916761d67a7 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869440.966554:0:6547:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000a1bb1fc7/0x3d2d1916761d6753 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.39@tcp remote: 0x375c010249035878 expref: 7 pid: 6546 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869440.966563:0:6547:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788869440.966568:0:6547:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788869440.966573:0:6547:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001f200784/0x3d2d1916761d67a7 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869440.966619:0:6547:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000a1bb1fc7/0x3d2d1916761d6753 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.201.39@tcp remote: 0x375c010249035878 expref: 7 pid: 6546 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869440.966647:0:6547:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000a1bb1fc7/0x3d2d1916761d6753 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.201.39@tcp remote: 0x375c010249035878 expref: 7 pid: 6546 timeout: 289 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788869440.966662:0:6547:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94c83f9abb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6547:1875765421459328:192.168.201.39@tcp:104: 00000100:00100000:3.0:1788869440.966741:0:6547:0:(client.c:2702:ptlrpc_set_wait()) set ffff94c807dffb40 going to sleep for 11 seconds 00000100:00100000:3.0:1788869440.968719:0:6547:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94c83f9abb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6547:1875765421459328:192.168.201.39@tcp:104: 00010000:00010000:3.0:1788869440.968747:0:6547:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000001f200784/0x3d2d1916761d67a7 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788869440.970018:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1788869440.970094:0:6550:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765413046528 00000100:00100000:2.0:1788869440.970102:0:6550:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765413046528 00002000:00100000:2.0:1788869440.970147:0:6550:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x2:0x0] (0->12) req@ffff94c810732a00 x1875765413046528/t0(0) o4->2125b9b3-626e-4cbe-be83-fb446e976ce2@192.168.201.39@tcp:386/0 lens 504/0 e 0 to 0 dl 1788869451 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788869440.970158:0:6550:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff94c810732a00 with x1875765413046528 ext(0->12) 00010000:00010000:2.0:1788869440.970166:0:6550:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000a1bb1fc7/0x3d2d1916761d6753 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.39@tcp remote: 0x375c010249035878 expref: 8 pid: 6546 timeout: 289 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869440.970191:0:6550:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000a1bb1fc7/0x3d2d1916761d6753 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.39@tcp remote: 0x375c010249035878 expref: 8 pid: 6546 timeout: 289 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788869440.970198:0:6550:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff94c810732a00 00000100:00100000:2.0:1788869440.970332:0:6550:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 0 00000100:00100000:2.0:1788869440.970341:0:6550:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c810732a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:2125b9b3-626e-4cbe-be83-fb446e976ce2+8:2348:x1875765413046528:12345-192.168.201.39@tcp:4:lfs.0 00000001:00100000:0.0:1788869440.984764:0:6571:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 2125b9b3-626e-4cbe-be83-fb446e976ce2 00000100:00100000:1.0:1788869440.985284:0:6550:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c810732a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:2125b9b3-626e-4cbe-be83-fb446e976ce2+9:2348:x1875765413046528:12345-192.168.201.39@tcp:4:lfs.0 Request processed in 14939us (15267us total) trans 4294967299 rc 0/0 00000100:00100000:1.0:1788869440.985298:0:6550:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 0 00002000:00100000:1.0:1788869440.985308:0:6550:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x2:0x0] (0->12) req@ffff94c810732a00 x1875765413046528/t4294967299(0) o4->2125b9b3-626e-4cbe-be83-fb446e976ce2@192.168.201.39@tcp:386/0 lens 504/448 e 0 to 0 dl 1788869451 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788869440.985317:0:6550:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff94c810732a00 with x1875765413046528 ext(0->12) 00010000:00010000:1.0:1788869440.985327:0:6550:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000a1bb1fc7/0x3d2d1916761d6753 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.39@tcp remote: 0x375c010249035878 expref: 9 pid: 6546 timeout: 289 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869440.985344:0:6550:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000a1bb1fc7/0x3d2d1916761d6753 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.39@tcp remote: 0x375c010249035878 expref: 9 pid: 6546 timeout: 289 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788869440.985352:0:6550:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff94c810732a00 00000100:00100000:2.0:1788869440.988319:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1788869440.988374:0:5739:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765413046656 00000100:00100000:0.0:1788869440.988381:0:5739:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765413046656 00010000:00010000:0.0:1788869440.988412:0:5739:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000a1bb1fc7/0x3d2d1916761d6753 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.39@tcp remote: 0x375c010249035878 expref: 9 pid: 6546 timeout: 289 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788869440.988446:0:5739:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 37 00000100:00100000:0.0:1788869440.988453:0:5739:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c83fbb0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2125b9b3-626e-4cbe-be83-fb446e976ce2+9:2347:x1875765413046656:12345-192.168.201.39@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788869440.988467:0:5739:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:0.0:1788869440.988495:0:5739:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x2:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:0.0:1788869440.988499:0:5739:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x2:0x0] updating lvb mtime from disk: 0 -> 1788869439 00002000:00010000:0.0:1788869440.988501:0:5739:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x2:0x0] updating lvb atime from disk: 0 -> 1788869439 00002000:00010000:0.0:1788869440.988503:0:5739:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x2:0x0] updating lvb ctime from disk: 0 -> 1788869439 00010000:00010000:0.0:1788869440.988509:0:5739:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000a1bb1fc7/0x3d2d1916761d6753 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.39@tcp remote: 0x375c010249035878 expref: 9 pid: 6546 timeout: 289 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869440.988524:0:5739:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000a1bb1fc7/0x3d2d1916761d6753 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.201.39@tcp remote: 0x375c010249035878 expref: 9 pid: 6546 timeout: 289 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869440.988547:0:5739:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a1bb1fc7/0x3d2d1916761d6753 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.201.39@tcp remote: 0x375c010249035878 expref: 9 pid: 6546 timeout: 289 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869440.988563:0:5739:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788869440.988568:0:5739:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788869440.988573:0:5739:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000001f200784/0x3d2d1916761d67a7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869440.988584:0:5739:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001f200784/0x3d2d1916761d67a7 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869440.988611:0:5739:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788869440.988645:0:6547:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000001f200784/0x3d2d1916761d67a7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869440.988658:0:6547:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001f200784/0x3d2d1916761d67a7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788869440.988679:0:5739:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c83fbb0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2125b9b3-626e-4cbe-be83-fb446e976ce2+8:2347:x1875765413046656:12345-192.168.201.39@tcp:103:ldlm_bl.0 Request processed in 219us (364us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869440.988688:0:5739:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 37 00010000:00010000:3.0:1788869440.988692:0:6547:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001f200784/0x3d2d1916761d67a7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869440.988702:0:6547:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001f200784/0x3d2d1916761d67a7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869440.988710:0:6547:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001f200784/0x3d2d1916761d67a7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869440.988728:0:6547:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94c83504c600 already unused, calling callback (ffffffffc1703220) 00010000:00010000:3.0:1788869440.988732:0:6547:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001f200784/0x3d2d1916761d67a7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869440.988742:0:6547:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001f200784/0x3d2d1916761d67a7 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869440.988754:0:6547:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001f200784/0x3d2d1916761d67a7 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869440.988763:0:6547:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001f200784/0x3d2d1916761d67a7 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788869440.988824:0:6547:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c810732680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2125b9b3-626e-4cbe-be83-fb446e976ce2+7:2347:x1875765413046400:12345-192.168.201.39@tcp:1:lfs.0 Request processed in 22328us (22477us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869440.988832:0:6547:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 23 00000100:00100000:0.0:1788869440.990097:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1788869440.990172:0:5758:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765413046912 00000100:00100000:1.0:1788869440.990179:0:5758:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765413046912 00000100:00100000:1.0:1788869440.990244:0:5758:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 8 00000100:00100000:1.0:1788869440.990277:0:5758:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c83c6f1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2125b9b3-626e-4cbe-be83-fb446e976ce2+19:10237:x1875765413046912:12345-192.168.201.39@tcp:35:lfs.0 00000004:00010000:1.0:1788869440.990336:0:5758:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0x4:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff94c81a582a00/0x3d2d1916761d6792 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0x375c010249035894 expref: 19 pid: 5755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788869440.990594:0:5758:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967317 00000001:00080000:1.0:1788869440.990641:0:5758:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967318 00000001:00080000:1.0:1788869440.991210:0:5758:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967319 00010000:00010000:1.0:1788869440.991281:0:5758:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94c8421f3400/0x3d2d1916761d67ae lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869440.991296:0:5758:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504d800/0x3d2d1916761d67a0 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.39@tcp remote: 0x375c01024903589b expref: 23 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869440.991305:0:5758:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff94c8421f3400/0x3d2d1916761d67ae lrc: 4/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869440.991334:0:5758:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504d800/0x3d2d1916761d67a0 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.201.39@tcp remote: 0x375c01024903589b expref: 23 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869440.991347:0:5758:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504d800/0x3d2d1916761d67a0 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.201.39@tcp remote: 0x375c01024903589b expref: 23 pid: 5786 timeout: 289 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788869440.991361:0:5758:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94c810730a80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5758:1875765421459456:192.168.201.39@tcp:104: 00000100:00100000:1.0:1788869440.991432:0:5758:0:(client.c:2702:ptlrpc_set_wait()) set ffff94c803146c00 going to sleep for 11 seconds 00000100:00100000:1.0:1788869440.993669:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1788869440.993676:0:5758:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94c810730a80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5758:1875765421459456:192.168.201.39@tcp:104: 00010000:00010000:0.0:1788869440.993710:0:5758:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff94c8421f3400/0x3d2d1916761d67ae lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5758 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788869440.993773:0:5741:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765413047040 00000100:00100000:3.0:1788869440.993800:0:5741:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765413047040 00010000:00010000:3.0:1788869440.993853:0:5741:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504d800/0x3d2d1916761d67a0 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.39@tcp remote: 0x375c01024903589b expref: 24 pid: 5786 timeout: 289 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788869440.993971:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 38 00000100:00100000:1.0:1788869440.993995:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c810733800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2125b9b3-626e-4cbe-be83-fb446e976ce2+24:2347:x1875765413047040:12345-192.168.201.39@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788869440.994021:0:5788:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788869440.994030:0:5788:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504d800/0x3d2d1916761d67a0 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.39@tcp remote: 0x375c01024903589b expref: 24 pid: 5786 timeout: 289 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869440.994043:0:5788:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504d800/0x3d2d1916761d67a0 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.201.39@tcp remote: 0x375c01024903589b expref: 24 pid: 5786 timeout: 289 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869440.994065:0:5788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504d800/0x3d2d1916761d67a0 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.201.39@tcp remote: 0x375c01024903589b expref: 24 pid: 5786 timeout: 289 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869440.994078:0:5788:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff94c803990d00) 00010000:00010000:1.0:1788869440.994082:0:5788:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff94c8421f3400/0x3d2d1916761d67ae lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869440.994090:0:5788:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff94c8421f3400/0x3d2d1916761d67ae lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869440.994096:0:5788:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94c8421f3400/0x3d2d1916761d67ae lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869440.994124:0:5788:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788869440.994173:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c810733800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2125b9b3-626e-4cbe-be83-fb446e976ce2+23:2347:x1875765413047040:12345-192.168.201.39@tcp:103:ldlm_bl.0 Request processed in 186us (510us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869440.994181:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 38 00010000:00010000:0.0:1788869440.994262:0:5758:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff94c8421f3400/0x3d2d1916761d67ae lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869440.994270:0:5758:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94c8421f3400/0x3d2d1916761d67ae lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5758 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788869440.994381:0:5758:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967320 00000001:00080000:0.0:1788869440.994528:0:5758:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967321 00000100:00100000:0.0:1788869440.994620:0:5758:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94c83c6f1f80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5758:1875765421459584:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1788869440.994705:0:5758:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869440.994730:0:5758:0:(client.c:2702:ptlrpc_set_wait()) set ffff94c83fd69900 going to sleep for 11 seconds 00000100:00100000:2.0:1788869440.994752:0:5760:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765421459584 00000100:00100000:2.0:1788869440.994761:0:5760:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765421459584 00000100:00100000:2.0:1788869440.994839:0:5760:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788869440.994847:0:5760:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c83c6f0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5758:x1875765421459584:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1788869440.994929:0:5760:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c83c6f0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5758:x1875765421459584:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 83us (223us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869440.994936:0:5760:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788869440.995000:0:5758:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94c83c6f1f80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5758:1875765421459584:0@lo:1000:mdt_rdpg00_000.0 00000100:00080000:0.0:1788869440.995136:0:5751:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00080000:1.0:1788869440.995690:0:5758:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967322 00000100:00100000:1.0:1788869440.995738:0:5758:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94c810732300 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5758:1875765421459712:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1788869440.995768:0:5758:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869440.995803:0:5758:0:(client.c:2702:ptlrpc_set_wait()) set ffff94c803146c00 going to sleep for 11 seconds 00000100:00100000:2.0:1788869440.995820:0:5761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765421459712 00000100:00100000:2.0:1788869440.995825:0:5761:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765421459712 00000100:00100000:2.0:1788869440.995861:0:5761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788869440.995870:0:5761:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c810731880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5758:x1875765421459712:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1788869440.996046:0:5761:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c810731880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5758:x1875765421459712:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 177us (275us total) trans 4294967300 rc 0/0 00000100:00100000:2.0:1788869440.996055:0:5761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788869440.996080:0:5758:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94c810732300 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5758:1875765421459712:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:0.0:1788869440.996124:0:5758:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967323 00010000:00010000:0.0:1788869440.996171:0:5758:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94c8421f3400/0x3d2d1916761d67ae lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869440.996181:0:5758:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94c8421f3400/0x3d2d1916761d67ae lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869440.996187:0:5758:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94c8421f3400/0x3d2d1916761d67ae lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869440.996193:0:5758:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94c8421f3400 already unused, calling callback (ffffffffc21124f0) 00010000:00010000:0.0:1788869440.996197:0:5758:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94c8421f3400/0x3d2d1916761d67ae lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869440.996205:0:5758:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94c8421f3400/0x3d2d1916761d67ae lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869440.996223:0:5758:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff94c803990d00) 00010000:00010000:0.0:1788869440.996226:0:5758:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:0.0:1788869440.996230:0:5758:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94c8421f3400/0x3d2d1916761d67ae lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869440.996236:0:5758:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94c8421f3400/0x3d2d1916761d67ae lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5758 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1788869440.996432:0:5758:0:(mdd_object.c:4016:mdd_close()) Object [0x200000401:0x5:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:0.0:1788869440.996605:0:5758:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].2, 64 off8320 00000004:00080000:0.0:1788869440.996616:0:5758:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 189288364914ns, next at 190288362561ns, rc = 0 00000001:00080000:0.0:1788869440.996622:0:5758:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967324 00010000:00010000:0.0:1788869440.996651:0:5758:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff94c803990d00) 00010000:00010000:0.0:1788869440.996654:0:5758:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1788869440.996661:0:5758:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94c81a582a00/0x3d2d1916761d6792 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.39@tcp remote: 0x375c010249035894 expref: 27 pid: 5755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788869440.996885:0:5758:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c83c6f1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2125b9b3-626e-4cbe-be83-fb446e976ce2+26:10237:x1875765413046912:12345-192.168.201.39@tcp:35:lfs.0 Request processed in 6611us (6791us total) trans 4294967325 rc 0/0 00000100:00100000:0.0:1788869440.996894:0:5758:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 8 00000020:00080000:0.0:1788869440.996898:0:5758:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:1.0:1788869440.998197:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1788869440.998324:0:5757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765413047168 00000100:00100000:3.0:1788869440.998334:0:5757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765413047168 00000100:00100000:3.0:1788869440.998379:0:5757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 45 00000100:00100000:3.0:1788869440.998386:0:5757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c810733b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2125b9b3-626e-4cbe-be83-fb446e976ce2+26:10237:x1875765413047168:12345-192.168.201.39@tcp:101:lfs.0 00010000:00010000:3.0:1788869440.998423:0:5757:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788869440.998447:0:5757:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504c800/0x3d2d1916761d67b5 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x375c0102490358a2 expref: -99 pid: 5757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869440.998503:0:5757:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504c800/0x3d2d1916761d67b5 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.39@tcp remote: 0x375c0102490358a2 expref: 27 pid: 5757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869440.998514:0:5757:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504c800/0x3d2d1916761d67b5 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.39@tcp remote: 0x375c0102490358a2 expref: 27 pid: 5757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869440.998528:0:5757:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff94c819394000) 00010000:00010000:3.0:1788869440.998531:0:5757:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788869440.998534:0:5757:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94c83504c800, rc 0) 00000100:00100000:3.0:1788869440.998591:0:5757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c810733b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2125b9b3-626e-4cbe-be83-fb446e976ce2+27:10237:x1875765413047168:12345-192.168.201.39@tcp:101:lfs.0 Request processed in 206us (405us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869440.998596:0:5757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 45 00000100:00100000:2.0:1788869441.003186:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1788869441.003247:0:5759:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765413047424 00000100:00100000:0.0:1788869441.003307:0:5759:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765413047424 00000100:00100000:0.0:1788869441.003408:0:5759:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 9 00000100:00100000:0.0:1788869441.003433:0:5759:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c818768050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2125b9b3-626e-4cbe-be83-fb446e976ce2+27:10237:x1875765413047424:12345-192.168.201.39@tcp:35:lfs.0 00000100:00080000:3.0:1788869441.003438:0:5751:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788869441.003679:0:5759:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c818768050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2125b9b3-626e-4cbe-be83-fb446e976ce2+28:10237:x1875765413047424:12345-192.168.201.39@tcp:35:lfs.0 Request processed in 259us (516us total) trans 4294967326 rc 0/0 00000100:00100000:0.0:1788869441.003704:0:5759:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 9 00000100:00100000:2.0:1788869441.048821:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1788869441.048899:0:5756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765413047680 00000100:00100000:1.0:1788869441.048912:0:5756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765413047680 00000100:00100000:1.0:1788869441.048989:0:5756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 46 00000100:00100000:1.0:1788869441.048999:0:5756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c82cdc7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2125b9b3-626e-4cbe-be83-fb446e976ce2+28:10247:x1875765413047680:12345-192.168.201.39@tcp:101:lfs.0 00010000:00010000:1.0:1788869441.049030:0:5756:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788869441.049062:0:5756:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94c8421f3c00/0x3d2d1916761d67bc lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x375c0102490358a9 expref: -99 pid: 5756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788869441.049216:0:5756:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00010000:00010000:1.0:1788869441.049377:0:5756:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94c8421f3c00/0x3d2d1916761d67bc lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0x375c0102490358a9 expref: 30 pid: 5756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869441.049391:0:5756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff94c819394300) 00010000:00010000:1.0:1788869441.049394:0:5756:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788869441.049398:0:5756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94c8421f3c00/0x3d2d1916761d67bc lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.39@tcp remote: 0x375c0102490358a9 expref: 30 pid: 5756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869441.049411:0:5756:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94c8421f3c00, rc 0) 00000100:00100000:1.0:1788869441.049467:0:5756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c82cdc7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2125b9b3-626e-4cbe-be83-fb446e976ce2+29:10247:x1875765413047680:12345-192.168.201.39@tcp:101:lfs.0 Request processed in 471us (690us total) trans 4294967327 rc 301/301 00000100:00100000:1.0:1788869441.049483:0:5756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 46 00000100:00100000:1.0:1788869441.054309:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1788869441.054383:0:5755:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765413047808 00000100:00100000:0.0:1788869441.054395:0:5755:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765413047808 00000100:00100000:0.0:1788869441.054464:0:5755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 47 00000100:00100000:0.0:1788869441.054477:0:5755:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c810730380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2125b9b3-626e-4cbe-be83-fb446e976ce2+29:10247:x1875765413047808:12345-192.168.201.39@tcp:34:lfs.0 00010000:00010000:0.0:1788869441.054549:0:5755:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff94c81a582a00/0x3d2d1916761d67ca lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869441.054565:0:5755:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94c81a582a00/0x3d2d1916761d67ca lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869441.054575:0:5755:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94c81a582a00/0x3d2d1916761d67ca lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869441.054586:0:5755:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94c81a583000/0x3d2d1916761d67d1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869441.054590:0:5755:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94c81a583000/0x3d2d1916761d67d1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869441.054594:0:5755:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94c81a583000/0x3d2d1916761d67d1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869441.054666:0:5755:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94c81a583400/0x3d2d1916761d67d8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869441.054671:0:5755:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94c81a583400/0x3d2d1916761d67d8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869441.054675:0:5755:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94c81a583400/0x3d2d1916761d67d8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788869441.054739:0:5755:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff94c81a583400/0x3d2d1916761d67d8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869441.054749:0:5755:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff94c81a582a00/0x3d2d1916761d67ca lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869441.054753:0:5755:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94c81a582a00/0x3d2d1916761d67ca lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869441.054758:0:5755:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94c81a582a00/0x3d2d1916761d67ca lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869441.054761:0:5755:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94c81a582a00 already unused, calling callback (ffffffffc21124f0) 00010000:00010000:0.0:1788869441.054764:0:5755:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94c81a582a00/0x3d2d1916761d67ca lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869441.054768:0:5755:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94c81a582a00/0x3d2d1916761d67ca lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869441.054776:0:5755:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff94c81a585400) 00010000:00010000:0.0:1788869441.054778:0:5755:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788869441.054781:0:5755:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94c81a582a00/0x3d2d1916761d67ca lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869441.054798:0:5755:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94c81a582a00/0x3d2d1916761d67ca lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869441.054808:0:5755:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94c81a583000/0x3d2d1916761d67d1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869441.054812:0:5755:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94c81a583000/0x3d2d1916761d67d1 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869441.054820:0:5755:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94c81a583000/0x3d2d1916761d67d1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869441.054824:0:5755:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94c81a583000 already unused, calling callback (ffffffffc21124f0) 00010000:00010000:0.0:1788869441.054827:0:5755:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94c81a583000/0x3d2d1916761d67d1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869441.054833:0:5755:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94c81a583000/0x3d2d1916761d67d1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869441.054841:0:5755:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff94c803990d00) 00010000:00010000:0.0:1788869441.054844:0:5755:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788869441.054846:0:5755:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94c81a583000/0x3d2d1916761d67d1 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869441.054852:0:5755:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94c81a583000/0x3d2d1916761d67d1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869441.054866:0:5755:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94c81a583400/0x3d2d1916761d67d8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869441.054872:0:5755:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94c81a583400/0x3d2d1916761d67d8 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869441.054878:0:5755:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94c81a583400/0x3d2d1916761d67d8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869441.054884:0:5755:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94c81a583400 already unused, calling callback (ffffffffc21124f0) 00010000:00010000:0.0:1788869441.054886:0:5755:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94c81a583400/0x3d2d1916761d67d8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869441.054898:0:5755:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94c81a583400/0x3d2d1916761d67d8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869441.054904:0:5755:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff94c819394000) 00010000:00010000:0.0:1788869441.054905:0:5755:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788869441.054907:0:5755:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94c81a583400/0x3d2d1916761d67d8 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869441.054911:0:5755:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94c81a583400/0x3d2d1916761d67d8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788869441.054989:0:5755:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c810730380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2125b9b3-626e-4cbe-be83-fb446e976ce2+29:10247:x1875765413047808:12345-192.168.201.39@tcp:34:lfs.0 Request processed in 515us (747us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869441.054996:0:5755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 47 00000100:00100000:2.0:1788869441.058655:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1788869441.058807:0:5758:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765413048064 00000100:00100000:1.0:1788869441.058818:0:5758:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765413048064 00000100:00100000:1.0:1788869441.058874:0:5758:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 10 00000100:00100000:1.0:1788869441.058884:0:5758:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c82cdc4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2125b9b3-626e-4cbe-be83-fb446e976ce2+29:10247:x1875765413048064:12345-192.168.201.39@tcp:35:lfs.0 00000100:00100000:1.0:1788869441.059108:0:5758:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c82cdc4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2125b9b3-626e-4cbe-be83-fb446e976ce2+30:10247:x1875765413048064:12345-192.168.201.39@tcp:35:lfs.0 Request processed in 225us (461us total) trans 4294967328 rc 0/0 00000100:00100000:1.0:1788869441.059115:0:5758:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 10 00000100:00100000:2.0:1788869441.083843:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1788869441.083960:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765413048320 00000100:00100000:3.0:1788869441.083970:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765413048320 00000100:00100000:3.0:1788869441.084034:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 48 00000100:00100000:3.0:1788869441.084046:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c82cdc5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2125b9b3-626e-4cbe-be83-fb446e976ce2+30:10250:x1875765413048320:12345-192.168.201.39@tcp:101:lfs.0 00010000:00010000:3.0:1788869441.084070:0:5786:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788869441.084092:0:5786:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504c600/0x3d2d1916761d67df lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x375c0102490358b0 expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869441.084166:0:5786:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504ca00/0x3d2d1916761d67e6 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869441.084195:0:5786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504ca00/0x3d2d1916761d67e6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869441.084205:0:5786:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504ca00/0x3d2d1916761d67e6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869441.084218:0:5786:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504d400/0x3d2d1916761d67ed lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869441.084224:0:5786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504d400/0x3d2d1916761d67ed lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869441.084230:0:5786:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504d400/0x3d2d1916761d67ed lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869441.084413:0:5786:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504d600/0x3d2d1916761d67f4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869441.084422:0:5786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504d600/0x3d2d1916761d67f4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869441.084431:0:5786:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504d600/0x3d2d1916761d67f4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788869441.084441:0:5786:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:3.0:1788869441.084528:0:5786:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504ca00/0x3d2d1916761d67e6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869441.084536:0:5786:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504ca00/0x3d2d1916761d67e6 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869441.084542:0:5786:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504ca00/0x3d2d1916761d67e6 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869441.084553:0:5786:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94c83504ca00 already unused, calling callback (ffffffffc21124f0) 00010000:00010000:3.0:1788869441.084557:0:5786:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504ca00/0x3d2d1916761d67e6 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869441.084565:0:5786:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504ca00/0x3d2d1916761d67e6 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869441.084576:0:5786:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff94c81a585400) 00010000:00010000:3.0:1788869441.084579:0:5786:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788869441.084583:0:5786:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504ca00/0x3d2d1916761d67e6 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869441.084590:0:5786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504ca00/0x3d2d1916761d67e6 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869441.084603:0:5786:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504d400/0x3d2d1916761d67ed lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869441.084608:0:5786:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504d400/0x3d2d1916761d67ed lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869441.084614:0:5786:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504d400/0x3d2d1916761d67ed lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869441.084619:0:5786:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94c83504d400 already unused, calling callback (ffffffffc21124f0) 00010000:00010000:3.0:1788869441.084622:0:5786:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504d400/0x3d2d1916761d67ed lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869441.084628:0:5786:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504d400/0x3d2d1916761d67ed lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869441.084645:0:5786:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff94c819394100) 00010000:00010000:3.0:1788869441.084647:0:5786:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788869441.084650:0:5786:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504d400/0x3d2d1916761d67ed lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869441.084656:0:5786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504d400/0x3d2d1916761d67ed lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869441.084707:0:5786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504c600/0x3d2d1916761d67df lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0x375c0102490358b0 expref: 33 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869441.084721:0:5786:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504d600/0x3d2d1916761d67f4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0x375c0102490358b0 expref: 32 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869441.084728:0:5786:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff94c819394000) 00010000:00010000:3.0:1788869441.084730:0:5786:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788869441.084733:0:5786:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94c83504d600, rc 0) 00000100:00100000:3.0:1788869441.084805:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c82cdc5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2125b9b3-626e-4cbe-be83-fb446e976ce2+32:10250:x1875765413048320:12345-192.168.201.39@tcp:101:lfs.0 Request processed in 757us (968us total) trans 4294967329 rc 0/0 00000100:00100000:3.0:1788869441.084812:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 48 00000100:00100000:0.0:1788869441.090505:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1788869441.090563:0:5757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765413048448 00000100:00100000:3.0:1788869441.090573:0:5757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765413048448 00000100:00100000:3.0:1788869441.090640:0:5757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 49 00000100:00100000:3.0:1788869441.090651:0:5757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c83c6f1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2125b9b3-626e-4cbe-be83-fb446e976ce2+32:10250:x1875765413048448:12345-192.168.201.39@tcp:54:lfs.0 00010000:00010000:3.0:1788869441.090855:0:5757:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504c600/0x3d2d1916761d6802 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869441.090872:0:5757:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504c600/0x3d2d1916761d6802 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869441.090897:0:5757:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504c600/0x3d2d1916761d6802 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869441.090922:0:5757:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504c600/0x3d2d1916761d6802 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869441.090929:0:5757:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504c600/0x3d2d1916761d6802 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869441.090936:0:5757:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504c600/0x3d2d1916761d6802 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869441.090942:0:5757:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94c83504c600 already unused, calling callback (ffffffffc21124f0) 00010000:00010000:3.0:1788869441.090947:0:5757:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504c600/0x3d2d1916761d6802 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869441.090953:0:5757:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504c600/0x3d2d1916761d6802 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869441.090978:0:5757:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff94c819394000) 00010000:00010000:3.0:1788869441.090981:0:5757:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788869441.090985:0:5757:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504c600/0x3d2d1916761d6802 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869441.090992:0:5757:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504c600/0x3d2d1916761d6802 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5757 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788869441.091059:0:5757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c83c6f1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2125b9b3-626e-4cbe-be83-fb446e976ce2+32:10250:x1875765413048448:12345-192.168.201.39@tcp:54:lfs.0 Request processed in 410us (562us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869441.091067:0:5757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 49 00000100:00100000:2.0:1788869441.092848:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1788869441.092898:0:5759:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765413048704 00000100:00100000:0.0:1788869441.092906:0:5759:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765413048704 00000100:00100000:0.0:1788869441.092947:0:5759:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 11 00000100:00100000:0.0:1788869441.092953:0:5759:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c82cdc5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2125b9b3-626e-4cbe-be83-fb446e976ce2+32:10250:x1875765413048704:12345-192.168.201.39@tcp:35:lfs.0 00000100:00100000:0.0:1788869441.093130:0:5759:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c82cdc5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2125b9b3-626e-4cbe-be83-fb446e976ce2+33:10250:x1875765413048704:12345-192.168.201.39@tcp:35:lfs.0 Request processed in 175us (285us total) trans 4294967330 rc 0/0 00000100:00100000:0.0:1788869441.093138:0:5759:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 11 00000100:00100000:2.0:1788869441.228941:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1788869441.228996:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765413048960 00000100:00100000:3.0:1788869441.229018:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765413048960 00000100:00100000:3.0:1788869441.229077:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 50 00000100:00100000:3.0:1788869441.229084:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c82cdc6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2125b9b3-626e-4cbe-be83-fb446e976ce2+33:10281:x1875765413048960:12345-192.168.201.39@tcp:101:cat.0 00010000:00010000:3.0:1788869441.229104:0:5786:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788869441.229120:0:5786:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504c600/0x3d2d1916761d6809 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x375c0102490358b7 expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869441.229226:0:5786:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504d400/0x3d2d1916761d6810 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869441.229239:0:5786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504d400/0x3d2d1916761d6810 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869441.229294:0:5786:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504d400/0x3d2d1916761d6810 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788869441.229306:0:5786:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:3.0:1788869441.229436:0:5786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504c600/0x3d2d1916761d6809 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0x375c0102490358b7 expref: 36 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869441.229449:0:5786:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504d400/0x3d2d1916761d6810 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0x375c0102490358b7 expref: 35 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869441.229455:0:5786:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff94c819394000) 00010000:00010000:3.0:1788869441.229457:0:5786:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788869441.229459:0:5786:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94c83504d400, rc 0) 00000100:00100000:3.0:1788869441.229505:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c82cdc6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2125b9b3-626e-4cbe-be83-fb446e976ce2+35:10281:x1875765413048960:12345-192.168.201.39@tcp:101:cat.0 Request processed in 422us (575us total) trans 4294967331 rc 0/0 00000100:00100000:3.0:1788869441.229510:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 50 00000100:00100000:2.0:1788869441.232400:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1788869441.232445:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1788869441.232546:0:5740:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765413049088 00000100:00100000:1.0:1788869441.232556:0:5740:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765413049088 00000100:00100000:1.0:1788869441.232653:0:5740:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 2 00000100:00100000:1.0:1788869441.232664:0:5740:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c810ef2850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2125b9b3-626e-4cbe-be83-fb446e976ce2+35:2348:x1875765413049088:12345-192.168.201.39@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788869441.232679:0:5740:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788869441.232701:0:5740:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504d400/0x3d2d1916761d6810 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.39@tcp remote: 0x375c0102490358b7 expref: 35 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869441.232720:0:5740:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff94c819394000) 00010000:00010000:1.0:1788869441.232725:0:5740:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788869441.232773:0:5740:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c810ef2850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2125b9b3-626e-4cbe-be83-fb446e976ce2+34:2348:x1875765413049088:12345-192.168.201.39@tcp:103:ldlm_bl.0 Request processed in 111us (380us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869441.232794:0:5740:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 2 00000100:00100000:0.0:1788869441.233527:0:5759:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765413049344 00000100:00100000:0.0:1788869441.233532:0:5759:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765413049344 00000100:00100000:0.0:1788869441.233640:0:5759:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 12 00000100:00100000:0.0:1788869441.233649:0:5759:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c82cdc7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2125b9b3-626e-4cbe-be83-fb446e976ce2+34:10281:x1875765413049344:12345-192.168.201.39@tcp:35:cat.0 00000100:00100000:0.0:1788869441.233925:0:5759:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c82cdc7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2125b9b3-626e-4cbe-be83-fb446e976ce2+35:10281:x1875765413049344:12345-192.168.201.39@tcp:35:cat.0 Request processed in 276us (1478us total) trans 4294967332 rc 0/0 00000100:00100000:0.0:1788869441.233944:0:5759:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 12 00000100:00100000:3.0:1788869441.284924:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1788869441.285061:0:5755:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765413049600 00000100:00100000:0.0:1788869441.285071:0:5755:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765413049600 00000100:00100000:0.0:1788869441.285166:0:5755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 51 00000100:00100000:0.0:1788869441.285177:0:5755:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c83f9abb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2125b9b3-626e-4cbe-be83-fb446e976ce2+35:10287:x1875765413049600:12345-192.168.201.39@tcp:101:dd.0 00010000:00010000:0.0:1788869441.285201:0:5755:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788869441.285204:0:5755:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1788869441.285229:0:5755:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504ce00/0x3d2d1916761d676f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.39@tcp remote: 0x375c010249035886 expref: 35 pid: 5757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869441.285287:0:5755:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff94c81a585400) 00010000:00010000:0.0:1788869441.285293:0:5755:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788869441.285308:0:5755:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94c81a583400/0x3d2d1916761d681e lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x375c0102490358be expref: -99 pid: 5755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869441.285400:0:5755:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94c81a583000/0x3d2d1916761d6825 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869441.285414:0:5755:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504d600/0x3d2d1916761d67f4 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0x375c0102490358b0 expref: 35 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869441.285422:0:5755:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff94c81a583000/0x3d2d1916761d6825 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869441.285454:0:5755:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504d600/0x3d2d1916761d67f4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.39@tcp remote: 0x375c0102490358b0 expref: 35 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869441.285467:0:5755:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504d600/0x3d2d1916761d67f4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.39@tcp remote: 0x375c0102490358b0 expref: 35 pid: 5786 timeout: 289 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788869441.285497:0:5755:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94c83c6f2d80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5755:1875765421459840:192.168.201.39@tcp:104: 00000100:00100000:0.0:1788869441.285594:0:5755:0:(client.c:2702:ptlrpc_set_wait()) set ffff94c83fd69480 going to sleep for 11 seconds 00000100:00100000:2.0:1788869441.288358:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1788869441.288497:0:5755:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94c83c6f2d80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5755:1875765421459840:192.168.201.39@tcp:104: 00010000:00010000:0.0:1788869441.288523:0:5755:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff94c81a583000/0x3d2d1916761d6825 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788869441.288565:0:5739:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765413049728 00000100:00100000:3.0:1788869441.288578:0:5739:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765413049728 00010000:00010000:3.0:1788869441.288609:0:5739:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504d600/0x3d2d1916761d67f4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.39@tcp remote: 0x375c0102490358b0 expref: 36 pid: 5786 timeout: 289 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788869441.288643:0:5739:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 39 00000100:00100000:3.0:1788869441.288651:0:5739:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c82cdc4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2125b9b3-626e-4cbe-be83-fb446e976ce2+36:2348:x1875765413049728:12345-192.168.201.39@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788869441.288665:0:5739:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788869441.288671:0:5739:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504d600/0x3d2d1916761d67f4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.39@tcp remote: 0x375c0102490358b0 expref: 36 pid: 5786 timeout: 289 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869441.288683:0:5739:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504d600/0x3d2d1916761d67f4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.39@tcp remote: 0x375c0102490358b0 expref: 36 pid: 5786 timeout: 289 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869441.288703:0:5739:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504d600/0x3d2d1916761d67f4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.39@tcp remote: 0x375c0102490358b0 expref: 36 pid: 5786 timeout: 289 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869441.288716:0:5739:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff94c819394000) 00010000:00010000:3.0:1788869441.288720:0:5739:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff94c81a583000/0x3d2d1916761d6825 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869441.288728:0:5739:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff94c81a583000/0x3d2d1916761d6825 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869441.288735:0:5739:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94c81a583000/0x3d2d1916761d6825 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869441.288759:0:5739:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788869441.288794:0:5755:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff94c81a583000/0x3d2d1916761d6825 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869441.288805:0:5755:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94c81a583000/0x3d2d1916761d6825 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788869441.288822:0:5755:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00000100:00100000:3.0:1788869441.288831:0:5739:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c82cdc4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2125b9b3-626e-4cbe-be83-fb446e976ce2+35:2348:x1875765413049728:12345-192.168.201.39@tcp:103:ldlm_bl.0 Request processed in 179us (479us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869441.288839:0:5739:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 39 00010000:00010000:0.0:1788869441.288996:0:5755:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94c81a583400/0x3d2d1916761d681e lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0x375c0102490358be expref: 36 pid: 5755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869441.289013:0:5755:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94c81a583000/0x3d2d1916761d6825 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0x375c0102490358be expref: 35 pid: 5755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869441.289022:0:5755:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff94c819394000) 00010000:00010000:0.0:1788869441.289025:0:5755:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1788869441.289027:0:5755:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94c81a583000, rc 0) 00000100:00100000:0.0:1788869441.289067:0:5755:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c83f9abb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2125b9b3-626e-4cbe-be83-fb446e976ce2+35:10287:x1875765413049600:12345-192.168.201.39@tcp:101:dd.0 Request processed in 3892us (4151us total) trans 4294967333 rc 0/0 00000100:00100000:0.0:1788869441.289074:0:5755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 51 00000100:00100000:2.0:1788869441.290448:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1788869441.290519:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765413049984 00000100:00100000:3.0:1788869441.290525:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765413049984 00000100:00100000:3.0:1788869441.290559:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 52 00000100:00100000:3.0:1788869441.290565:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c82d042300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2125b9b3-626e-4cbe-be83-fb446e976ce2+35:10287:x1875765413049984:12345-192.168.201.39@tcp:36:dd.0 00010000:00010000:3.0:1788869441.290748:0:5786:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504c600/0x3d2d1916761d6833 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869441.290762:0:5786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504c600/0x3d2d1916761d6833 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869441.290771:0:5786:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504c600/0x3d2d1916761d6833 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788869441.290827:0:5786:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967334 00000004:00010000:3.0:1788869441.290844:0:5786:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000c2408c66 reply state 00000000c1c1c860 transno 4294967335 ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504c600/0x3d2d1916761d6833 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788869441.290851:0:5786:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788869441.290958:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c82d042300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2125b9b3-626e-4cbe-be83-fb446e976ce2+38:10287:x1875765413049984:12345-192.168.201.39@tcp:36:dd.0 Request processed in 393us (515us total) trans 4294967335 rc 0/0 00000100:00100000:3.0:1788869441.290963:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 52 00000020:00080000:3.0:1788869441.290967:0:5786:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1788869441.291821:0:3269:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504c600/0x3d2d1916761d6833 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869441.291829:0:3269:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504c600/0x3d2d1916761d6833 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869441.291835:0:3269:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504c600/0x3d2d1916761d6833 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869441.291838:0:3269:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94c83504c600 already unused, calling callback (ffffffffc21124f0) 00010000:00010000:1.0:1788869441.291849:0:3269:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504c600/0x3d2d1916761d6833 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869441.291855:0:3269:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504c600/0x3d2d1916761d6833 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869441.291865:0:3269:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff94c819394000) 00010000:00010000:1.0:1788869441.291867:0:3269:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788869441.291869:0:3269:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504c600/0x3d2d1916761d6833 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869441.291886:0:3269:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504c600/0x3d2d1916761d6833 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788869441.454542:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1788869441.454839:0:5757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765413050112 00000100:00100000:3.0:1788869441.454847:0:5757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765413050112 00000100:00100000:3.0:1788869441.454900:0:5757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 53 00000100:00100000:3.0:1788869441.454910:0:5757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c82d041180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2125b9b3-626e-4cbe-be83-fb446e976ce2+37:10301:x1875765413050112:12345-192.168.201.39@tcp:101:stat.0 00010000:00010000:3.0:1788869441.454933:0:5757:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788869441.454965:0:5757:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504d600/0x3d2d1916761d683a lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x375c0102490358c5 expref: -99 pid: 5757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869441.455029:0:5757:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504ca00/0x3d2d1916761d6841 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869441.455043:0:5757:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504ca00/0x3d2d1916761d6841 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869441.455054:0:5757:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504ca00/0x3d2d1916761d6841 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869441.455068:0:5757:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504c600/0x3d2d1916761d6848 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869441.455074:0:5757:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504c600/0x3d2d1916761d6848 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869441.455078:0:5757:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504c600/0x3d2d1916761d6848 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869441.455152:0:5757:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504ce00/0x3d2d1916761d684f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869441.455160:0:5757:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff94c81a583000/0x3d2d1916761d6825 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0x375c0102490358be expref: 38 pid: 5755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869441.455165:0:5757:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504ce00/0x3d2d1916761d684f lrc: 4/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869441.455190:0:5757:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff94c81a583000/0x3d2d1916761d6825 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.39@tcp remote: 0x375c0102490358be expref: 38 pid: 5755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869441.455207:0:5757:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff94c81a583000/0x3d2d1916761d6825 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.39@tcp remote: 0x375c0102490358be expref: 38 pid: 5755 timeout: 289 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788869441.455217:0:5757:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94c83f9ab800 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5757:1875765421459968:192.168.201.39@tcp:104: 00000100:00100000:3.0:1788869441.456574:0:5757:0:(client.c:2702:ptlrpc_set_wait()) set ffff94c807dff900 going to sleep for 11 seconds 00000100:00100000:0.0:1788869441.460120:0:5757:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94c83f9ab800 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5757:1875765421459968:192.168.201.39@tcp:104: 00010000:00010000:0.0:1788869441.460181:0:5757:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504ce00/0x3d2d1916761d684f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5757 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788869441.465880:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1788869441.466028:0:5758:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765413050368 00000100:00100000:1.0:1788869441.466038:0:5758:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765413050368 00000100:00100000:1.0:1788869441.466101:0:5758:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 13 00000100:00100000:1.0:1788869441.466111:0:5758:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c82d042a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2125b9b3-626e-4cbe-be83-fb446e976ce2+39:5552:x1875765413050368:12345-192.168.201.39@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1788869441.466539:0:5758:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c82d042a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2125b9b3-626e-4cbe-be83-fb446e976ce2+40:5552:x1875765413050368:12345-192.168.201.39@tcp:35:ldlm_bl.0 Request processed in 429us (665us total) trans 4294967336 rc 0/0 00000100:00100000:1.0:1788869441.466545:0:5758:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 13 00000100:00100000:2.0:1788869441.474970:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1788869441.475082:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765413050496 00000100:00100000:1.0:1788869441.475092:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765413050496 00010000:00010000:1.0:1788869441.475130:0:5788:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff94c81a583000/0x3d2d1916761d6825 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.39@tcp remote: 0x375c0102490358be expref: 40 pid: 5755 timeout: 289 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788869441.475174:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 40 00000100:00100000:1.0:1788869441.475184:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c82d043800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2125b9b3-626e-4cbe-be83-fb446e976ce2+40:2348:x1875765413050496:12345-192.168.201.39@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788869441.475199:0:5788:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788869441.475220:0:5788:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff94c81a583000/0x3d2d1916761d6825 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.39@tcp remote: 0x375c0102490358be expref: 40 pid: 5755 timeout: 289 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869441.475234:0:5788:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff94c81a583000/0x3d2d1916761d6825 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.39@tcp remote: 0x375c0102490358be expref: 40 pid: 5755 timeout: 289 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869441.475285:0:5788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94c81a583000/0x3d2d1916761d6825 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.39@tcp remote: 0x375c0102490358be expref: 40 pid: 5755 timeout: 289 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869441.475302:0:5788:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff94c819394000) 00010000:00010000:1.0:1788869441.475308:0:5788:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504ce00/0x3d2d1916761d684f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869441.475317:0:5788:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504ce00/0x3d2d1916761d684f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869441.475325:0:5788:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504ce00/0x3d2d1916761d684f lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869441.475357:0:5788:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788869441.475423:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c82d043800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2125b9b3-626e-4cbe-be83-fb446e976ce2+39:2348:x1875765413050496:12345-192.168.201.39@tcp:103:ldlm_bl.0 Request processed in 239us (461us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869441.475430:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 40 00010000:00010000:0.0:1788869441.475577:0:5757:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504ce00/0x3d2d1916761d684f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869441.475587:0:5757:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504ce00/0x3d2d1916761d684f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5757 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788869441.475629:0:5757:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:0.0:1788869441.475633:0:5757:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1788869441.475669:0:5757:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504ce00/0x3d2d1916761d684f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869441.475681:0:5757:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504ce00/0x3d2d1916761d684f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869441.475690:0:5757:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504ca00/0x3d2d1916761d6841 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869441.475697:0:5757:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504ca00/0x3d2d1916761d6841 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869441.475703:0:5757:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504ca00/0x3d2d1916761d6841 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869441.475709:0:5757:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94c83504ca00 already unused, calling callback (ffffffffc21124f0) 00010000:00010000:0.0:1788869441.475713:0:5757:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504ca00/0x3d2d1916761d6841 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869441.475721:0:5757:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504ca00/0x3d2d1916761d6841 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869441.475741:0:5757:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff94c81a585400) 00010000:00010000:0.0:1788869441.475744:0:5757:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788869441.475748:0:5757:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504ca00/0x3d2d1916761d6841 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869441.475763:0:5757:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504ca00/0x3d2d1916761d6841 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869441.475783:0:5757:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504c600/0x3d2d1916761d6848 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869441.475791:0:5757:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504c600/0x3d2d1916761d6848 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869441.475797:0:5757:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504c600/0x3d2d1916761d6848 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869441.475802:0:5757:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94c83504c600 already unused, calling callback (ffffffffc21124f0) 00010000:00010000:0.0:1788869441.475805:0:5757:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504c600/0x3d2d1916761d6848 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869441.475811:0:5757:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504c600/0x3d2d1916761d6848 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869441.475819:0:5757:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff94c819394100) 00010000:00010000:0.0:1788869441.475821:0:5757:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788869441.475824:0:5757:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504c600/0x3d2d1916761d6848 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869441.475830:0:5757:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504c600/0x3d2d1916761d6848 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869441.475875:0:5757:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504d600/0x3d2d1916761d683a lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0x375c0102490358c5 expref: 39 pid: 5757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869441.475889:0:5757:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504ce00/0x3d2d1916761d684f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0x375c0102490358c5 expref: 38 pid: 5757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869441.475896:0:5757:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff94c819394000) 00010000:00010000:0.0:1788869441.475899:0:5757:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788869441.475901:0:5757:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94c83504ce00, rc 0) 00000100:00100000:0.0:1788869441.475941:0:5757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c82d041180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2125b9b3-626e-4cbe-be83-fb446e976ce2+38:10301:x1875765413050112:12345-192.168.201.39@tcp:101:stat.0 Request processed in 21032us (21405us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869441.475948:0:5757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 53 00000100:00100000:2.0:1788869441.527666:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1788869441.527760:0:5756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765413050752 00000100:00100000:1.0:1788869441.527771:0:5756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765413050752 00000100:00100000:1.0:1788869441.527835:0:5756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 54 00000100:00100000:1.0:1788869441.527847:0:5756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c82d041c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2125b9b3-626e-4cbe-be83-fb446e976ce2+38:10307:x1875765413050752:12345-192.168.201.39@tcp:36:truncate.0 00010000:00010000:1.0:1788869441.527899:0:5756:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788869441.527927:0:5756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504ce00/0x3d2d1916761d684f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.39@tcp remote: 0x375c0102490358c5 expref: 38 pid: 5757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869441.527953:0:5756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff94c819394000) 00010000:00010000:1.0:1788869441.527957:0:5756:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788869441.528153:0:5756:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94c8421f3c00/0x3d2d1916761d6856 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869441.528167:0:5756:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94c8421f3c00/0x3d2d1916761d6856 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869441.528175:0:5756:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94c8421f3c00/0x3d2d1916761d6856 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788869441.528223:0:5756:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967337 00000004:00010000:1.0:1788869441.528241:0:5756:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000979c20d1 reply state 00000000bd09c5e9 transno 4294967338 ns: mdt-lustre-MDT0000_UUID lock: ffff94c8421f3c00/0x3d2d1916761d6856 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788869441.528281:0:5756:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788869441.528381:0:5756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c82d041c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2125b9b3-626e-4cbe-be83-fb446e976ce2+40:10307:x1875765413050752:12345-192.168.201.39@tcp:36:truncate.0 Request processed in 537us (725us total) trans 4294967338 rc 0/0 00000100:00100000:1.0:1788869441.528386:0:5756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 54 00000020:00080000:1.0:1788869441.528390:0:5756:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1788869441.529497:0:3270:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94c8421f3c00/0x3d2d1916761d6856 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869441.529506:0:3270:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94c8421f3c00/0x3d2d1916761d6856 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869441.529511:0:3270:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94c8421f3c00/0x3d2d1916761d6856 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869441.529515:0:3270:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94c8421f3c00 already unused, calling callback (ffffffffc21124f0) 00010000:00010000:1.0:1788869441.529525:0:3270:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94c8421f3c00/0x3d2d1916761d6856 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869441.529530:0:3270:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94c8421f3c00/0x3d2d1916761d6856 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869441.529540:0:3270:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff94c819394000) 00010000:00010000:1.0:1788869441.529542:0:3270:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788869441.529544:0:3270:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94c8421f3c00/0x3d2d1916761d6856 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869441.529548:0:3270:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94c8421f3c00/0x3d2d1916761d6856 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788869441.620612:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1788869441.620686:0:5755:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765413050880 00000100:00100000:0.0:1788869441.620697:0:5755:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765413050880 00000100:00100000:0.0:1788869441.620763:0:5755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 55 00000100:00100000:0.0:1788869441.620784:0:5755:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c82d042680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2125b9b3-626e-4cbe-be83-fb446e976ce2+39:10321:x1875765413050880:12345-192.168.201.39@tcp:101:stat.0 00010000:00010000:0.0:1788869441.620819:0:5755:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788869441.620841:0:5755:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94c81a583400/0x3d2d1916761d685d lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x375c0102490358cc expref: -99 pid: 5755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869441.622046:0:5755:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff94c81a582a00/0x3d2d1916761d6864 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869441.622526:0:5755:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94c81a582a00/0x3d2d1916761d6864 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869441.622542:0:5755:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94c81a582a00/0x3d2d1916761d6864 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869441.622576:0:5755:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94c81a583000/0x3d2d1916761d686b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869441.622584:0:5755:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94c81a583000/0x3d2d1916761d686b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869441.622591:0:5755:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94c81a583000/0x3d2d1916761d686b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869441.622695:0:5755:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94c81a582e00/0x3d2d1916761d6872 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869441.622703:0:5755:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94c81a582e00/0x3d2d1916761d6872 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869441.622710:0:5755:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94c81a582e00/0x3d2d1916761d6872 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788869441.622746:0:5755:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 1234567 00000004:00200000:0.0:1788869441.622751:0:5755:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1788869441.622769:0:5755:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff94c81a582e00/0x3d2d1916761d6872 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869441.622791:0:5755:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94c81a582e00/0x3d2d1916761d6872 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869441.622800:0:5755:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff94c81a582a00/0x3d2d1916761d6864 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869441.622807:0:5755:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94c81a582a00/0x3d2d1916761d6864 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869441.622822:0:5755:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94c81a582a00/0x3d2d1916761d6864 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869441.622828:0:5755:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94c81a582a00 already unused, calling callback (ffffffffc21124f0) 00010000:00010000:0.0:1788869441.622832:0:5755:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94c81a582a00/0x3d2d1916761d6864 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869441.622839:0:5755:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94c81a582a00/0x3d2d1916761d6864 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869441.622850:0:5755:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff94c81a585400) 00010000:00010000:0.0:1788869441.622853:0:5755:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788869441.622857:0:5755:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94c81a582a00/0x3d2d1916761d6864 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869441.622862:0:5755:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94c81a582a00/0x3d2d1916761d6864 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869441.622874:0:5755:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94c81a583000/0x3d2d1916761d686b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869441.622879:0:5755:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94c81a583000/0x3d2d1916761d686b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869441.622884:0:5755:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94c81a583000/0x3d2d1916761d686b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869441.622889:0:5755:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94c81a583000 already unused, calling callback (ffffffffc21124f0) 00010000:00010000:0.0:1788869441.622891:0:5755:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94c81a583000/0x3d2d1916761d686b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869441.623421:0:5755:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94c81a583000/0x3d2d1916761d686b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869441.623431:0:5755:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff94c803990d00) 00010000:00010000:0.0:1788869441.623434:0:5755:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788869441.623438:0:5755:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94c81a583000/0x3d2d1916761d686b lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869441.623444:0:5755:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94c81a583000/0x3d2d1916761d686b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869441.623485:0:5755:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94c81a583400/0x3d2d1916761d685d lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0x375c0102490358cc expref: 41 pid: 5755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869441.623501:0:5755:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94c81a582e00/0x3d2d1916761d6872 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0x375c0102490358cc expref: 40 pid: 5755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869441.623509:0:5755:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff94c819394000) 00010000:00010000:0.0:1788869441.623511:0:5755:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788869441.623514:0:5755:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94c81a582e00, rc 0) 00000100:00100000:0.0:1788869441.623654:0:5755:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c82d042680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2125b9b3-626e-4cbe-be83-fb446e976ce2+40:10321:x1875765413050880:12345-192.168.201.39@tcp:101:stat.0 Request processed in 2881us (3050us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869441.623664:0:5755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 55 00000100:00100000:0.0:1788869441.627442:0:3285:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94c810731f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:121cd5bc-7f07-4cf7-8e2e-4356c89c0696:3285:1875765421460096:0@lo:400:kworker.0 00000100:00100000:3.0:1788869441.627477:0:3286:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94c82065f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3286:1875765421460224:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788869441.627536:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869441.627551:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869441.627619:0:5750:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765421460096 00000100:00100000:2.0:1788869441.627626:0:5750:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765421460096 00000100:00100000:0.0:1788869441.627628:0:6549:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765421460224 00000100:00100000:0.0:1788869441.627634:0:6549:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765421460224 00000100:00100000:2.0:1788869441.627671:0:5750:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 265 00000100:00100000:2.0:1788869441.627679:0:5750:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c81f14d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:121cd5bc-7f07-4cf7-8e2e-4356c89c0696+19:3285:x1875765421460096:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788869441.627725:0:5750:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c81f14d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:121cd5bc-7f07-4cf7-8e2e-4356c89c0696+19:3285:x1875765421460096:12345-0@lo:400:kworker.0 Request processed in 46us (190us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869441.627731:0:5750:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 265 00000100:00100000:2.0:1788869441.627769:0:3285:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94c810731f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:121cd5bc-7f07-4cf7-8e2e-4356c89c0696:3285:1875765421460096:0@lo:400:kworker.0 00000100:00100000:0.0:1788869441.627908:0:6549:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1788869441.627916:0:6549:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c83f9aa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3286:x1875765421460224:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788869441.627945:0:6549:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00080000:2.0:1788869441.627999:0:5751:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788869441.628007:0:3283:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94c810733800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3283:1875765421460352:0@lo:400:kworker.0 00000100:00100000:1.0:1788869441.628015:0:3284:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94c810730000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3284:1875765421460480:0@lo:400:kworker.0 00000100:00100000:2.0:1788869441.628017:0:3285:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94c810733480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3285:1875765421460608:0@lo:400:kworker.0 00000100:00100000:2.0:1788869441.628050:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869441.628105:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765421460608 00000100:00100000:2.0:1788869441.628106:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869441.628109:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765421460608 00000100:00100000:3.0:1788869441.628139:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1788869441.628151:0:5751:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788869441.628172:0:5757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765421460480 00000100:00100000:2.0:1788869441.628177:0:5757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765421460480 00000100:00100000:3.0:1788869441.628186:0:5755:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765421460352 00000100:00100000:3.0:1788869441.628191:0:5755:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765421460352 00000100:00100000:1.0:1788869441.628217:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1788869441.628226:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c8349edc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3285:x1875765421460608:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788869441.628289:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c8349edc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3285:x1875765421460608:12345-0@lo:400:kworker.0 Request processed in 65us (237us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869441.628524:0:6549:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c83f9aa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3286:x1875765421460224:12345-0@lo:13:osp-pre-1-0.0 Request processed in 609us (973us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869441.628530:0:6549:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1788869441.628561:0:3286:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94c82065f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3286:1875765421460224:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788869441.629237:0:5757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1788869441.629266:0:5755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1788869441.629274:0:5757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c8349ec380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3284:x1875765421460480:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788869441.629282:0:5755:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c83f9aa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3283:x1875765421460352:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788869441.629327:0:5757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c8349ec380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3284:x1875765421460480:12345-0@lo:400:kworker.0 Request processed in 61us (1221us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869441.629334:0:5755:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c83f9aa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3283:x1875765421460352:12345-0@lo:400:kworker.0 Request processed in 55us (1195us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869441.629339:0:5757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1788869441.629347:0:5755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:1.0:1788869441.629379:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1788869441.629380:0:3284:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94c810730000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3284:1875765421460480:0@lo:400:kworker.0 00000100:00100000:3.0:1788869441.629384:0:3283:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94c810733800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3283:1875765421460352:0@lo:400:kworker.0 00000100:00080000:2.0:1788869441.629400:0:5751:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788869441.629424:0:3285:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94c810733480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3285:1875765421460608:0@lo:400:kworker.0 00000100:00100000:2.0:1788869441.683365:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1788869441.683505:0:5757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765413051136 00000100:00100000:3.0:1788869441.683515:0:5757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765413051136 00000100:00100000:3.0:1788869441.683570:0:5757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 56 00000100:00100000:3.0:1788869441.683579:0:5757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c8349eea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2125b9b3-626e-4cbe-be83-fb446e976ce2+40:10331:x1875765413051136:12345-192.168.201.39@tcp:101:lfs.0 00010000:00010000:3.0:1788869441.683598:0:5757:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788869441.683907:0:5757:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504d400/0x3d2d1916761d6879 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x375c0102490358d3 expref: -99 pid: 5757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788869441.684034:0:5757:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00010000:00010000:3.0:1788869441.684161:0:5757:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504d400/0x3d2d1916761d6879 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0x375c0102490358d3 expref: 42 pid: 5757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869441.684175:0:5757:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff94c819394300) 00010000:00010000:3.0:1788869441.684179:0:5757:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788869441.684185:0:5757:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504d400/0x3d2d1916761d6879 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.39@tcp remote: 0x375c0102490358d3 expref: 42 pid: 5757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869441.684198:0:5757:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94c83504d400, rc 0) 00000100:00100000:3.0:1788869441.684306:0:5757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c8349eea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2125b9b3-626e-4cbe-be83-fb446e976ce2+41:10331:x1875765413051136:12345-192.168.201.39@tcp:101:lfs.0 Request processed in 673us (896us total) trans 4294967339 rc 301/301 00000100:00100000:3.0:1788869441.684313:0:5757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 56 00000100:00100000:2.0:1788869441.689188:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1788869441.689323:0:5758:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765413051392 00000100:00100000:1.0:1788869441.689333:0:5758:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765413051392 00000100:00100000:1.0:1788869441.689401:0:5758:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 14 00000100:00100000:1.0:1788869441.689411:0:5758:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c8349eed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2125b9b3-626e-4cbe-be83-fb446e976ce2+41:10331:x1875765413051392:12345-192.168.201.39@tcp:35:lfs.0 00000100:00100000:1.0:1788869441.690767:0:5758:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c8349eed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2125b9b3-626e-4cbe-be83-fb446e976ce2+42:10331:x1875765413051392:12345-192.168.201.39@tcp:35:lfs.0 Request processed in 257us (488us total) trans 4294967340 rc 0/0 00000100:00100000:1.0:1788869441.690792:0:5758:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 14 00000100:00100000:2.0:1788869441.731726:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1788869441.734131:0:5755:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765413051648 00000100:00100000:3.0:1788869441.734146:0:5755:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765413051648 00000100:00100000:3.0:1788869441.734227:0:5755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 57 00000100:00100000:3.0:1788869441.734237:0:5755:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c8349ec700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2125b9b3-626e-4cbe-be83-fb446e976ce2+42:10337:x1875765413051648:12345-192.168.201.39@tcp:101:bash.0 00010000:00010000:3.0:1788869441.734288:0:5755:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788869441.734309:0:5755:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504d400/0x3d2d1916761d6887 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x375c0102490358da expref: -99 pid: 5755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869441.734407:0:5755:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504d800/0x3d2d1916761d688e lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869441.734422:0:5755:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff94c81a582e00/0x3d2d1916761d6872 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0x375c0102490358cc expref: 43 pid: 5755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869441.734449:0:5755:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504d800/0x3d2d1916761d688e lrc: 4/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869441.734480:0:5755:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff94c81a582e00/0x3d2d1916761d6872 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.39@tcp remote: 0x375c0102490358cc expref: 43 pid: 5755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869441.734493:0:5755:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff94c81a582e00/0x3d2d1916761d6872 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.39@tcp remote: 0x375c0102490358cc expref: 43 pid: 5755 timeout: 290 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788869441.734507:0:5755:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94c83f9ab800 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5755:1875765421460736:192.168.201.39@tcp:104: 00000100:00100000:3.0:1788869441.734591:0:5755:0:(client.c:2702:ptlrpc_set_wait()) set ffff94c807dff9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788869441.737026:0:5755:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94c83f9ab800 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5755:1875765421460736:192.168.201.39@tcp:104: 00000100:00100000:2.0:1788869441.737028:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00010000:00010000:3.0:1788869441.737056:0:5755:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504d800/0x3d2d1916761d688e lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788869441.737452:0:5740:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765413051776 00000100:00100000:1.0:1788869441.737461:0:5740:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765413051776 00010000:00010000:1.0:1788869441.737496:0:5740:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff94c81a582e00/0x3d2d1916761d6872 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.39@tcp remote: 0x375c0102490358cc expref: 44 pid: 5755 timeout: 290 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788869441.737534:0:5740:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 41 00000100:00100000:1.0:1788869441.737543:0:5740:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c835a7ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2125b9b3-626e-4cbe-be83-fb446e976ce2+44:2347:x1875765413051776:12345-192.168.201.39@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788869441.737557:0:5740:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788869441.737564:0:5740:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff94c81a582e00/0x3d2d1916761d6872 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.39@tcp remote: 0x375c0102490358cc expref: 44 pid: 5755 timeout: 290 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869441.737576:0:5740:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff94c81a582e00/0x3d2d1916761d6872 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.39@tcp remote: 0x375c0102490358cc expref: 44 pid: 5755 timeout: 290 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869441.737599:0:5740:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94c81a582e00/0x3d2d1916761d6872 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.39@tcp remote: 0x375c0102490358cc expref: 44 pid: 5755 timeout: 290 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869441.737615:0:5740:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff94c819394000) 00010000:00010000:1.0:1788869441.737620:0:5740:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504d800/0x3d2d1916761d688e lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869441.737630:0:5740:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504d800/0x3d2d1916761d688e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869441.737637:0:5740:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504d800/0x3d2d1916761d688e lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869441.737669:0:5740:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788869441.737732:0:5740:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c835a7ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2125b9b3-626e-4cbe-be83-fb446e976ce2+43:2347:x1875765413051776:12345-192.168.201.39@tcp:103:ldlm_bl.0 Request processed in 189us (712us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869441.737751:0:5740:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 41 00010000:00010000:3.0:1788869441.737895:0:5755:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504d800/0x3d2d1916761d688e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869441.737905:0:5755:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504d800/0x3d2d1916761d688e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788869441.737925:0:5755:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 1234567 00010000:00010000:3.0:1788869441.738073:0:5755:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504d400/0x3d2d1916761d6887 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0x375c0102490358da expref: 44 pid: 5755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869441.738090:0:5755:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504d800/0x3d2d1916761d688e lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0x375c0102490358da expref: 43 pid: 5755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869441.738109:0:5755:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff94c819394000) 00010000:00010000:3.0:1788869441.738112:0:5755:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1788869441.738115:0:5755:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94c83504d800, rc 0) 00000100:00100000:3.0:1788869441.738154:0:5755:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c8349ec700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2125b9b3-626e-4cbe-be83-fb446e976ce2+43:10337:x1875765413051648:12345-192.168.201.39@tcp:101:bash.0 Request processed in 3919us (6438us total) trans 4294967341 rc 0/0 00000100:00100000:3.0:1788869441.738162:0:5755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 57 00000100:00100000:2.0:1788869441.744391:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1788869441.744444:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765413052032 00000100:00100000:1.0:1788869441.744462:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765413052032 00000100:00100000:1.0:1788869441.744523:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 58 00000100:00100000:1.0:1788869441.744535:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c835a7fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2125b9b3-626e-4cbe-be83-fb446e976ce2+43:10337:x1875765413052032:12345-192.168.201.39@tcp:36:bash.0 00010000:00010000:1.0:1788869441.744803:0:5786:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94c8421f3c00/0x3d2d1916761d689c lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869441.744820:0:5786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94c8421f3c00/0x3d2d1916761d689c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869441.744831:0:5786:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94c8421f3c00/0x3d2d1916761d689c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788869441.744884:0:5786:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967342 00000004:00010000:1.0:1788869441.744910:0:5786:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000ee47a24c reply state 0000000013e39fac transno 4294967343 ns: mdt-lustre-MDT0000_UUID lock: ffff94c8421f3c00/0x3d2d1916761d689c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788869441.744919:0:5786:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788869441.745066:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c835a7fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2125b9b3-626e-4cbe-be83-fb446e976ce2+46:10337:x1875765413052032:12345-192.168.201.39@tcp:36:bash.0 Request processed in 533us (683us total) trans 4294967343 rc 0/0 00000100:00100000:1.0:1788869441.745074:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 58 00000020:00080000:1.0:1788869441.745079:0:5786:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1788869441.746493:0:3269:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94c8421f3c00/0x3d2d1916761d689c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869441.746507:0:3269:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94c8421f3c00/0x3d2d1916761d689c lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869441.746514:0:3269:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94c8421f3c00/0x3d2d1916761d689c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869441.746534:0:3269:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94c8421f3c00 already unused, calling callback (ffffffffc21124f0) 00010000:00010000:1.0:1788869441.746539:0:3269:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94c8421f3c00/0x3d2d1916761d689c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869441.746546:0:3269:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94c8421f3c00/0x3d2d1916761d689c lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869441.746560:0:3269:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff94c819394000) 00010000:00010000:1.0:1788869441.746562:0:3269:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788869441.746565:0:3269:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94c8421f3c00/0x3d2d1916761d689c lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869441.746570:0:3269:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94c8421f3c00/0x3d2d1916761d689c lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788869441.750242:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1788869441.750430:0:5756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765413052160 00000100:00100000:0.0:1788869441.750438:0:5756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765413052160 00000100:00100000:0.0:1788869441.750484:0:5756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 59 00000100:00100000:0.0:1788869441.750491:0:5756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c835a7d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2125b9b3-626e-4cbe-be83-fb446e976ce2+45:10337:x1875765413052160:12345-192.168.201.39@tcp:101:bash.0 00010000:00010000:0.0:1788869441.750511:0:5756:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788869441.750527:0:5756:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94c81a582200/0x3d2d1916761d68a3 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x375c0102490358e1 expref: -99 pid: 5756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869441.750592:0:5756:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94c81a583e00/0x3d2d1916761d68aa lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869441.750603:0:5756:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504d800/0x3d2d1916761d688e lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0x375c0102490358da expref: 46 pid: 5755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869441.750612:0:5756:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff94c81a583e00/0x3d2d1916761d68aa lrc: 4/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869441.750643:0:5756:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504d800/0x3d2d1916761d688e lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.39@tcp remote: 0x375c0102490358da expref: 46 pid: 5755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869441.750657:0:5756:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504d800/0x3d2d1916761d688e lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.39@tcp remote: 0x375c0102490358da expref: 46 pid: 5755 timeout: 290 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788869441.750677:0:5756:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94c83c6f2d80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5756:1875765421460864:192.168.201.39@tcp:104: 00000100:00100000:0.0:1788869441.750747:0:5756:0:(client.c:2702:ptlrpc_set_wait()) set ffff94c83fd69c00 going to sleep for 11 seconds 00000100:00100000:1.0:1788869441.752240:0:5756:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94c83c6f2d80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5756:1875765421460864:192.168.201.39@tcp:104: 00010000:00010000:1.0:1788869441.752279:0:5756:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff94c81a583e00/0x3d2d1916761d68aa lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788869441.756570:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1788869441.756631:0:5739:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765413052288 00000100:00100000:3.0:1788869441.756640:0:5739:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765413052288 00010000:00010000:3.0:1788869441.756684:0:5739:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504d800/0x3d2d1916761d688e lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.39@tcp remote: 0x375c0102490358da expref: 47 pid: 5755 timeout: 290 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788869441.756886:0:5739:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 42 00000100:00100000:3.0:1788869441.756898:0:5739:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c835a7ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2125b9b3-626e-4cbe-be83-fb446e976ce2+47:2348:x1875765413052288:12345-192.168.201.39@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788869441.756915:0:5739:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788869441.756923:0:5739:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504d800/0x3d2d1916761d688e lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.39@tcp remote: 0x375c0102490358da expref: 47 pid: 5755 timeout: 290 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869441.756938:0:5739:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504d800/0x3d2d1916761d688e lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.39@tcp remote: 0x375c0102490358da expref: 47 pid: 5755 timeout: 290 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869441.756961:0:5739:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504d800/0x3d2d1916761d688e lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.39@tcp remote: 0x375c0102490358da expref: 47 pid: 5755 timeout: 290 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869441.756977:0:5739:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff94c819394000) 00010000:00010000:3.0:1788869441.756983:0:5739:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff94c81a583e00/0x3d2d1916761d68aa lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869441.757006:0:5739:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff94c81a583e00/0x3d2d1916761d68aa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869441.757014:0:5739:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94c81a583e00/0x3d2d1916761d68aa lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869441.757043:0:5739:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788869441.757104:0:5739:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c835a7ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2125b9b3-626e-4cbe-be83-fb446e976ce2+46:2348:x1875765413052288:12345-192.168.201.39@tcp:103:ldlm_bl.0 Request processed in 208us (542us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869441.757113:0:5739:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 42 00010000:00010000:0.0:1788869441.757225:0:5756:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff94c81a583e00/0x3d2d1916761d68aa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869441.757236:0:5756:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94c81a583e00/0x3d2d1916761d68aa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788869441.757299:0:5756:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:0.0:1788869441.757305:0:5756:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1788869441.757326:0:5756:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff94c81a583e00/0x3d2d1916761d68aa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869441.757359:0:5756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94c81a582200/0x3d2d1916761d68a3 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0x375c0102490358e1 expref: 46 pid: 5756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869441.757375:0:5756:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94c81a583e00/0x3d2d1916761d68aa lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0x375c0102490358e1 expref: 45 pid: 5756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869441.757384:0:5756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff94c819394000) 00010000:00010000:0.0:1788869441.757387:0:5756:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788869441.757390:0:5756:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94c81a583e00, rc 0) 00000100:00100000:0.0:1788869441.757429:0:5756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c835a7d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2125b9b3-626e-4cbe-be83-fb446e976ce2+45:10337:x1875765413052160:12345-192.168.201.39@tcp:101:bash.0 Request processed in 6937us (7196us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869441.757437:0:5756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 59 00000100:00100000:2.0:1788869441.760312:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1788869441.760352:0:5759:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765413052544 00000100:00100000:0.0:1788869441.760362:0:5759:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765413052544 00000100:00100000:0.0:1788869441.760428:0:5759:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 15 00000100:00100000:0.0:1788869441.760438:0:5759:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c818769050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2125b9b3-626e-4cbe-be83-fb446e976ce2+45:10337:x1875765413052544:12345-192.168.201.39@tcp:35:bash.0 00000100:00100000:0.0:1788869441.760657:0:5759:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c818769050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2125b9b3-626e-4cbe-be83-fb446e976ce2+46:10337:x1875765413052544:12345-192.168.201.39@tcp:35:bash.0 Request processed in 220us (350us total) trans 4294967344 rc 0/0 00000100:00100000:0.0:1788869441.760666:0:5759:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 15 00000100:00100000:2.0:1788869441.820199:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1788869441.820279:0:5757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765413052800 00000100:00100000:3.0:1788869441.820289:0:5757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765413052800 00000100:00100000:3.0:1788869441.820340:0:5757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 60 00000100:00100000:3.0:1788869441.820350:0:5757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c835a7df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2125b9b3-626e-4cbe-be83-fb446e976ce2+46:10347:x1875765413052800:12345-192.168.201.39@tcp:101:lfs.0 00010000:00010000:3.0:1788869441.820374:0:5757:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788869441.820395:0:5757:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504d400/0x3d2d1916761d68b1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x375c0102490358e8 expref: -99 pid: 5757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788869441.820514:0:5757:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00010000:00010000:3.0:1788869441.820634:0:5757:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504d400/0x3d2d1916761d68b1 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0x375c0102490358e8 expref: 48 pid: 5757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869441.820649:0:5757:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff94c819394300) 00010000:00010000:3.0:1788869441.820653:0:5757:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788869441.820658:0:5757:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504d400/0x3d2d1916761d68b1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.39@tcp remote: 0x375c0102490358e8 expref: 48 pid: 5757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869441.820671:0:5757:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94c83504d400, rc 0) 00000100:00100000:3.0:1788869441.820807:0:5757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c835a7df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2125b9b3-626e-4cbe-be83-fb446e976ce2+47:10347:x1875765413052800:12345-192.168.201.39@tcp:101:lfs.0 Request processed in 458us (615us total) trans 4294967345 rc 301/301 00000100:00100000:3.0:1788869441.820814:0:5757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 60 00000100:00100000:3.0:1788869441.822739:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1788869441.825978:0:5755:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765413052928 00000100:00100000:1.0:1788869441.825992:0:5755:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765413052928 00000100:00100000:1.0:1788869441.826053:0:5755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 61 00000100:00100000:1.0:1788869441.826064:0:5755:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c83f9ab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2125b9b3-626e-4cbe-be83-fb446e976ce2+47:10347:x1875765413052928:12345-192.168.201.39@tcp:34:lfs.0 00010000:00010000:1.0:1788869441.826167:0:5755:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff94c8421f3c00/0x3d2d1916761d68bf lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869441.826184:0:5755:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94c8421f3c00/0x3d2d1916761d68bf lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869441.826207:0:5755:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94c8421f3c00/0x3d2d1916761d68bf lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869441.826224:0:5755:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94c8421f3400/0x3d2d1916761d68c6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869441.826232:0:5755:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94c8421f3400/0x3d2d1916761d68c6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869441.826238:0:5755:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94c8421f3400/0x3d2d1916761d68c6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869441.826363:0:5755:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94c83fde6000/0x3d2d1916761d68cd lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869441.826373:0:5755:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94c83fde6000/0x3d2d1916761d68cd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869441.826380:0:5755:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94c83fde6000/0x3d2d1916761d68cd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788869441.826420:0:5755:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff94c83fde6000/0x3d2d1916761d68cd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869441.826432:0:5755:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff94c8421f3c00/0x3d2d1916761d68bf lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869441.826439:0:5755:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94c8421f3c00/0x3d2d1916761d68bf lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869441.826446:0:5755:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94c8421f3c00/0x3d2d1916761d68bf lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869441.826461:0:5755:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94c8421f3c00 already unused, calling callback (ffffffffc21124f0) 00010000:00010000:1.0:1788869441.826465:0:5755:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94c8421f3c00/0x3d2d1916761d68bf lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869441.826474:0:5755:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94c8421f3c00/0x3d2d1916761d68bf lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869441.826486:0:5755:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff94c81a585400) 00010000:00010000:1.0:1788869441.826489:0:5755:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788869441.826494:0:5755:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94c8421f3c00/0x3d2d1916761d68bf lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869441.826500:0:5755:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94c8421f3c00/0x3d2d1916761d68bf lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869441.826514:0:5755:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94c8421f3400/0x3d2d1916761d68c6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869441.826520:0:5755:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94c8421f3400/0x3d2d1916761d68c6 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869441.826526:0:5755:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94c8421f3400/0x3d2d1916761d68c6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869441.826531:0:5755:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94c8421f3400 already unused, calling callback (ffffffffc21124f0) 00010000:00010000:1.0:1788869441.826534:0:5755:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94c8421f3400/0x3d2d1916761d68c6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869441.826539:0:5755:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94c8421f3400/0x3d2d1916761d68c6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869441.826558:0:5755:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff94c81a585100) 00010000:00010000:1.0:1788869441.826560:0:5755:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788869441.826563:0:5755:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94c8421f3400/0x3d2d1916761d68c6 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869441.826568:0:5755:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94c8421f3400/0x3d2d1916761d68c6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869441.826582:0:5755:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94c83fde6000/0x3d2d1916761d68cd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869441.826588:0:5755:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94c83fde6000/0x3d2d1916761d68cd lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869441.826594:0:5755:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94c83fde6000/0x3d2d1916761d68cd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869441.826599:0:5755:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94c83fde6000 already unused, calling callback (ffffffffc21124f0) 00010000:00010000:1.0:1788869441.826602:0:5755:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94c83fde6000/0x3d2d1916761d68cd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869441.826607:0:5755:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94c83fde6000/0x3d2d1916761d68cd lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869441.826614:0:5755:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff94c819394000) 00010000:00010000:1.0:1788869441.826616:0:5755:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788869441.826619:0:5755:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94c83fde6000/0x3d2d1916761d68cd lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869441.826624:0:5755:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94c83fde6000/0x3d2d1916761d68cd lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788869441.826700:0:5755:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c83f9ab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2125b9b3-626e-4cbe-be83-fb446e976ce2+47:10347:x1875765413052928:12345-192.168.201.39@tcp:34:lfs.0 Request processed in 637us (3966us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869441.826707:0:5755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 61 00000100:00100000:2.0:1788869441.828436:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1788869441.828477:0:5758:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765413053184 00000100:00100000:1.0:1788869441.828484:0:5758:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765413053184 00000100:00100000:1.0:1788869441.828518:0:5758:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 16 00000100:00100000:1.0:1788869441.828524:0:5758:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c835a7ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2125b9b3-626e-4cbe-be83-fb446e976ce2+47:10347:x1875765413053184:12345-192.168.201.39@tcp:35:lfs.0 00000100:00100000:1.0:1788869441.828721:0:5758:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c835a7ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2125b9b3-626e-4cbe-be83-fb446e976ce2+48:10347:x1875765413053184:12345-192.168.201.39@tcp:35:lfs.0 Request processed in 196us (291us total) trans 4294967346 rc 0/0 00000100:00100000:1.0:1788869441.828727:0:5758:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 16 00000100:00100000:2.0:1788869441.854718:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1788869441.854779:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765413053440 00000100:00100000:1.0:1788869441.854789:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765413053440 00000100:00100000:1.0:1788869441.854852:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 62 00000100:00100000:1.0:1788869441.854864:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c835a7e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2125b9b3-626e-4cbe-be83-fb446e976ce2+48:10350:x1875765413053440:12345-192.168.201.39@tcp:101:lfs.0 00010000:00010000:1.0:1788869441.854888:0:5786:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788869441.854908:0:5786:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94c83fde6000/0x3d2d1916761d68d4 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x375c0102490358ef expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869441.854999:0:5786:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff94c83fde7c00/0x3d2d1916761d68db lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869441.855012:0:5786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94c83fde7c00/0x3d2d1916761d68db lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869441.855023:0:5786:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94c83fde7c00/0x3d2d1916761d68db lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869441.855046:0:5786:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94c83fde7200/0x3d2d1916761d68e2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869441.855054:0:5786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94c83fde7200/0x3d2d1916761d68e2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869441.855061:0:5786:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94c83fde7200/0x3d2d1916761d68e2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869441.855177:0:5786:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94c83fde6600/0x3d2d1916761d68e9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869441.855186:0:5786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94c83fde6600/0x3d2d1916761d68e9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869441.855193:0:5786:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94c83fde6600/0x3d2d1916761d68e9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788869441.855204:0:5786:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:1.0:1788869441.855341:0:5786:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff94c83fde7c00/0x3d2d1916761d68db lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869441.855350:0:5786:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94c83fde7c00/0x3d2d1916761d68db lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869441.855357:0:5786:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94c83fde7c00/0x3d2d1916761d68db lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869441.855364:0:5786:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94c83fde7c00 already unused, calling callback (ffffffffc21124f0) 00010000:00010000:1.0:1788869441.855381:0:5786:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94c83fde7c00/0x3d2d1916761d68db lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869441.855398:0:5786:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94c83fde7c00/0x3d2d1916761d68db lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869441.855411:0:5786:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff94c81a585400) 00010000:00010000:1.0:1788869441.855414:0:5786:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788869441.855418:0:5786:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94c83fde7c00/0x3d2d1916761d68db lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869441.855424:0:5786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94c83fde7c00/0x3d2d1916761d68db lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869441.855436:0:5786:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94c83fde7200/0x3d2d1916761d68e2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869441.855442:0:5786:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94c83fde7200/0x3d2d1916761d68e2 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869441.855447:0:5786:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94c83fde7200/0x3d2d1916761d68e2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869441.855452:0:5786:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94c83fde7200 already unused, calling callback (ffffffffc21124f0) 00010000:00010000:1.0:1788869441.855454:0:5786:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94c83fde7200/0x3d2d1916761d68e2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869441.855460:0:5786:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94c83fde7200/0x3d2d1916761d68e2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869441.855467:0:5786:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff94c81a585100) 00010000:00010000:1.0:1788869441.855470:0:5786:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788869441.855472:0:5786:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94c83fde7200/0x3d2d1916761d68e2 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869441.855488:0:5786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94c83fde7200/0x3d2d1916761d68e2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869441.855528:0:5786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94c83fde6000/0x3d2d1916761d68d4 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0x375c0102490358ef expref: 51 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869441.855542:0:5786:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94c83fde6600/0x3d2d1916761d68e9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0x375c0102490358ef expref: 50 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869441.855549:0:5786:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff94c819394000) 00010000:00010000:1.0:1788869441.855552:0:5786:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788869441.855554:0:5786:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94c83fde6600, rc 0) 00000100:00100000:1.0:1788869441.855614:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c835a7e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2125b9b3-626e-4cbe-be83-fb446e976ce2+50:10350:x1875765413053440:12345-192.168.201.39@tcp:101:lfs.0 Request processed in 752us (911us total) trans 4294967347 rc 0/0 00000100:00100000:1.0:1788869441.855622:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 62 00000100:00100000:3.0:1788869441.857567:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1788869441.857615:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1788869441.857617:0:5755:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765413053568 00000100:00100000:1.0:1788869441.857625:0:5755:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765413053568 00000100:00100000:1.0:1788869441.857667:0:5755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 63 00000100:00100000:1.0:1788869441.857678:0:5755:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c82cedb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2125b9b3-626e-4cbe-be83-fb446e976ce2+50:10350:x1875765413053568:12345-192.168.201.39@tcp:54:lfs.0 00000100:00100000:0.0:1788869441.857684:0:7448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765413053696 00000100:00100000:0.0:1788869441.857690:0:7448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765413053696 00010000:00010000:1.0:1788869441.857725:0:5755:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94c83fde6a00/0x3d2d1916761d68f7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869441.857738:0:5755:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94c83fde6a00/0x3d2d1916761d68f7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788869441.857743:0:7448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 3 00010000:00010000:1.0:1788869441.857755:0:5755:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94c83fde6a00/0x3d2d1916761d68f7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788869441.857756:0:7448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c82ceda300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:2125b9b3-626e-4cbe-be83-fb446e976ce2+51:2348:x1875765413053696:12345-192.168.201.39@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788869441.857785:0:7448:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788869441.857802:0:7448:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94c83fde6600/0x3d2d1916761d68e9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.39@tcp remote: 0x375c0102490358ef expref: 51 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869441.857805:0:5755:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94c83fde6a00/0x3d2d1916761d68f7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869441.857814:0:5755:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94c83fde6a00/0x3d2d1916761d68f7 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869441.857820:0:5755:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94c83fde6a00/0x3d2d1916761d68f7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869441.857823:0:7448:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff94c819394000) 00010000:00010000:0.0:1788869441.857829:0:7448:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788869441.857834:0:5755:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94c83fde6a00 already unused, calling callback (ffffffffc21124f0) 00010000:00010000:1.0:1788869441.857839:0:5755:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94c83fde6a00/0x3d2d1916761d68f7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869441.857846:0:5755:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94c83fde6a00/0x3d2d1916761d68f7 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869441.857855:0:5755:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff94c819394000) 00010000:00010000:1.0:1788869441.857858:0:5755:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788869441.857861:0:5755:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94c83fde6a00/0x3d2d1916761d68f7 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788869441.857867:0:7448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c82ceda300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:2125b9b3-626e-4cbe-be83-fb446e976ce2+50:2348:x1875765413053696:12345-192.168.201.39@tcp:103:ldlm_bl.0 Request processed in 113us (251us total) trans 0 rc 0/0 00010000:00010000:1.0:1788869441.857874:0:5755:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94c83fde6a00/0x3d2d1916761d68f7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788869441.857878:0:7448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 3 00000100:00100000:1.0:1788869441.857928:0:5755:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c82cedb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2125b9b3-626e-4cbe-be83-fb446e976ce2+49:10350:x1875765413053568:12345-192.168.201.39@tcp:54:lfs.0 Request processed in 253us (365us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869441.857937:0:5755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 63 00000100:00100000:2.0:1788869441.858896:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1788869441.858936:0:5759:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765413053952 00000100:00100000:0.0:1788869441.858941:0:5759:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765413053952 00000100:00100000:0.0:1788869441.858972:0:5759:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 17 00000100:00100000:0.0:1788869441.858978:0:5759:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c82c842300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2125b9b3-626e-4cbe-be83-fb446e976ce2+49:10350:x1875765413053952:12345-192.168.201.39@tcp:35:lfs.0 00000100:00100000:0.0:1788869441.859115:0:5759:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c82c842300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2125b9b3-626e-4cbe-be83-fb446e976ce2+50:10350:x1875765413053952:12345-192.168.201.39@tcp:35:lfs.0 Request processed in 136us (220us total) trans 4294967348 rc 0/0 00000100:00100000:0.0:1788869441.859122:0:5759:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 17 00000100:00100000:2.0:1788869441.937447:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1788869441.937501:0:5757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765413054208 00000100:00100000:3.0:1788869441.937512:0:5757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765413054208 00000100:00100000:3.0:1788869441.937572:0:5757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 64 00000100:00100000:3.0:1788869441.937584:0:5757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c82c841f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2125b9b3-626e-4cbe-be83-fb446e976ce2+50:10368:x1875765413054208:12345-192.168.201.39@tcp:101:cat.0 00010000:00010000:3.0:1788869441.937607:0:5757:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788869441.937738:0:5757:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504d800/0x3d2d1916761d68fe lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x375c0102490358f6 expref: -99 pid: 5757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869441.937861:0:5757:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504d400/0x3d2d1916761d6905 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869441.937877:0:5757:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504d400/0x3d2d1916761d6905 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869441.937888:0:5757:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504d400/0x3d2d1916761d6905 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5757 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788869441.937900:0:5757:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:3.0:1788869441.938021:0:5757:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504d800/0x3d2d1916761d68fe lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0x375c0102490358f6 expref: 53 pid: 5757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869441.938040:0:5757:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504d400/0x3d2d1916761d6905 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0x375c0102490358f6 expref: 52 pid: 5757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869441.938069:0:5757:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff94c819394000) 00010000:00010000:3.0:1788869441.938072:0:5757:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:3.0:1788869441.938075:0:5757:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94c83504d400, rc 0) 00000100:00100000:3.0:1788869441.938131:0:5757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c82c841f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2125b9b3-626e-4cbe-be83-fb446e976ce2+52:10368:x1875765413054208:12345-192.168.201.39@tcp:101:cat.0 Request processed in 549us (692us total) trans 4294967349 rc 0/0 00000100:00100000:3.0:1788869441.938138:0:5757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 64 00010000:00010000:3.0:1788869441.947829:0:7447:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788869441.956333:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1788869441.956785:0:5756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765413054336 00000100:00100000:2.0:1788869441.956795:0:5756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765413054336 00000100:00100000:2.0:1788869441.956859:0:5756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 65 00000100:00100000:2.0:1788869441.956869:0:5756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c82ced9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2125b9b3-626e-4cbe-be83-fb446e976ce2+52:10369:x1875765413054336:12345-192.168.201.39@tcp:101:lfs.0 00010000:00010000:2.0:1788869441.956893:0:5756:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788869441.956925:0:5756:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94c805039200/0x3d2d1916761d6913 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x375c0102490358fd expref: -99 pid: 5756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869441.956993:0:5756:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94c805039c00/0x3d2d1916761d691a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869441.957007:0:5756:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94c805039c00/0x3d2d1916761d691a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869441.957018:0:5756:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94c805039c00/0x3d2d1916761d691a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788869441.957073:0:5756:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00000004:00200000:2.0:1788869441.957077:0:5756:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:2.0:1788869441.957102:0:5756:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff94c805039c00/0x3d2d1916761d691a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869441.957125:0:5756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94c805039200/0x3d2d1916761d6913 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0x375c0102490358fd expref: 54 pid: 5756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869441.957143:0:5756:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94c805039c00/0x3d2d1916761d691a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0x375c0102490358fd expref: 53 pid: 5756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869441.957150:0:5756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff94c81a585400) 00010000:00010000:2.0:1788869441.957153:0:5756:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788869441.957155:0:5756:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94c805039c00, rc 0) 00000100:00100000:2.0:1788869441.957350:0:5756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c82ced9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2125b9b3-626e-4cbe-be83-fb446e976ce2+53:10369:x1875765413054336:12345-192.168.201.39@tcp:101:lfs.0 Request processed in 478us (1023us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869441.957358:0:5756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 65 00000100:00100000:2.0:1788869441.963732:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1788869441.963832:0:5758:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765413054720 00000100:00100000:1.0:1788869441.963842:0:5758:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765413054720 00000100:00100000:1.0:1788869441.963905:0:5758:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 18 00000100:00100000:1.0:1788869441.963923:0:5758:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c82c841880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2125b9b3-626e-4cbe-be83-fb446e976ce2+53:10369:x1875765413054720:12345-192.168.201.39@tcp:35:lfs.0 00000100:00100000:1.0:1788869441.964461:0:5758:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c82c841880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2125b9b3-626e-4cbe-be83-fb446e976ce2+54:10369:x1875765413054720:12345-192.168.201.39@tcp:35:lfs.0 Request processed in 532us (730us total) trans 4294967350 rc 0/0 00000100:00100000:1.0:1788869441.964468:0:5758:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 18 00000100:00100000:0.0:1788869441.966286:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1788869441.966345:0:5741:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765413054848 00000100:00100000:2.0:1788869441.966355:0:5741:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765413054848 00000100:00100000:2.0:1788869441.966401:0:5741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 4 00000100:00100000:2.0:1788869441.966407:0:5741:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c83c6f1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2125b9b3-626e-4cbe-be83-fb446e976ce2+54:10369:x1875765413054848:12345-192.168.201.39@tcp:103:lfs.0 00010000:00010000:2.0:1788869441.966419:0:5741:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:2.0:1788869441.966443:0:5741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94c81a583e00/0x3d2d1916761d68aa lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.39@tcp remote: 0x375c0102490358e1 expref: 54 pid: 5756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869441.966465:0:5741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504d400/0x3d2d1916761d6905 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.39@tcp remote: 0x375c0102490358f6 expref: 53 pid: 5757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869441.966476:0:5741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504c800/0x3d2d1916761d67b5 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.39@tcp remote: 0x375c0102490358a2 expref: 52 pid: 5757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869441.966485:0:5741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff94c819394000) 00010000:00010000:2.0:1788869441.966494:0:5741:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788869441.966530:0:5741:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c83c6f1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2125b9b3-626e-4cbe-be83-fb446e976ce2+51:10369:x1875765413054848:12345-192.168.201.39@tcp:103:lfs.0 Request processed in 123us (252us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869441.966535:0:5741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 4 00000100:00100000:3.0:1788869441.968348:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1788869441.968438:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765413054976 00000100:00100000:1.0:1788869441.968451:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765413054976 00000100:00100000:1.0:1788869441.968522:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 66 00000100:00100000:1.0:1788869441.968534:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c82cedbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2125b9b3-626e-4cbe-be83-fb446e976ce2+51:10369:x1875765413054976:12345-192.168.201.39@tcp:58:lfs.0 00010000:00010000:1.0:1788869441.968675:0:5786:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94c83fde6a00/0x3d2d1916761d6921 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869441.968691:0:5786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94c83fde6a00/0x3d2d1916761d6921 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869441.968907:0:5786:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94c83fde6a00/0x3d2d1916761d6921 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788869441.969149:0:5786:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788869441.969335:0:5786:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 64 off8256 00000040:00080000:1.0:1788869441.969378:0:5786:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1, 136 off8328 00000100:00100000:1.0:1788869441.969460:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c82cedbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2125b9b3-626e-4cbe-be83-fb446e976ce2+51:10369:x1875765413054976:12345-192.168.201.39@tcp:58:lfs.0 Request processed in 929us (1125us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869441.969468:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 66 00000100:00100000:0.0:1788869441.992500:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1788869441.992576:0:5755:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765413055104 00000100:00100000:1.0:1788869441.992592:0:5755:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765413055104 00000100:00100000:1.0:1788869441.992730:0:5755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 67 00000100:00100000:1.0:1788869441.992741:0:5755:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c83c6f1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2125b9b3-626e-4cbe-be83-fb446e976ce2+51:10371:x1875765413055104:12345-192.168.201.39@tcp:101:lfs.0 00010000:00010000:1.0:1788869441.992762:0:5755:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788869441.992808:0:5755:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94c83fde6000/0x3d2d1916761d6928 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x375c010249035904 expref: -99 pid: 5755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869441.992890:0:5755:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff94c83fde7200/0x3d2d1916761d692f lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869441.992905:0:5755:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94c83fde7200/0x3d2d1916761d692f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869441.992917:0:5755:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94c83fde7200/0x3d2d1916761d692f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869441.992933:0:5755:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94c83fde7c00/0x3d2d1916761d6936 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869441.992941:0:5755:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94c83fde7c00/0x3d2d1916761d6936 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869441.992948:0:5755:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94c83fde7c00/0x3d2d1916761d6936 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869441.993043:0:5755:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94c83fde6800/0x3d2d1916761d693d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869441.993052:0:5755:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94c83fde6800/0x3d2d1916761d693d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869441.993072:0:5755:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94c83fde6800/0x3d2d1916761d693d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788869441.993107:0:5755:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:1.0:1788869441.993111:0:5755:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1788869441.993129:0:5755:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff94c83fde6800/0x3d2d1916761d693d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869441.993149:0:5755:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94c83fde6800/0x3d2d1916761d693d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869441.993157:0:5755:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff94c83fde7200/0x3d2d1916761d692f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869441.993163:0:5755:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94c83fde7200/0x3d2d1916761d692f lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869441.993169:0:5755:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94c83fde7200/0x3d2d1916761d692f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869441.993175:0:5755:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94c83fde7200 already unused, calling callback (ffffffffc21124f0) 00010000:00010000:1.0:1788869441.993179:0:5755:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94c83fde7200/0x3d2d1916761d692f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869441.993187:0:5755:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94c83fde7200/0x3d2d1916761d692f lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869441.993199:0:5755:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff94c81a585400) 00010000:00010000:1.0:1788869441.993202:0:5755:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788869441.993206:0:5755:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94c83fde7200/0x3d2d1916761d692f lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869441.993213:0:5755:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94c83fde7200/0x3d2d1916761d692f lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869441.993226:0:5755:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94c83fde7c00/0x3d2d1916761d6936 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869441.993232:0:5755:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94c83fde7c00/0x3d2d1916761d6936 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869441.993244:0:5755:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94c83fde7c00/0x3d2d1916761d6936 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869441.993286:0:5755:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94c83fde7c00 already unused, calling callback (ffffffffc21124f0) 00010000:00010000:1.0:1788869441.993290:0:5755:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94c83fde7c00/0x3d2d1916761d6936 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869441.993310:0:5755:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94c83fde7c00/0x3d2d1916761d6936 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869441.993323:0:5755:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff94c81a585900) 00010000:00010000:1.0:1788869441.993326:0:5755:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788869441.993333:0:5755:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94c83fde7c00/0x3d2d1916761d6936 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869441.993340:0:5755:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94c83fde7c00/0x3d2d1916761d6936 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869441.993388:0:5755:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94c83fde6000/0x3d2d1916761d6928 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0x375c010249035904 expref: 53 pid: 5755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869441.993405:0:5755:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94c83fde6800/0x3d2d1916761d693d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0x375c010249035904 expref: 52 pid: 5755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869441.993412:0:5755:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff94c81a585100) 00010000:00010000:1.0:1788869441.993414:0:5755:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788869441.993417:0:5755:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94c83fde6800, rc 0) 00000100:00100000:0.0:1788869441.993633:0:5755:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c83c6f1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2125b9b3-626e-4cbe-be83-fb446e976ce2+52:10371:x1875765413055104:12345-192.168.201.39@tcp:101:lfs.0 Request processed in 888us (1141us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869441.993644:0:5755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 67 00000040:00080000:3.0:1788869442.076543:0:11485:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788869442.076551:0:11485:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788869442.076597:0:11485:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:3.0:1788869442.076605:0:11485:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1788869442.076722:0:11485:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94c82ced8380 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11485:1875765421460992:192.168.201.39@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1788869442.078928:0:11485:0:(client.c:2702:ptlrpc_set_wait()) set ffff94c807dffe40 going to sleep for 11 seconds 00000100:00100000:3.0:1788869442.082707:0:11485:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94c82ced8380 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11485:1875765421460992:192.168.201.39@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1788869442.087854:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1788869442.088006:0:5766:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765413055232 00000100:00100000:0.0:1788869442.088017:0:5766:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765413055232 00000100:00100000:0.0:1788869442.088092:0:5766:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 1 00000100:00100000:0.0:1788869442.088104:0:5766:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c82ced8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:2125b9b3-626e-4cbe-be83-fb446e976ce2+52:10382:x1875765413055232:12345-192.168.201.39@tcp:900:lhsmtool_posix.0 00000100:00100000:0.0:1788869442.088182:0:5766:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c82ced8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:2125b9b3-626e-4cbe-be83-fb446e976ce2+52:10382:x1875765413055232:12345-192.168.201.39@tcp:900:lhsmtool_posix.0 Request processed in 81us (339us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869442.088190:0:5766:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 1 00000100:00100000:0.0:1788869442.090959:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1788869442.091025:0:5757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765413055360 00000100:00100000:3.0:1788869442.091034:0:5757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765413055360 00000100:00100000:3.0:1788869442.091089:0:5757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 68 00000100:00100000:3.0:1788869442.091099:0:5757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c83c6f0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2125b9b3-626e-4cbe-be83-fb446e976ce2+52:10382:x1875765413055360:12345-192.168.201.39@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1788869442.091130:0:5757:0:(mdt_handler.c:8041:mdt_fid2path()) path get [0x200000401:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1788869442.091291:0:5757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c83c6f0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2125b9b3-626e-4cbe-be83-fb446e976ce2+52:10382:x1875765413055360:12345-192.168.201.39@tcp:53:lhsmtool_posix.0 Request processed in 193us (340us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869442.091308:0:5757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 68 00000100:00100000:3.0:1788869442.095779:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1788869442.095927:0:5756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765413055488 00000100:00100000:2.0:1788869442.095937:0:5756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765413055488 00000100:00100000:2.0:1788869442.095991:0:5756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 69 00000100:00100000:2.0:1788869442.096000:0:5756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c82ced8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2125b9b3-626e-4cbe-be83-fb446e976ce2+52:10382:x1875765413055488:12345-192.168.201.39@tcp:34:lhsmtool_posix.0 00010000:00010000:2.0:1788869442.096071:0:5756:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff94c805039800/0x3d2d1916761d6944 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869442.096088:0:5756:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94c805039800/0x3d2d1916761d6944 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869442.096107:0:5756:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94c805039800/0x3d2d1916761d6944 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869442.096124:0:5756:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94c805039400/0x3d2d1916761d694b lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869442.096133:0:5756:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94c805039400/0x3d2d1916761d694b lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869442.096140:0:5756:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94c805039400/0x3d2d1916761d694b lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869442.096168:0:5756:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94c805039000/0x3d2d1916761d6952 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869442.096177:0:5756:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94c805039000/0x3d2d1916761d6952 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869442.096184:0:5756:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94c805039000/0x3d2d1916761d6952 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788869442.096223:0:5756:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:2.0:1788869442.096228:0:5756:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1788869442.096289:0:5756:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff94c805039000/0x3d2d1916761d6952 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869442.096301:0:5756:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff94c805039800/0x3d2d1916761d6944 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869442.096307:0:5756:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94c805039800/0x3d2d1916761d6944 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869442.096323:0:5756:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94c805039800/0x3d2d1916761d6944 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869442.096329:0:5756:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94c805039800 already unused, calling callback (ffffffffc21124f0) 00010000:00010000:2.0:1788869442.096333:0:5756:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94c805039800/0x3d2d1916761d6944 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869442.096340:0:5756:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94c805039800/0x3d2d1916761d6944 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869442.096351:0:5756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff94c819394200) 00010000:00010000:2.0:1788869442.096354:0:5756:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788869442.096358:0:5756:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94c805039800/0x3d2d1916761d6944 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869442.096363:0:5756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94c805039800/0x3d2d1916761d6944 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869442.096374:0:5756:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94c805039400/0x3d2d1916761d694b lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869442.096380:0:5756:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94c805039400/0x3d2d1916761d694b lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869442.096385:0:5756:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94c805039400/0x3d2d1916761d694b lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869442.096390:0:5756:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94c805039400 already unused, calling callback (ffffffffc21124f0) 00010000:00010000:2.0:1788869442.096392:0:5756:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94c805039400/0x3d2d1916761d694b lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869442.096408:0:5756:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94c805039400/0x3d2d1916761d694b lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869442.096415:0:5756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x3c15db59 (ffff94c802f3f100) 00010000:00010000:2.0:1788869442.096418:0:5756:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788869442.096420:0:5756:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94c805039400/0x3d2d1916761d694b lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869442.096426:0:5756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94c805039400/0x3d2d1916761d694b lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869442.096440:0:5756:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94c805039000/0x3d2d1916761d6952 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869442.096446:0:5756:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94c805039000/0x3d2d1916761d6952 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869442.096452:0:5756:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94c805039000/0x3d2d1916761d6952 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869442.096456:0:5756:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94c805039000 already unused, calling callback (ffffffffc21124f0) 00010000:00010000:2.0:1788869442.096459:0:5756:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94c805039000/0x3d2d1916761d6952 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869442.096465:0:5756:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94c805039000/0x3d2d1916761d6952 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869442.096471:0:5756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff94c81a585100) 00010000:00010000:2.0:1788869442.096473:0:5756:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788869442.096476:0:5756:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94c805039000/0x3d2d1916761d6952 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869442.096493:0:5756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94c805039000/0x3d2d1916761d6952 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788869442.097689:0:5756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c82ced8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2125b9b3-626e-4cbe-be83-fb446e976ce2+52:10382:x1875765413055488:12345-192.168.201.39@tcp:34:lhsmtool_posix.0 Request processed in 569us (805us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869442.097701:0:5756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 69 00000100:00100000:0.0:1788869442.101949:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1788869442.102009:0:5757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765413055744 00000100:00100000:3.0:1788869442.102026:0:5757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765413055744 00000100:00100000:3.0:1788869442.102103:0:5757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 70 00000100:00100000:3.0:1788869442.102115:0:5757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c83c6f2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2125b9b3-626e-4cbe-be83-fb446e976ce2+52:10382:x1875765413055744:12345-192.168.201.39@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788869442.102150:0:5757:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788869442.102179:0:5757:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504d800/0x3d2d1916761d6959 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x375c01024903590b expref: -99 pid: 5757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869442.102360:0:5757:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504c000/0x3d2d1916761d6960 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869442.102377:0:5757:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504c000/0x3d2d1916761d6960 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869442.102391:0:5757:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504c000/0x3d2d1916761d6960 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5757 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788869442.102405:0:5757:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:3.0:1788869442.102537:0:5757:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504c000/0x3d2d1916761d6960 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869442.102546:0:5757:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504c000/0x3d2d1916761d6960 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869442.102554:0:5757:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504c000/0x3d2d1916761d6960 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869442.102561:0:5757:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94c83504c000 already unused, calling callback (ffffffffc21124f0) 00010000:00010000:3.0:1788869442.102579:0:5757:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504c000/0x3d2d1916761d6960 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869442.102588:0:5757:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504c000/0x3d2d1916761d6960 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869442.102603:0:5757:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff94c81a585100) 00010000:00010000:3.0:1788869442.102607:0:5757:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788869442.102612:0:5757:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504c000/0x3d2d1916761d6960 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869442.102619:0:5757:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504c000/0x3d2d1916761d6960 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869442.102667:0:5757:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504d800/0x3d2d1916761d6959 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0x375c01024903590b expref: 54 pid: 5757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869442.102679:0:5757:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff94c819394200) 00010000:00010000:3.0:1788869442.102682:0:5757:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788869442.102686:0:5757:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504d800/0x3d2d1916761d6959 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.39@tcp remote: 0x375c01024903590b expref: 54 pid: 5757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869442.102697:0:5757:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94c83504d800, rc 0) 00000100:00100000:3.0:1788869442.102798:0:5757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c83c6f2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2125b9b3-626e-4cbe-be83-fb446e976ce2+53:10382:x1875765413055744:12345-192.168.201.39@tcp:101:lhsmtool_posix.0 Request processed in 685us (856us total) trans 4294967351 rc 301/301 00000100:00100000:3.0:1788869442.102807:0:5757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 70 00000100:00100000:0.0:1788869442.107826:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1788869442.107913:0:5755:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765413055872 00000100:00100000:3.0:1788869442.107930:0:5755:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765413055872 00000100:00100000:3.0:1788869442.108019:0:5755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 71 00000100:00100000:3.0:1788869442.108033:0:5755:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c83c6f1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2125b9b3-626e-4cbe-be83-fb446e976ce2+53:10382:x1875765413055872:12345-192.168.201.39@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1788869442.108101:0:5755:0:(mdt_handler.c:8041:mdt_fid2path()) path get [0x200000401:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1788869442.108314:0:5755:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c83c6f1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2125b9b3-626e-4cbe-be83-fb446e976ce2+53:10382:x1875765413055872:12345-192.168.201.39@tcp:53:lhsmtool_posix.0 Request processed in 284us (497us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869442.108325:0:5755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 71 00000100:00100000:0.0:1788869442.111343:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1788869442.111385:0:5757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765413056128 00000100:00100000:3.0:1788869442.111399:0:5757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765413056128 00000100:00100000:3.0:1788869442.111468:0:5757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 72 00000100:00100000:3.0:1788869442.111479:0:5757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c82cdc4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2125b9b3-626e-4cbe-be83-fb446e976ce2+53:10382:x1875765413056128:12345-192.168.201.39@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788869442.111506:0:5757:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788869442.111510:0:5757:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1788869442.111546:0:5757:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94c805039c00/0x3d2d1916761d691a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.39@tcp remote: 0x375c0102490358fd expref: 53 pid: 5756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869442.111568:0:5757:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff94c81a585400) 00010000:00010000:3.0:1788869442.111575:0:5757:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788869442.111592:0:5757:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504c200/0x3d2d1916761d696e lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x375c010249035912 expref: -99 pid: 5757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1788869442.113110:0:5757:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x3:0x0], index 1: 0 00010000:00010000:2.0:1788869442.113763:0:5757:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94c805039400/0x3d2d1916761d6975 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869442.113794:0:5757:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94c805039400/0x3d2d1916761d6975 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869442.113805:0:5757:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94c805039400/0x3d2d1916761d6975 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869442.113890:0:5757:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504c200/0x3d2d1916761d696e lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0x375c010249035912 expref: 55 pid: 5757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869442.113922:0:5757:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94c805039400/0x3d2d1916761d6975 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0x375c010249035912 expref: 54 pid: 5757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869442.113938:0:5757:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff94c802f3f100) 00010000:00010000:2.0:1788869442.113941:0:5757:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788869442.113945:0:5757:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94c805039400, rc 0) 00000100:00100000:2.0:1788869442.114020:0:5757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c82cdc4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2125b9b3-626e-4cbe-be83-fb446e976ce2+54:10382:x1875765413056128:12345-192.168.201.39@tcp:101:lhsmtool_posix.0 Request processed in 2539us (2683us total) trans 4294967352 rc 0/0 00000100:00100000:2.0:1788869442.114030:0:5757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 72 00000100:00100000:0.0:1788869442.119615:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1788869442.119693:0:5756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765413056384 00000100:00100000:2.0:1788869442.119722:0:5756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765413056384 00000100:00100000:2.0:1788869442.119811:0:5756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 73 00000100:00100000:2.0:1788869442.119823:0:5756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c82cdc5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2125b9b3-626e-4cbe-be83-fb446e976ce2+54:10382:x1875765413056384:12345-192.168.201.39@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1788869442.119876:0:5756:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788869442.119902:0:5756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94c805039400/0x3d2d1916761d6975 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.39@tcp remote: 0x375c010249035912 expref: 54 pid: 5757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869442.119920:0:5756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff94c802f3f100) 00010000:00010000:2.0:1788869442.119930:0:5756:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788869442.119952:0:5756:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94c805039800/0x3d2d1916761d6983 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869442.119965:0:5756:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94c805039800/0x3d2d1916761d6983 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869442.119974:0:5756:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94c805039800/0x3d2d1916761d6983 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869442.119986:0:5756:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94c805039e00/0x3d2d1916761d698a lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0xdec54435 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869442.119993:0:5756:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94c805039e00/0x3d2d1916761d698a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0xdec54435 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869442.119998:0:5756:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94c805039e00/0x3d2d1916761d698a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0xdec54435 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869442.120069:0:5756:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94c805039800/0x3d2d1916761d6983 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869442.120077:0:5756:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94c805039800/0x3d2d1916761d6983 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869442.120090:0:5756:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94c805039800/0x3d2d1916761d6983 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869442.120096:0:5756:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94c805039800 already unused, calling callback (ffffffffc21124f0) 00010000:00010000:2.0:1788869442.120100:0:5756:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94c805039800/0x3d2d1916761d6983 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869442.120107:0:5756:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94c805039800/0x3d2d1916761d6983 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869442.120115:0:5756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff94c81a585400) 00010000:00010000:2.0:1788869442.120118:0:5756:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788869442.120122:0:5756:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94c805039800/0x3d2d1916761d6983 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869442.120128:0:5756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94c805039800/0x3d2d1916761d6983 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869442.120138:0:5756:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94c805039e00/0x3d2d1916761d698a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0xdec54435 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869442.120156:0:5756:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94c805039e00/0x3d2d1916761d698a lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xdec54435 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869442.120163:0:5756:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94c805039e00/0x3d2d1916761d698a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xdec54435 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869442.120168:0:5756:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94c805039e00 already unused, calling callback (ffffffffc21124f0) 00010000:00010000:2.0:1788869442.120171:0:5756:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94c805039e00/0x3d2d1916761d698a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xdec54435 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869442.120187:0:5756:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94c805039e00/0x3d2d1916761d698a lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xdec54435 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869442.120196:0:5756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0xdec54435 (ffff94c802f3fa00) 00010000:00010000:2.0:1788869442.120198:0:5756:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788869442.120202:0:5756:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94c805039e00/0x3d2d1916761d698a lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0xdec54435 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869442.120208:0:5756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94c805039e00/0x3d2d1916761d698a lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0xdec54435 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788869442.120340:0:5756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c82cdc5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2125b9b3-626e-4cbe-be83-fb446e976ce2+53:10382:x1875765413056384:12345-192.168.201.39@tcp:36:lhsmtool_posix.0 Request processed in 519us (739us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788869442.120349:0:5756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 73 00000100:00100000:0.0:1788869442.121845:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1788869442.122092:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765413056512 00000100:00100000:1.0:1788869442.122102:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765413056512 00000100:00100000:1.0:1788869442.122225:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 74 00000100:00100000:1.0:1788869442.122238:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c82cdc7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2125b9b3-626e-4cbe-be83-fb446e976ce2+53:10382:x1875765413056512:12345-192.168.201.39@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788869442.122336:0:5786:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788869442.122367:0:5786:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94c83fde7200/0x3d2d1916761d6991 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x375c010249035919 expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869442.122405:0:5786:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94c83fde7a00/0x3d2d1916761d6998 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869442.122417:0:5786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94c83fde7a00/0x3d2d1916761d6998 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869442.122426:0:5786:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94c83fde7a00/0x3d2d1916761d6998 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869442.122527:0:5786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94c83fde7200/0x3d2d1916761d6991 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0x375c010249035919 expref: 55 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869442.122543:0:5786:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94c83fde7a00/0x3d2d1916761d6998 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0x375c010249035919 expref: 54 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869442.122550:0:5786:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff94c81a585900) 00010000:00010000:1.0:1788869442.122552:0:5786:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1788869442.122555:0:5786:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94c83fde7a00, rc 0) 00000100:00100000:1.0:1788869442.122654:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c82cdc7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2125b9b3-626e-4cbe-be83-fb446e976ce2+54:10382:x1875765413056512:12345-192.168.201.39@tcp:101:lhsmtool_posix.0 Request processed in 420us (818us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869442.122660:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 74 00000100:00100000:1.0:1788869442.124572:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1788869442.124646:0:5755:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765413056768 00000100:00100000:3.0:1788869442.124658:0:5755:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765413056768 00000100:00100000:3.0:1788869442.124715:0:5755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 75 00000100:00100000:3.0:1788869442.124724:0:5755:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c810731c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2125b9b3-626e-4cbe-be83-fb446e976ce2+54:10382:x1875765413056768:12345-192.168.201.39@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1788869442.124810:0:5755:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504d800/0x3d2d1916761d699f lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869442.124824:0:5755:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504d800/0x3d2d1916761d699f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869442.124890:0:5755:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504d800/0x3d2d1916761d699f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788869442.125100:0:5755:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].3, 88 off8408 00000004:00080000:3.0:1788869442.125107:0:5755:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 190416856956ns, next at 191416854843ns, rc = 0 00000004:00010000:3.0:1788869442.125190:0:5755:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000ba0366c6 reply state 00000000cd198d89 transno 4294967353 ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504d800/0x3d2d1916761d699f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788869442.125199:0:5755:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788869442.125330:0:5755:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c810731c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2125b9b3-626e-4cbe-be83-fb446e976ce2+56:10382:x1875765413056768:12345-192.168.201.39@tcp:36:lhsmtool_posix.0 Request processed in 606us (764us total) trans 4294967353 rc 0/0 00000100:00100000:3.0:1788869442.125339:0:5755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 75 00000100:00100000:0.0:1788869442.126751:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1788869442.126811:0:5757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765413056896 00000100:00100000:2.0:1788869442.126818:0:5757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765413056896 00010000:00010000:1.0:1788869442.126845:0:3270:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504d800/0x3d2d1916761d699f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788869442.126875:0:5757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 76 00010000:00010000:1.0:1788869442.126875:0:3270:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504d800/0x3d2d1916761d699f lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788869442.126893:0:5757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c82d042a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2125b9b3-626e-4cbe-be83-fb446e976ce2+56:10382:x1875765413056896:12345-192.168.201.39@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788869442.126893:0:3270:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504d800/0x3d2d1916761d699f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869442.126918:0:5757:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788869442.126924:0:3270:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94c83504d800 already unused, calling callback (ffffffffc21124f0) 00010000:00010000:1.0:1788869442.126934:0:3270:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504d800/0x3d2d1916761d699f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869442.126935:0:5757:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94c805039e00/0x3d2d1916761d69a6 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x375c010249035920 expref: -99 pid: 5757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869442.126975:0:3270:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504d800/0x3d2d1916761d699f lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869442.126994:0:3270:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff94c81a585900) 00010000:00010000:1.0:1788869442.126997:0:3270:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1788869442.127002:0:3270:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504d800/0x3d2d1916761d699f lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869442.127007:0:3270:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504d800/0x3d2d1916761d699f lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869442.127031:0:5757:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94c805039e00/0x3d2d1916761d69a6 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.39@tcp remote: 0x375c010249035920 expref: 56 pid: 5757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869442.127048:0:5757:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94c805039e00/0x3d2d1916761d69a6 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.39@tcp remote: 0x375c010249035920 expref: 56 pid: 5757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869442.127092:0:5757:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff94c81a585900) 00010000:00010000:2.0:1788869442.127095:0:5757:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788869442.127099:0:5757:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94c805039e00, rc 0) 00000100:00100000:2.0:1788869442.127147:0:5757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c82d042a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2125b9b3-626e-4cbe-be83-fb446e976ce2+56:10382:x1875765413056896:12345-192.168.201.39@tcp:101:lhsmtool_posix.0 Request processed in 260us (401us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869442.127155:0:5757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 76 00000100:00100000:0.0:1788869442.128548:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1788869442.128671:0:7884:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765413057024 00000100:00100000:2.0:1788869442.128681:0:7884:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765413057024 00000100:00100000:2.0:1788869442.128774:0:7884:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 24 00000100:00100000:2.0:1788869442.128784:0:7884:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c8349eed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2344:x1875765413057024:12345-192.168.201.39@tcp:8:lhsmtool_posix.0 00010000:00080000:2.0:1788869442.128823:0:7884:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0001: connection from 2125b9b3-626e-4cbe-be83-fb446e976ce2@192.168.201.39@tcp t0 exp 0000000000000000 cur 190 last 0 00000020:00000080:2.0:1788869442.128859:0:7884:0:(genops.c:1406:class_connect()) connect: client 2125b9b3-626e-4cbe-be83-fb446e976ce2, cookie 0x3d2d1916761d69ad 00002000:00100000:2.0:1788869442.128886:0:7884:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 2125b9b3-626e-4cbe-be83-fb446e976ce2/ffff94c834d63000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113718 ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1788869442.128910:0:7884:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:2.0:1788869442.129208:0:7884:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1788869442.129245:0:7884:0:(import.c:65:import_set_state_nolock()) ffff94c834d60000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788869442.129366:0:7884:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c8349eed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:2125b9b3-626e-4cbe-be83-fb446e976ce2+6:2344:x1875765413057024:12345-192.168.201.39@tcp:8:lhsmtool_posix.0 Request processed in 581us (824us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869442.129376:0:7884:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 24 00000100:00100000:0.0:1788869442.133705:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1788869442.133754:0:6544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765413057152 00000100:00100000:1.0:1788869442.133775:0:6544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765413057152 00000100:00080000:2.0:1788869442.133887:0:5751:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788869442.133922:0:6544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 25 00000100:00100000:1.0:1788869442.133935:0:6544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c82065f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2125b9b3-626e-4cbe-be83-fb446e976ce2+6:0:x1875765413057152:12345-192.168.201.39@tcp:2:lhsmtool_posix.0 00000001:00080000:0.0:1788869442.163344:0:7458:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967301 is committed 00000001:00100000:0.0:1788869442.163365:0:7458:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 2125b9b3-626e-4cbe-be83-fb446e976ce2 00000100:00100000:1.0:1788869442.163470:0:6544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c82065f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2125b9b3-626e-4cbe-be83-fb446e976ce2+5:0:x1875765413057152:12345-192.168.201.39@tcp:2:lhsmtool_posix.0 Request processed in 29528us (29765us total) trans 4294967301 rc 0/0 00000100:00100000:1.0:1788869442.163485:0:6544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 25 00000100:00100000:1.0:1788869442.165141:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1788869442.165287:0:5758:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765413057408 00000100:00100000:0.0:1788869442.165299:0:5758:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765413057408 00000100:00100000:0.0:1788869442.165363:0:5758:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 19 00000100:00100000:0.0:1788869442.165373:0:5758:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c810732d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2125b9b3-626e-4cbe-be83-fb446e976ce2+56:10382:x1875765413057408:12345-192.168.201.39@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1788869442.165630:0:5758:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c810732d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2125b9b3-626e-4cbe-be83-fb446e976ce2+57:10382:x1875765413057408:12345-192.168.201.39@tcp:35:lhsmtool_posix.0 Request processed in 259us (495us total) trans 4294967354 rc 0/0 00000100:00100000:0.0:1788869442.165637:0:5758:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 19 00000100:00100000:0.0:1788869442.169335:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1788869442.169390:0:5755:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765413057664 00000100:00100000:3.0:1788869442.169402:0:5755:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765413057664 00000100:00100000:3.0:1788869442.169462:0:5755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 77 00000100:00100000:3.0:1788869442.169469:0:5755:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c702349f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2125b9b3-626e-4cbe-be83-fb446e976ce2+57:10382:x1875765413057664:12345-192.168.201.39@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1788869442.169567:0:5755:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c702349f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2125b9b3-626e-4cbe-be83-fb446e976ce2+57:10382:x1875765413057664:12345-192.168.201.39@tcp:57:lhsmtool_posix.0 Request processed in 97us (247us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869442.169575:0:5755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 77 00000100:00100000:2.0:1788869442.171848:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1788869442.171945:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765413057792 00000100:00100000:3.0:1788869442.171953:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765413057792 00000100:00100000:3.0:1788869442.172027:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 78 00000100:00100000:3.0:1788869442.172036:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c82c843b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2125b9b3-626e-4cbe-be83-fb446e976ce2+57:10382:x1875765413057792:12345-192.168.201.39@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788869442.172051:0:5786:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788869442.172067:0:5786:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504c000/0x3d2d1916761d69b4 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x375c010249035927 expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869442.172132:0:5786:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504c400/0x3d2d1916761d69bb lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869442.172145:0:5786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504c400/0x3d2d1916761d69bb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869442.172156:0:5786:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504c400/0x3d2d1916761d69bb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788869442.172193:0:5786:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1788869442.172210:0:5786:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504c400/0x3d2d1916761d69bb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869442.172235:0:5786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504c000/0x3d2d1916761d69b4 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0x375c010249035927 expref: 59 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869442.172246:0:5786:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504c400/0x3d2d1916761d69bb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0x375c010249035927 expref: 58 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869442.172275:0:5786:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff94c81a585900) 00010000:00010000:3.0:1788869442.172278:0:5786:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1788869442.172281:0:5786:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94c83504c400, rc 0) 00000100:00100000:3.0:1788869442.172321:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c82c843b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2125b9b3-626e-4cbe-be83-fb446e976ce2+58:10382:x1875765413057792:12345-192.168.201.39@tcp:101:lhsmtool_posix.0 Request processed in 287us (484us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869442.172326:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 78 00000100:00100000:0.0:1788869442.178485:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1788869442.178632:0:6546:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765413057920 00000100:00100000:2.0:1788869442.178650:0:6546:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765413057920 00000100:00100000:2.0:1788869442.178848:0:6546:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 26 00000100:00100000:2.0:1788869442.178859:0:6546:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c702349500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2125b9b3-626e-4cbe-be83-fb446e976ce2+5:2347:x1875765413057920:12345-192.168.201.39@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788869442.178888:0:6546:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788869442.178910:0:6546:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000eab914c0/0x3d2d1916761d69c2 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x375c01024903592e expref: -99 pid: 6546 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788869442.178935:0:6546:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a9ffb40, blocks: 0x1 00010000:00010000:2.0:1788869442.178952:0:6546:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=190s v=(0 0) 00010000:00010000:2.0:1788869442.178957:0:6546:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788869442.178966:0:6546:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000eab914c0/0x3d2d1916761d69c2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.39@tcp remote: 0x375c01024903592e expref: 6 pid: 6546 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869442.178983:0:6546:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000eab914c0/0x3d2d1916761d69c2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.39@tcp remote: 0x375c01024903592e expref: 6 pid: 6546 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869442.178996:0:6546:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94c805038800, rc 0) 00000100:00100000:2.0:1788869442.179086:0:6546:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c702349500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2125b9b3-626e-4cbe-be83-fb446e976ce2+6:2347:x1875765413057920:12345-192.168.201.39@tcp:101:lhsmtool_posix.0 Request processed in 229us (608us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869442.179093:0:6546:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 26 00000100:00100000:0.0:1788869442.183775:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1788869442.184021:0:5755:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765413058176 00000100:00100000:3.0:1788869442.184032:0:5755:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765413058176 00000100:00100000:3.0:1788869442.184095:0:5755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 79 00000100:00100000:3.0:1788869442.184122:0:5755:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c810e6ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2125b9b3-626e-4cbe-be83-fb446e976ce2+58:10382:x1875765413058176:12345-192.168.201.39@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1788869442.184231:0:5755:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c810e6ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2125b9b3-626e-4cbe-be83-fb446e976ce2+58:10382:x1875765413058176:12345-192.168.201.39@tcp:57:lhsmtool_posix.0 Request processed in 110us (475us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869442.184239:0:5755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 79 00000100:00100000:2.0:1788869442.186752:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1788869442.186822:0:6547:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765413058304 00000100:00100000:3.0:1788869442.186829:0:6547:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765413058304 00000100:00100000:3.0:1788869442.186879:0:6547:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 27 00000100:00100000:3.0:1788869442.186895:0:6547:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c82c842a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2125b9b3-626e-4cbe-be83-fb446e976ce2+6:10382:x1875765413058304:12345-192.168.201.39@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788869442.186912:0:6547:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788869442.186930:0:6547:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fb48b48d/0x3d2d1916761d69c9 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x375c010249035935 expref: -99 pid: 6547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869442.186964:0:6547:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000eab914c0/0x3d2d1916761d69c2 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.39@tcp remote: 0x375c01024903592e expref: 7 pid: 6546 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869442.186972:0:6547:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788869442.186977:0:6547:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788869442.186982:0:6547:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fb48b48d/0x3d2d1916761d69c9 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.201.39@tcp remote: 0x375c010249035935 expref: 7 pid: 6547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869442.187025:0:6547:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000eab914c0/0x3d2d1916761d69c2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.39@tcp remote: 0x375c01024903592e expref: 7 pid: 6546 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869442.187039:0:6547:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000eab914c0/0x3d2d1916761d69c2 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.39@tcp remote: 0x375c01024903592e expref: 7 pid: 6546 timeout: 290 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788869442.187077:0:6547:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94c82cedb480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6547:1875765421461120:192.168.201.39@tcp:104: 00000100:00100000:3.0:1788869442.187223:0:6547:0:(client.c:2702:ptlrpc_set_wait()) set ffff94c8357d56c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788869442.190862:0:6547:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94c82cedb480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6547:1875765421461120:192.168.201.39@tcp:104: 00000100:00100000:0.0:1788869442.190881:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00010000:00010000:3.0:1788869442.190905:0:6547:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000fb48b48d/0x3d2d1916761d69c9 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.39@tcp remote: 0x375c010249035935 expref: 7 pid: 6547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869442.190926:0:6547:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94c83504c000, rc 0) 00000100:00100000:2.0:1788869442.190940:0:5739:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765413058432 00000100:00100000:2.0:1788869442.190949:0:5739:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765413058432 00010000:00010000:2.0:1788869442.190982:0:5739:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000eab914c0/0x3d2d1916761d69c2 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.39@tcp remote: 0x375c01024903592e expref: 8 pid: 6546 timeout: 290 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788869442.191014:0:5739:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 43 00000100:00100000:3.0:1788869442.191022:0:6547:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c82c842a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2125b9b3-626e-4cbe-be83-fb446e976ce2+8:10382:x1875765413058304:12345-192.168.201.39@tcp:101:lhsmtool_posix.0 Request processed in 4133us (4272us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869442.191024:0:5739:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c810ef0c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2125b9b3-626e-4cbe-be83-fb446e976ce2+8:2348:x1875765413058432:12345-192.168.201.39@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1788869442.191038:0:6547:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 27 00010000:00010000:2.0:1788869442.191050:0:5739:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788869442.191073:0:5739:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000eab914c0/0x3d2d1916761d69c2 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.39@tcp remote: 0x375c01024903592e expref: 7 pid: 6546 timeout: 290 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869442.191089:0:5739:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000eab914c0/0x3d2d1916761d69c2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.39@tcp remote: 0x375c01024903592e expref: 7 pid: 6546 timeout: 290 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869442.191111:0:5739:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000eab914c0/0x3d2d1916761d69c2 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.39@tcp remote: 0x375c01024903592e expref: 7 pid: 6546 timeout: 290 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869442.191124:0:5739:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788869442.191137:0:5739:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788869442.191146:0:5739:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000fb48b48d/0x3d2d1916761d69c9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.39@tcp remote: 0x375c010249035935 expref: 6 pid: 6547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869442.191155:0:5739:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fb48b48d/0x3d2d1916761d69c9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.39@tcp remote: 0x375c010249035935 expref: 6 pid: 6547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869442.191187:0:5739:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000fb48b48d/0x3d2d1916761d69c9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.39@tcp remote: 0x375c010249035935 expref: 6 pid: 6547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788869442.191200:0:5739:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94c82c841180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5739:1875765421461248:192.168.201.39@tcp:105: 00000100:00100000:2.0:1788869442.191244:0:5739:0:(client.c:2702:ptlrpc_set_wait()) set ffff94c807dffb40 going to sleep for 11 seconds 00000100:00100000:2.0:1788869442.193291:0:5739:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94c82c841180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5739:1875765421461248:192.168.201.39@tcp:105: 00010000:00010000:2.0:1788869442.193308:0:5739:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788869442.193349:0:5739:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c810ef0c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2125b9b3-626e-4cbe-be83-fb446e976ce2+6:2348:x1875765413058432:12345-192.168.201.39@tcp:103:ldlm_bl.0 Request processed in 2328us (2471us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869442.193357:0:5739:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 43 00000100:00100000:2.0:1788869442.193585:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1788869442.193801:0:6552:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765413058560 00000100:00100000:1.0:1788869442.193807:0:6552:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765413058560 00002000:00100000:1.0:1788869442.193845:0:6552:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3:0x0] (0->8) req@ffff94c82c841180 x1875765413058560/t0(0) o4->2125b9b3-626e-4cbe-be83-fb446e976ce2@192.168.201.39@tcp:388/0 lens 504/0 e 0 to 0 dl 1788869453 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788869442.193852:0:6552:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff94c82c841180 with x1875765413058560 ext(0->8) 00002000:00010000:1.0:1788869442.193855:0:6552:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff94c82c841180 00000100:00100000:1.0:1788869442.193903:0:6552:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 0 00000100:00100000:1.0:1788869442.193910:0:6552:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c82c841180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:2125b9b3-626e-4cbe-be83-fb446e976ce2+6:2346:x1875765413058560:12345-192.168.201.39@tcp:4:lhsmtool_posix.0 00000100:00100000:1.0:1788869442.195727:0:6552:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c82c841180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:2125b9b3-626e-4cbe-be83-fb446e976ce2+8:2346:x1875765413058560:12345-192.168.201.39@tcp:4:lhsmtool_posix.0 Request processed in 1812us (2136us total) trans 4294967302 rc 0/0 00000100:00100000:1.0:1788869442.195735:0:6552:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 0 00002000:00100000:1.0:1788869442.195742:0:6552:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3:0x0] (0->8) req@ffff94c82c841180 x1875765413058560/t4294967302(0) o4->2125b9b3-626e-4cbe-be83-fb446e976ce2@192.168.201.39@tcp:388/0 lens 504/448 e 0 to 0 dl 1788869453 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788869442.195748:0:6552:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff94c82c841180 with x1875765413058560 ext(0->8) 00002000:00010000:1.0:1788869442.195753:0:6552:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff94c82c841180 00000100:00100000:0.0:1788869442.199670:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1788869442.199782:0:5757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765413058688 00000100:00100000:1.0:1788869442.199792:0:5757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765413058688 00000100:00100000:1.0:1788869442.199853:0:5757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 80 00000100:00100000:1.0:1788869442.199865:0:5757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c82cda8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2125b9b3-626e-4cbe-be83-fb446e976ce2+58:10382:x1875765413058688:12345-192.168.201.39@tcp:44:lhsmtool_posix.0 00000001:00080000:3.0:1788869442.223573:0:5777:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967354 is committed 00000004:00080000:3.0:1788869442.223671:0:5777:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2 committed 00000100:00100000:1.0:1788869442.223707:0:5757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c82cda8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2125b9b3-626e-4cbe-be83-fb446e976ce2+47:10382:x1875765413058688:12345-192.168.201.39@tcp:44:lhsmtool_posix.0 Request processed in 23838us (24038us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869442.223718:0:5757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 80 00000020:00080000:3.0:1788869442.223757:0:5777:0:(update_trans.c:58:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff94c803146000 refcount 2 committed 0 result 0 batchid 1 00000020:00080000:3.0:1788869442.223775:0:5777:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff94c810eb8600 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff94c803146e40 00000020:00080000:3.0:1788869442.223779:0:5777:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff94c810eb8000 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff94c82ce9f800 00000020:00080000:1.0:1788869442.223800:0:5791:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 1 committed batchid 0 00000004:00080000:3.0:1788869442.223811:0:5777:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 4 committed 00000100:00100000:2.0:1788869442.223823:0:3285:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788869442.223842:0:3285:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94c82cdab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3285:1875765421461376:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1788869442.223902:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869442.223938:0:6546:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765421461376 00000100:00100000:3.0:1788869442.223946:0:6546:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765421461376 00000100:00080000:2.0:1788869442.223977:0:5751:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788869442.224003:0:6546:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1788869442.224013:0:6546:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c82c841500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3285:x1875765421461376:12345-0@lo:6:osp-syn-0-0.0 00000020:00080000:1.0:1788869442.224048:0:5791:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000100:00100000:2.0:1788869442.224124:0:3284:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788869442.224135:0:3284:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94c810731500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3284:1875765421461504:0@lo:2:osp-syn-1-0.0 00002000:00080000:3.0:1788869442.224153:0:6546:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:2 count 1 00000100:00100000:2.0:1788869442.224165:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00010000:3.0:1788869442.224182:0:6546:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x2:0x0] initial LVB size: 13, mtime: 0x6a9ffb3f, atime: 0x6a9ffb3f, ctime: 0x6a9ffb3f, blocks: 0x1 00010000:00010000:3.0:1788869442.224191:0:6546:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002376f634/0x3d2d1916761d69d0 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6546 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788869442.224197:0:6544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765421461504 00000100:00100000:1.0:1788869442.224207:0:6544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765421461504 00010000:00010000:3.0:1788869442.224214:0:6546:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=190s v=(0 0) 00010000:00010000:3.0:1788869442.224220:0:6546:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788869442.224227:0:6546:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002376f634/0x3d2d1916761d69d0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6546 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788869442.224235:0:6544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1788869442.224243:0:6544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c82c840000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3284:x1875765421461504:12345-0@lo:2:osp-syn-1-0.0 00010000:00010000:3.0:1788869442.224286:0:6546:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002376f634/0x3d2d1916761d69d0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6546 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788869442.224359:0:6544:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:1.0:1788869442.224362:0:6544:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb mtime from disk: 0 -> 1788869440 00002000:00010000:1.0:1788869442.224364:0:6544:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1788869442.224365:0:6544:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb ctime from disk: 1788869440 -> 1788869440 00002000:00010000:1.0:1788869442.224366:0:6544:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:1.0:1788869442.224397:0:6544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c82c840000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3284:x1875765421461504:12345-0@lo:2:osp-syn-1-0.0 Request processed in 156us (232us total) trans 4294967303 rc 0/0 00000100:00100000:1.0:1788869442.224402:0:6544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000004:00080000:0.0:1788869442.224426:0:3284:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94c810731500/2, rc 0, transno 4294967303 00000100:00100000:0.0:1788869442.224435:0:3284:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94c810731500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3284:1875765421461504:0@lo:2:osp-syn-1-0.0 00010000:00010000:3.0:1788869442.224586:0:6546:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002376f634/0x3d2d1916761d69d0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6546 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869442.224602:0:6546:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002376f634/0x3d2d1916761d69d0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6546 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869442.224622:0:6546:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788869442.224642:0:5743:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788869442.224649:0:5743:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002376f634/0x3d2d1916761d69d0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6546 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869442.224660:0:5743:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94c83504d800 already unused, calling callback (ffffffffc1703220) 00010000:00010000:0.0:1788869442.224665:0:5743:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002376f634/0x3d2d1916761d69d0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6546 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869442.224675:0:5743:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002376f634/0x3d2d1916761d69d0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6546 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869442.224692:0:5743:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002376f634/0x3d2d1916761d69d0 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6546 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869442.224701:0:5743:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002376f634/0x3d2d1916761d69d0 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6546 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869442.224731:0:5743:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788869442.224733:0:5743:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788869442.224735:0:5743:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788869442.225635:0:6546:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c82c841500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3285:x1875765421461376:12345-0@lo:6:osp-syn-0-0.0 Request processed in 1621us (1732us total) trans 4294967301 rc 0/0 00000100:00100000:3.0:1788869442.225645:0:6546:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000004:00080000:0.0:1788869442.225660:0:3285:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94c82cdab800/2, rc 0, transno 4294967301 00000100:00100000:0.0:1788869442.225669:0:3285:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94c82cdab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3285:1875765421461376:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1788869442.226691:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1788869442.226737:0:7884:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765413058816 00000100:00100000:1.0:1788869442.226744:0:7884:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765413058816 00000100:00100000:1.0:1788869442.226790:0:7884:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 30 00000100:00100000:1.0:1788869442.226799:0:7884:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c82cdaa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:2125b9b3-626e-4cbe-be83-fb446e976ce2+8:2347:x1875765413058816:12345-192.168.201.39@tcp:16:lhsmtool_posix.0 00000100:00100000:1.0:1788869442.255425:0:7884:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c82cdaa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:2125b9b3-626e-4cbe-be83-fb446e976ce2+8:2347:x1875765413058816:12345-192.168.201.39@tcp:16:lhsmtool_posix.0 Request processed in 28617us (28728us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869442.255442:0:7884:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 30 00000001:00080000:0.0:1788869442.256396:0:7458:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967303 is committed 00000001:00080000:0.0:1788869442.256407:0:7458:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967302 is committed 00000100:00100000:0.0:1788869442.259597:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1788869442.259699:0:5756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765413059072 00000100:00100000:2.0:1788869442.259709:0:5756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765413059072 00000100:00100000:2.0:1788869442.259835:0:5756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 81 00000100:00100000:2.0:1788869442.259848:0:5756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c82cda9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2125b9b3-626e-4cbe-be83-fb446e976ce2+13:10382:x1875765413059072:12345-192.168.201.39@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1788869442.259904:0:5756:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788869442.259933:0:5756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504c400/0x3d2d1916761d69bb lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.39@tcp remote: 0x375c010249035927 expref: 13 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869442.259951:0:5756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff94c81a585900) 00010000:00010000:2.0:1788869442.259956:0:5756:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788869442.259989:0:5756:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94c805038800/0x3d2d1916761d69d7 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869442.260004:0:5756:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94c805038800/0x3d2d1916761d69d7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869442.260014:0:5756:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94c805038800/0x3d2d1916761d69d7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788869442.260287:0:5756:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000009173e07b reply state 00000000c2a936c1 transno 4294967355 ns: mdt-lustre-MDT0000_UUID lock: ffff94c805038800/0x3d2d1916761d69d7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788869442.260298:0:5756:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788869442.260394:0:5756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c82cda9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2125b9b3-626e-4cbe-be83-fb446e976ce2+14:10382:x1875765413059072:12345-192.168.201.39@tcp:36:lhsmtool_posix.0 Request processed in 548us (803us total) trans 4294967355 rc 0/0 00000100:00100000:2.0:1788869442.260401:0:5756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 81 00010000:00010000:2.0:1788869442.261836:0:3269:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94c805038800/0x3d2d1916761d69d7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869442.261848:0:3269:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94c805038800/0x3d2d1916761d69d7 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869442.261855:0:3269:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94c805038800/0x3d2d1916761d69d7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869442.261860:0:3269:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94c805038800 already unused, calling callback (ffffffffc21124f0) 00010000:00010000:2.0:1788869442.261865:0:3269:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94c805038800/0x3d2d1916761d69d7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869442.261872:0:3269:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94c805038800/0x3d2d1916761d69d7 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869442.261885:0:3269:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff94c81a585900) 00010000:00010000:2.0:1788869442.261888:0:3269:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788869442.261892:0:3269:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94c805038800/0x3d2d1916761d69d7 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869442.261899:0:3269:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94c805038800/0x3d2d1916761d69d7 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788869442.262099:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1788869442.262145:0:6544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765413059200 00000100:00100000:3.0:1788869442.262152:0:6544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765413059200 00000100:00100000:3.0:1788869442.262198:0:6544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 31 00000100:00100000:3.0:1788869442.262279:0:6544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c82cdabb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2125b9b3-626e-4cbe-be83-fb446e976ce2+6:2346:x1875765413059200:12345-192.168.201.39@tcp:2:lhsmtool_posix.0 00002000:00010000:3.0:1788869442.262519:0:6544:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb size from disk: 9 -> 9 00002000:00010000:3.0:1788869442.262523:0:6544:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb mtime from disk: 1788869440 -> 1788869440 00002000:00010000:3.0:1788869442.262526:0:6544:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb atime from disk: 0 -> 1788869439 00002000:00010000:3.0:1788869442.262534:0:6544:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb ctime from disk: 1788869440 -> 1788869440 00002000:00010000:3.0:1788869442.262536:0:6544:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:3.0:1788869442.262590:0:6544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c82cdabb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2125b9b3-626e-4cbe-be83-fb446e976ce2+7:2346:x1875765413059200:12345-192.168.201.39@tcp:2:lhsmtool_posix.0 Request processed in 346us (492us total) trans 4294967304 rc 0/0 00000100:00100000:3.0:1788869442.262599:0:6544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 31 00000100:00100000:3.0:1788869442.265850:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1788869442.265894:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765413059456 00000100:00100000:1.0:1788869442.265903:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765413059456 00000100:00100000:1.0:1788869442.265962:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 82 00000100:00100000:1.0:1788869442.265973:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c82cedb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2125b9b3-626e-4cbe-be83-fb446e976ce2+13:10382:x1875765413059456:12345-192.168.201.39@tcp:55:lhsmtool_posix.0 00010000:00010000:1.0:1788869442.266031:0:5786:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94c83fde7600/0x3d2d1916761d69de lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869442.266272:0:5786:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff94c83fde7a00/0x3d2d1916761d6998 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0x375c010249035919 expref: 13 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869442.266300:0:5786:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff94c83fde7600/0x3d2d1916761d69de lrc: 4/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869442.266338:0:5786:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff94c83fde7a00/0x3d2d1916761d6998 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.39@tcp remote: 0x375c010249035919 expref: 13 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869442.266353:0:5786:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff94c83fde7a00/0x3d2d1916761d6998 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.39@tcp remote: 0x375c010249035919 expref: 13 pid: 5786 timeout: 290 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788869442.266379:0:5786:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94c810733100 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:5786:1875765421461632:192.168.201.39@tcp:104: 00000100:00100000:1.0:1788869442.266466:0:5786:0:(client.c:2702:ptlrpc_set_wait()) set ffff94c803146540 going to sleep for 11 seconds 00000100:00100000:3.0:1788869442.269841:0:5786:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94c810733100 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:5786:1875765421461632:192.168.201.39@tcp:104: 00000100:00100000:0.0:1788869442.269860:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00010000:00010000:3.0:1788869442.269874:0:5786:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff94c83fde7600/0x3d2d1916761d69de lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788869442.269899:0:7448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765413059584 00000100:00100000:0.0:1788869442.269908:0:7448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765413059584 00010000:00010000:0.0:1788869442.269945:0:7448:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff94c83fde7a00/0x3d2d1916761d6998 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.39@tcp remote: 0x375c010249035919 expref: 14 pid: 5786 timeout: 290 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788869442.269984:0:7448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 44 00000100:00100000:0.0:1788869442.270009:0:7448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c82cda8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:2125b9b3-626e-4cbe-be83-fb446e976ce2+14:2347:x1875765413059584:12345-192.168.201.39@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788869442.270025:0:7448:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788869442.270032:0:7448:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff94c83fde7a00/0x3d2d1916761d6998 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.39@tcp remote: 0x375c010249035919 expref: 14 pid: 5786 timeout: 290 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869442.270045:0:7448:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff94c83fde7a00/0x3d2d1916761d6998 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.39@tcp remote: 0x375c010249035919 expref: 14 pid: 5786 timeout: 290 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869442.270066:0:7448:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94c83fde7a00/0x3d2d1916761d6998 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.39@tcp remote: 0x375c010249035919 expref: 14 pid: 5786 timeout: 290 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869442.270087:0:7448:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff94c81a585900) 00010000:00010000:0.0:1788869442.270091:0:7448:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff94c83fde7600/0x3d2d1916761d69de lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869442.270101:0:7448:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff94c83fde7600/0x3d2d1916761d69de lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869442.270110:0:7448:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94c83fde7600/0x3d2d1916761d69de lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869442.270136:0:7448:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788869442.270158:0:5786:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff94c83fde7600/0x3d2d1916761d69de lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869442.270165:0:5786:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94c83fde7600/0x3d2d1916761d69de lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788869442.270194:0:7448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c82cda8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:2125b9b3-626e-4cbe-be83-fb446e976ce2+13:2347:x1875765413059584:12345-192.168.201.39@tcp:103:ldlm_bl.0 Request processed in 200us (347us total) trans 0 rc 0/0 00010000:00010000:3.0:1788869442.270199:0:5786:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94c83fde7600/0x3d2d1916761d69de lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788869442.270205:0:7448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 44 00010000:00010000:3.0:1788869442.270213:0:5786:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94c83fde7600/0x3d2d1916761d69de lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869442.270221:0:5786:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94c83fde7600/0x3d2d1916761d69de lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869442.270228:0:5786:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94c83fde7600 already unused, calling callback (ffffffffc21124f0) 00010000:00010000:3.0:1788869442.270234:0:5786:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94c83fde7600/0x3d2d1916761d69de lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869442.270241:0:5786:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94c83fde7600/0x3d2d1916761d69de lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869442.270299:0:5786:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff94c81a585900) 00010000:00010000:3.0:1788869442.270302:0:5786:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:3.0:1788869442.270306:0:5786:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94c83fde7600/0x3d2d1916761d69de lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869442.270312:0:5786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94c83fde7600/0x3d2d1916761d69de lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788869442.270398:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c82cedb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2125b9b3-626e-4cbe-be83-fb446e976ce2+12:10382:x1875765413059456:12345-192.168.201.39@tcp:55:lhsmtool_posix.0 Request processed in 4426us (4553us total) trans 0 rc -22/-22 00000100:00100000:3.0:1788869442.270406:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 82 00000100:00100000:2.0:1788869442.274461:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1788869442.274519:0:6547:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765413059712 00000100:00100000:3.0:1788869442.274528:0:6547:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765413059712 00000100:00100000:3.0:1788869442.274578:0:6547:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 32 00000100:00100000:3.0:1788869442.274588:0:6547:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c82cdc4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2125b9b3-626e-4cbe-be83-fb446e976ce2+7:2348:x1875765413059712:12345-192.168.201.39@tcp:1:lhsmtool_posix.0 00010000:00010000:3.0:1788869442.274632:0:6547:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000ff0131d3/0x3d2d1916761d69e5 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869442.274666:0:6547:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000fb48b48d/0x3d2d1916761d69c9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.39@tcp remote: 0x375c010249035935 expref: 7 pid: 6547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869442.274674:0:6547:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788869442.274679:0:6547:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788869442.274683:0:6547:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ff0131d3/0x3d2d1916761d69e5 lrc: 4/1,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869442.274718:0:6547:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000fb48b48d/0x3d2d1916761d69c9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.201.39@tcp remote: 0x375c010249035935 expref: 7 pid: 6547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869442.274739:0:6547:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000fb48b48d/0x3d2d1916761d69c9 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.201.39@tcp remote: 0x375c010249035935 expref: 7 pid: 6547 timeout: 290 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788869442.274750:0:6547:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94c82ced9c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6547:1875765421461760:192.168.201.39@tcp:104: 00000100:00100000:3.0:1788869442.274831:0:6547:0:(client.c:2702:ptlrpc_set_wait()) set ffff94c8357d5b40 going to sleep for 11 seconds 00000100:00100000:3.0:1788869442.277740:0:6547:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94c82ced9c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6547:1875765421461760:192.168.201.39@tcp:104: 00010000:00010000:3.0:1788869442.277783:0:6547:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000ff0131d3/0x3d2d1916761d69e5 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788869442.278524:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1788869442.278579:0:5741:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765413059840 00000100:00100000:3.0:1788869442.278588:0:5741:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765413059840 00010000:00010000:3.0:1788869442.278938:0:5741:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000fb48b48d/0x3d2d1916761d69c9 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.39@tcp remote: 0x375c010249035935 expref: 8 pid: 6547 timeout: 290 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788869442.278992:0:5741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 45 00000100:00100000:3.0:1788869442.279000:0:5741:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c82cda8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2125b9b3-626e-4cbe-be83-fb446e976ce2+8:2348:x1875765413059840:12345-192.168.201.39@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788869442.279013:0:5741:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788869442.279035:0:5741:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000fb48b48d/0x3d2d1916761d69c9 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.39@tcp remote: 0x375c010249035935 expref: 8 pid: 6547 timeout: 290 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869442.279422:0:5741:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000fb48b48d/0x3d2d1916761d69c9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.201.39@tcp remote: 0x375c010249035935 expref: 8 pid: 6547 timeout: 290 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869442.279448:0:5741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fb48b48d/0x3d2d1916761d69c9 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.201.39@tcp remote: 0x375c010249035935 expref: 8 pid: 6547 timeout: 290 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869442.279567:0:5741:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788869442.279572:0:5741:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788869442.279578:0:5741:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000ff0131d3/0x3d2d1916761d69e5 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869442.279588:0:5741:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ff0131d3/0x3d2d1916761d69e5 lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869442.279612:0:5741:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788869442.279706:0:5741:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c82cda8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2125b9b3-626e-4cbe-be83-fb446e976ce2+7:2348:x1875765413059840:12345-192.168.201.39@tcp:103:ldlm_bl.0 Request processed in 706us (1184us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869442.279714:0:5741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 45 00010000:00010000:0.0:1788869442.279800:0:6547:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000ff0131d3/0x3d2d1916761d69e5 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869442.279812:0:6547:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ff0131d3/0x3d2d1916761d69e5 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869442.279839:0:6547:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000ff0131d3/0x3d2d1916761d69e5 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869442.279848:0:6547:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ff0131d3/0x3d2d1916761d69e5 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869442.279869:0:6547:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ff0131d3/0x3d2d1916761d69e5 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869442.279877:0:6547:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94c83504c200 already unused, calling callback (ffffffffc1703220) 00010000:00010000:0.0:1788869442.279881:0:6547:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ff0131d3/0x3d2d1916761d69e5 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869442.279891:0:6547:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ff0131d3/0x3d2d1916761d69e5 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869442.279907:0:6547:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ff0131d3/0x3d2d1916761d69e5 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869442.279915:0:6547:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ff0131d3/0x3d2d1916761d69e5 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788869442.282888:0:6547:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c82cdc4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2125b9b3-626e-4cbe-be83-fb446e976ce2+6:2348:x1875765413059712:12345-192.168.201.39@tcp:1:lhsmtool_posix.0 Request processed in 8291us (8422us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869442.282902:0:6547:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 32 00000100:00100000:0.0:1788869442.287358:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1788869442.287430:0:5755:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765413060096 00000100:00100000:3.0:1788869442.287447:0:5755:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765413060096 00000100:00100000:3.0:1788869442.287534:0:5755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 83 00000100:00100000:3.0:1788869442.287549:0:5755:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c82cdab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2125b9b3-626e-4cbe-be83-fb446e976ce2+12:10382:x1875765413060096:12345-192.168.201.39@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1788869442.287654:0:5755:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504c000/0x3d2d1916761d69ec lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869442.287676:0:5755:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504c000/0x3d2d1916761d69ec lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869442.288379:0:5755:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504c000/0x3d2d1916761d69ec lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869442.288667:0:5755:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504c800/0x3d2d1916761d69f3 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869442.288824:0:5755:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff94c805039e00/0x3d2d1916761d69a6 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.39@tcp remote: 0x375c010249035920 expref: 13 pid: 5757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869442.288837:0:5755:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504c800/0x3d2d1916761d69f3 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869442.288884:0:5755:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff94c805039e00/0x3d2d1916761d69a6 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.201.39@tcp remote: 0x375c010249035920 expref: 13 pid: 5757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869442.288901:0:5755:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff94c805039e00/0x3d2d1916761d69a6 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.201.39@tcp remote: 0x375c010249035920 expref: 13 pid: 5757 timeout: 290 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788869442.288920:0:5755:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94c82ced9c00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5755:1875765421461888:192.168.201.39@tcp:104: 00000100:00100000:3.0:1788869442.289044:0:5755:0:(client.c:2702:ptlrpc_set_wait()) set ffff94c8357d5b40 going to sleep for 11 seconds 00000100:00100000:0.0:1788869442.294671:0:5755:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94c82ced9c00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5755:1875765421461888:192.168.201.39@tcp:104: 00010000:00010000:0.0:1788869442.294698:0:5755:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504c800/0x3d2d1916761d69f3 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788869442.295408:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1788869442.295474:0:5739:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765413060224 00000100:00100000:2.0:1788869442.295543:0:5739:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765413060224 00010000:00010000:2.0:1788869442.295577:0:5739:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff94c805039e00/0x3d2d1916761d69a6 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.39@tcp remote: 0x375c010249035920 expref: 14 pid: 5757 timeout: 290 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788869442.295644:0:5739:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 46 00000100:00100000:2.0:1788869442.295654:0:5739:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c810730700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2125b9b3-626e-4cbe-be83-fb446e976ce2+14:2347:x1875765413060224:12345-192.168.201.39@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788869442.295668:0:5739:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788869442.295675:0:5739:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff94c805039e00/0x3d2d1916761d69a6 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.39@tcp remote: 0x375c010249035920 expref: 14 pid: 5757 timeout: 290 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869442.295688:0:5739:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff94c805039e00/0x3d2d1916761d69a6 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.201.39@tcp remote: 0x375c010249035920 expref: 14 pid: 5757 timeout: 290 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869442.295709:0:5739:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94c805039e00/0x3d2d1916761d69a6 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.201.39@tcp remote: 0x375c010249035920 expref: 14 pid: 5757 timeout: 290 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869442.295722:0:5739:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff94c81a585900) 00010000:00010000:2.0:1788869442.295727:0:5739:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504c800/0x3d2d1916761d69f3 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869442.295736:0:5739:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504c800/0x3d2d1916761d69f3 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869442.295743:0:5739:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504c800/0x3d2d1916761d69f3 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869442.295789:0:5739:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788869442.295833:0:5739:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c810730700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2125b9b3-626e-4cbe-be83-fb446e976ce2+13:2347:x1875765413060224:12345-192.168.201.39@tcp:103:ldlm_bl.0 Request processed in 180us (428us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869442.295840:0:5739:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 46 00010000:00010000:1.0:1788869442.295885:0:5755:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504c800/0x3d2d1916761d69f3 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869442.295892:0:5755:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504c800/0x3d2d1916761d69f3 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788869442.296065:0:5755:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967356 00000001:00080000:1.0:1788869442.296207:0:5755:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967357 00000001:00080000:1.0:1788869442.296270:0:5755:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967358 00000100:00100000:1.0:1788869442.296356:0:5755:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94c810731180 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5755:1875765421462016:0@lo:1000:mdt00_000.0 00000100:00100000:1.0:1788869442.296400:0:5755:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869442.296421:0:5755:0:(client.c:2702:ptlrpc_set_wait()) set ffff94c802c49900 going to sleep for 11 seconds 00000100:00100000:2.0:1788869442.296657:0:5761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765421462016 00000100:00100000:2.0:1788869442.296662:0:5761:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765421462016 00000100:00100000:2.0:1788869442.296719:0:5761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788869442.296726:0:5761:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c810733100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5755:x1875765421462016:12345-0@lo:1000:mdt00_000.0 00000100:00100000:2.0:1788869442.296806:0:5761:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c810733100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5755:x1875765421462016:12345-0@lo:1000:mdt00_000.0 Request processed in 81us (405us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869442.296812:0:5761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788869442.296906:0:5755:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967303 gen 2 00000004:00080000:2.0:1788869442.296911:0:5755:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94c810731500, transno 4294967303 00000100:00100000:2.0:1788869442.296961:0:5755:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94c810731180 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5755:1875765421462016:0@lo:1000:mdt00_000.0 00000001:00080000:2.0:1788869442.297413:0:5755:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967359 00000100:00100000:2.0:1788869442.297463:0:5755:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94c82d043800 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5755:1875765421462144:0@lo:1000:mdt00_000.0 00000100:00100000:2.0:1788869442.297493:0:5755:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869442.297506:0:5755:0:(client.c:2702:ptlrpc_set_wait()) set ffff94c803146a80 going to sleep for 11 seconds 00000100:00100000:3.0:1788869442.297611:0:5760:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765421462144 00000100:00100000:3.0:1788869442.297616:0:5760:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765421462144 00000100:00100000:3.0:1788869442.297648:0:5760:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788869442.297655:0:5760:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c835a7ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5755:x1875765421462144:12345-0@lo:1000:mdt00_000.0 00000100:00100000:3.0:1788869442.297805:0:5760:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c835a7ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5755:x1875765421462144:12345-0@lo:1000:mdt00_000.0 Request processed in 151us (312us total) trans 4294967305 rc 0/0 00000100:00100000:3.0:1788869442.297812:0:5760:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788869442.297883:0:5755:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94c82d043800 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5755:1875765421462144:0@lo:1000:mdt00_000.0 00010000:00010000:2.0:1788869442.297908:0:5755:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504c800/0x3d2d1916761d69f3 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869442.297916:0:5755:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504c800/0x3d2d1916761d69f3 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869442.297923:0:5755:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504c800/0x3d2d1916761d69f3 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869442.297934:0:5755:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94c83504c800 already unused, calling callback (ffffffffc21124f0) 00010000:00010000:2.0:1788869442.297938:0:5755:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504c800/0x3d2d1916761d69f3 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869442.297945:0:5755:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504c800/0x3d2d1916761d69f3 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869442.297958:0:5755:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff94c81a585900) 00010000:00010000:2.0:1788869442.297961:0:5755:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788869442.297965:0:5755:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504c800/0x3d2d1916761d69f3 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869442.297970:0:5755:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504c800/0x3d2d1916761d69f3 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869442.298001:0:5755:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94c83fde6a00/0x3d2d1916761d6921 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869442.298008:0:5755:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94c83fde6a00/0x3d2d1916761d6921 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869442.298013:0:5755:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94c83fde6a00/0x3d2d1916761d6921 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869442.298018:0:5755:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94c83fde6a00 already unused, calling callback (ffffffffc21124f0) 00010000:00010000:2.0:1788869442.298021:0:5755:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94c83fde6a00/0x3d2d1916761d6921 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869442.298027:0:5755:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94c83fde6a00/0x3d2d1916761d6921 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869442.298042:0:5755:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff94c81a585100) 00010000:00010000:2.0:1788869442.298043:0:5755:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788869442.298045:0:5755:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94c83fde6a00/0x3d2d1916761d6921 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869442.298050:0:5755:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94c83fde6a00/0x3d2d1916761d6921 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869442.298071:0:5755:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94c805039a00/0x3d2d1916761d69fa lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869442.298085:0:5755:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff94c83fde6800/0x3d2d1916761d693d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0x375c010249035904 expref: 16 pid: 5755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869442.298094:0:5755:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff94c805039a00/0x3d2d1916761d69fa lrc: 4/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869442.298115:0:5755:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff94c83fde6800/0x3d2d1916761d693d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.39@tcp remote: 0x375c010249035904 expref: 16 pid: 5755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869442.298124:0:5755:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff94c83fde6800/0x3d2d1916761d693d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.39@tcp remote: 0x375c010249035904 expref: 16 pid: 5755 timeout: 290 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788869442.298132:0:5755:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94c835a7ca80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5755:1875765421462272:192.168.201.39@tcp:104: 00000100:00100000:2.0:1788869442.298174:0:5755:0:(client.c:2702:ptlrpc_set_wait()) set ffff94c803146a80 going to sleep for 11 seconds 00000100:00100000:2.0:1788869442.299643:0:5755:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94c835a7ca80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5755:1875765421462272:192.168.201.39@tcp:104: 00010000:00010000:2.0:1788869442.299661:0:5755:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff94c805039a00/0x3d2d1916761d69fa lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788869442.300896:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1788869442.301683:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765413060352 00000100:00100000:0.0:1788869442.301698:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765413060352 00010000:00010000:0.0:1788869442.301732:0:5788:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff94c83fde6800/0x3d2d1916761d693d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.39@tcp remote: 0x375c010249035904 expref: 17 pid: 5755 timeout: 290 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788869442.301785:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 47 00000100:00100000:0.0:1788869442.301796:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c82cedad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2125b9b3-626e-4cbe-be83-fb446e976ce2+17:2348:x1875765413060352:12345-192.168.201.39@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788869442.301809:0:5788:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788869442.301816:0:5788:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff94c83fde6800/0x3d2d1916761d693d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.39@tcp remote: 0x375c010249035904 expref: 17 pid: 5755 timeout: 290 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869442.301829:0:5788:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff94c83fde6800/0x3d2d1916761d693d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.39@tcp remote: 0x375c010249035904 expref: 17 pid: 5755 timeout: 290 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869442.301850:0:5788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94c83fde6800/0x3d2d1916761d693d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.39@tcp remote: 0x375c010249035904 expref: 17 pid: 5755 timeout: 290 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869442.301862:0:5788:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff94c81a585100) 00010000:00010000:0.0:1788869442.301866:0:5788:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff94c805039a00/0x3d2d1916761d69fa lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869442.301875:0:5788:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff94c805039a00/0x3d2d1916761d69fa lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869442.301881:0:5788:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94c805039a00/0x3d2d1916761d69fa lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869442.301904:0:5788:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788869442.301918:0:5755:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff94c805039a00/0x3d2d1916761d69fa lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869442.301924:0:5755:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94c805039a00/0x3d2d1916761d69fa lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869442.301934:0:5755:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94c805039a00/0x3d2d1916761d69fa lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869442.301938:0:5755:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94c805039a00/0x3d2d1916761d69fa lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869442.301943:0:5755:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94c805039a00/0x3d2d1916761d69fa lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869442.301949:0:5755:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94c805039a00 already unused, calling callback (ffffffffc21124f0) 00000100:00100000:0.0:1788869442.301954:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c82cedad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2125b9b3-626e-4cbe-be83-fb446e976ce2+16:2348:x1875765413060352:12345-192.168.201.39@tcp:103:ldlm_bl.0 Request processed in 158us (1057us total) trans 0 rc 0/0 00010000:00010000:2.0:1788869442.301956:0:5755:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94c805039a00/0x3d2d1916761d69fa lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869442.301968:0:5755:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94c805039a00/0x3d2d1916761d69fa lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788869442.301978:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 47 00010000:00010000:2.0:1788869442.301981:0:5755:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff94c81a585100) 00010000:00010000:2.0:1788869442.301986:0:5755:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788869442.301989:0:5755:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94c805039a00/0x3d2d1916761d69fa lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869442.301995:0:5755:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94c805039a00/0x3d2d1916761d69fa lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869442.302005:0:5755:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504c000/0x3d2d1916761d69ec lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869442.302017:0:5755:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504c000/0x3d2d1916761d69ec lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869442.302023:0:5755:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504c000/0x3d2d1916761d69ec lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869442.302028:0:5755:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94c83504c000 already unused, calling callback (ffffffffc21124f0) 00010000:00010000:2.0:1788869442.302031:0:5755:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504c000/0x3d2d1916761d69ec lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869442.302036:0:5755:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504c000/0x3d2d1916761d69ec lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869442.302045:0:5755:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff94c81a585100) 00010000:00010000:2.0:1788869442.302047:0:5755:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1788869442.302050:0:5755:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504c000/0x3d2d1916761d69ec lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869442.302056:0:5755:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504c000/0x3d2d1916761d69ec lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788869442.302275:0:5755:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c82cdab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2125b9b3-626e-4cbe-be83-fb446e976ce2+15:10382:x1875765413060096:12345-192.168.201.39@tcp:57:lhsmtool_posix.0 Request processed in 14730us (14924us total) trans 4294967360 rc 0/0 00000100:00100000:2.0:1788869442.302284:0:5755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 83 00000020:00080000:2.0:1788869442.302287:0:5755:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:3.0:1788869442.302550:0:11485:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788869442.302553:0:11485:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788869442.302578:0:11485:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:3.0:1788869442.302583:0:11485:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1788869442.304219:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1788869442.304351:0:5759:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765413060608 00000100:00100000:2.0:1788869442.304359:0:5759:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765413060608 00000100:00100000:2.0:1788869442.304402:0:5759:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 20 00000100:00100000:2.0:1788869442.304409:0:5759:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c82ced9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2125b9b3-626e-4cbe-be83-fb446e976ce2+15:10382:x1875765413060608:12345-192.168.201.39@tcp:35:lhsmtool_posix.0 00000004:00080000:2.0:1788869442.304908:0:5759:0:(mdd_object.c:4016:mdd_close()) Object [0x200000401:0x6:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:2.0:1788869442.304977:0:5759:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967361 00010000:00010000:2.0:1788869442.305006:0:5759:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94c805039e00/0x3d2d1916761d6a01 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869442.305016:0:5759:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94c805039e00/0x3d2d1916761d6a01 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869442.305023:0:5759:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94c805039e00/0x3d2d1916761d6a01 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869442.305028:0:5759:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94c805039e00/0x3d2d1916761d6a01 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869442.305031:0:5759:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94c805039e00/0x3d2d1916761d6a01 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869442.305035:0:5759:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94c805039e00/0x3d2d1916761d6a01 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869442.305055:0:5759:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1788869442.305117:0:5759:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c82ced9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2125b9b3-626e-4cbe-be83-fb446e976ce2+17:10382:x1875765413060608:12345-192.168.201.39@tcp:35:lhsmtool_posix.0 Request processed in 707us (901us total) trans 4294967362 rc 0/0 00000100:00100000:2.0:1788869442.305125:0:5759:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 20 00000020:00080000:2.0:1788869442.305128:0:5759:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1788869442.307031:0:5742:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788869442.307042:0:5742:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94c805039e00/0x3d2d1916761d6a01 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869442.307051:0:5742:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94c805039e00 already unused, calling callback (ffffffffc1703220) 00010000:00010000:0.0:1788869442.307056:0:5742:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94c805039e00/0x3d2d1916761d6a01 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869442.307064:0:5742:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94c805039e00/0x3d2d1916761d6a01 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869442.307080:0:5742:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff94c802f3f000) 00010000:00010000:0.0:1788869442.307083:0:5742:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1788869442.307087:0:5742:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94c805039e00/0x3d2d1916761d6a01 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869442.307093:0:5742:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94c805039e00/0x3d2d1916761d6a01 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869442.307109:0:5742:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788869442.307111:0:5742:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788869442.307112:0:5742:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788869442.427696:0:11805:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788869442.427707:0:11805:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788869442.427746:0:11805:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:2.0:1788869442.427753:0:11805:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1788869442.500033:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1788869442.500105:0:5757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765413060864 00000100:00100000:2.0:1788869442.500119:0:5757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765413060864 00000100:00100000:2.0:1788869442.500211:0:5757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 84 00000100:00100000:2.0:1788869442.500223:0:5757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c810731500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2125b9b3-626e-4cbe-be83-fb446e976ce2+17:10392:x1875765413060864:12345-192.168.201.39@tcp:101:lfs.0 00010000:00010000:2.0:1788869442.500402:0:5757:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788869442.500432:0:5757:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94c805039000/0x3d2d1916761d6a08 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x375c01024903593c expref: -99 pid: 5757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869442.500816:0:5757:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff94c805039c00/0x3d2d1916761d6a0f lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869442.500834:0:5757:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94c805039c00/0x3d2d1916761d6a0f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869442.500847:0:5757:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94c805039c00/0x3d2d1916761d6a0f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5757 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788869442.500861:0:5757:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 7680 00010000:00010000:2.0:1788869442.501061:0:5757:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94c805039000/0x3d2d1916761d6a08 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0x375c01024903593c expref: 20 pid: 5757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869442.501079:0:5757:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94c805039c00/0x3d2d1916761d6a0f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0x375c01024903593c expref: 19 pid: 5757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869442.501089:0:5757:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff94c81a585400) 00010000:00010000:2.0:1788869442.501093:0:5757:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1788869442.501096:0:5757:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94c805039c00, rc 0) 00000100:00100000:2.0:1788869442.501659:0:5757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c810731500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2125b9b3-626e-4cbe-be83-fb446e976ce2+19:10392:x1875765413060864:12345-192.168.201.39@tcp:101:lfs.0 Request processed in 1436us (1638us total) trans 4294967363 rc 0/0 00000100:00100000:2.0:1788869442.501668:0:5757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 84 00000100:00100000:1.0:1788869442.504668:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1788869442.504821:0:5756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765413060992 00000100:00100000:3.0:1788869442.504835:0:5756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765413060992 00000100:00100000:3.0:1788869442.504935:0:5756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 85 00000100:00100000:3.0:1788869442.504949:0:5756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c810733480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2125b9b3-626e-4cbe-be83-fb446e976ce2+19:10392:x1875765413060992:12345-192.168.201.39@tcp:34:lfs.0 00010000:00010000:3.0:1788869442.505044:0:5756:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504ce00/0x3d2d1916761d6a1d lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869442.505064:0:5756:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504ce00/0x3d2d1916761d6a1d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869442.505078:0:5756:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504ce00/0x3d2d1916761d6a1d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869442.505097:0:5756:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504d400/0x3d2d1916761d6a24 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869442.505105:0:5756:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504d400/0x3d2d1916761d6a24 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869442.505112:0:5756:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504d400/0x3d2d1916761d6a24 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869442.505526:0:5756:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504d600/0x3d2d1916761d6a2b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869442.505536:0:5756:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504d600/0x3d2d1916761d6a2b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869442.505545:0:5756:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504d600/0x3d2d1916761d6a2b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788869442.505594:0:5756:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504d600/0x3d2d1916761d6a2b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869442.505947:0:5756:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504ce00/0x3d2d1916761d6a1d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869442.505954:0:5756:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504ce00/0x3d2d1916761d6a1d lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869442.505963:0:5756:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504ce00/0x3d2d1916761d6a1d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869442.505970:0:5756:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94c83504ce00 already unused, calling callback (ffffffffc21124f0) 00010000:00010000:3.0:1788869442.505975:0:5756:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504ce00/0x3d2d1916761d6a1d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869442.505983:0:5756:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504ce00/0x3d2d1916761d6a1d lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869442.505996:0:5756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff94c81a585400) 00010000:00010000:3.0:1788869442.505999:0:5756:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788869442.506004:0:5756:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504ce00/0x3d2d1916761d6a1d lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869442.506010:0:5756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504ce00/0x3d2d1916761d6a1d lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869442.506019:0:5756:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504d400/0x3d2d1916761d6a24 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869442.506026:0:5756:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504d400/0x3d2d1916761d6a24 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869442.506032:0:5756:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504d400/0x3d2d1916761d6a24 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869442.506043:0:5756:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94c83504d400 already unused, calling callback (ffffffffc21124f0) 00010000:00010000:3.0:1788869442.506046:0:5756:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504d400/0x3d2d1916761d6a24 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869442.506052:0:5756:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504d400/0x3d2d1916761d6a24 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869442.506061:0:5756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff94c819394600) 00010000:00010000:3.0:1788869442.506063:0:5756:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788869442.506066:0:5756:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504d400/0x3d2d1916761d6a24 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869442.506072:0:5756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504d400/0x3d2d1916761d6a24 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869442.506087:0:5756:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504d600/0x3d2d1916761d6a2b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869442.506093:0:5756:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504d600/0x3d2d1916761d6a2b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869442.506099:0:5756:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504d600/0x3d2d1916761d6a2b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869442.506103:0:5756:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94c83504d600 already unused, calling callback (ffffffffc21124f0) 00010000:00010000:3.0:1788869442.506106:0:5756:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504d600/0x3d2d1916761d6a2b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869442.506112:0:5756:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504d600/0x3d2d1916761d6a2b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869442.506129:0:5756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff94c819394800) 00010000:00010000:3.0:1788869442.506131:0:5756:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788869442.506134:0:5756:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504d600/0x3d2d1916761d6a2b lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869442.506140:0:5756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504d600/0x3d2d1916761d6a2b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788869442.506325:0:5756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c810733480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2125b9b3-626e-4cbe-be83-fb446e976ce2+19:10392:x1875765413060992:12345-192.168.201.39@tcp:34:lfs.0 Request processed in 1376us (2078us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869442.506334:0:5756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 85 00000100:00100000:3.0:1788869442.527239:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1788869442.527315:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765413061248 00000100:00100000:0.0:1788869442.527328:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765413061248 00000100:00100000:0.0:1788869442.527404:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 86 00000100:00100000:0.0:1788869442.527417:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c82cedb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2125b9b3-626e-4cbe-be83-fb446e976ce2+19:10395:x1875765413061248:12345-192.168.201.39@tcp:101:lfs.0 00010000:00010000:0.0:1788869442.527445:0:5786:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788869442.527475:0:5786:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94c81a582a00/0x3d2d1916761d6a32 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x375c010249035943 expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869442.527593:0:5786:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff94c81a582200/0x3d2d1916761d6a39 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869442.527610:0:5786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94c81a582200/0x3d2d1916761d6a39 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869442.527623:0:5786:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94c81a582200/0x3d2d1916761d6a39 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869442.527642:0:5786:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94c81a583e00/0x3d2d1916761d6a40 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869442.527649:0:5786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94c81a583e00/0x3d2d1916761d6a40 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869442.527656:0:5786:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94c81a583e00/0x3d2d1916761d6a40 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869442.528118:0:5786:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94c81a582e00/0x3d2d1916761d6a47 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869442.528128:0:5786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94c81a582e00/0x3d2d1916761d6a47 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869442.528137:0:5786:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94c81a582e00/0x3d2d1916761d6a47 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788869442.528150:0:5786:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 9 00010000:00010000:0.0:1788869442.528310:0:5786:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff94c81a582200/0x3d2d1916761d6a39 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869442.528318:0:5786:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94c81a582200/0x3d2d1916761d6a39 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869442.528333:0:5786:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94c81a582200/0x3d2d1916761d6a39 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869442.528340:0:5786:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94c81a582200 already unused, calling callback (ffffffffc21124f0) 00010000:00010000:0.0:1788869442.528346:0:5786:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94c81a582200/0x3d2d1916761d6a39 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869442.528355:0:5786:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94c81a582200/0x3d2d1916761d6a39 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869442.528369:0:5786:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff94c81a585400) 00010000:00010000:0.0:1788869442.528373:0:5786:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788869442.528378:0:5786:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94c81a582200/0x3d2d1916761d6a39 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869442.528385:0:5786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94c81a582200/0x3d2d1916761d6a39 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869442.528400:0:5786:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94c81a583e00/0x3d2d1916761d6a40 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869442.528408:0:5786:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94c81a583e00/0x3d2d1916761d6a40 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869442.528414:0:5786:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94c81a583e00/0x3d2d1916761d6a40 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869442.528420:0:5786:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94c81a583e00 already unused, calling callback (ffffffffc21124f0) 00010000:00010000:0.0:1788869442.528423:0:5786:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94c81a583e00/0x3d2d1916761d6a40 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869442.528438:0:5786:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94c81a583e00/0x3d2d1916761d6a40 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869442.528447:0:5786:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff94c803990c00) 00010000:00010000:0.0:1788869442.528450:0:5786:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788869442.528453:0:5786:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94c81a583e00/0x3d2d1916761d6a40 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869442.528459:0:5786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94c81a583e00/0x3d2d1916761d6a40 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869442.528508:0:5786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94c81a582a00/0x3d2d1916761d6a32 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0x375c010249035943 expref: 22 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869442.528525:0:5786:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94c81a582e00/0x3d2d1916761d6a47 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0x375c010249035943 expref: 21 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869442.528532:0:5786:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff94c803990d00) 00010000:00010000:0.0:1788869442.528534:0:5786:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788869442.528536:0:5786:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94c81a582e00, rc 0) 00000100:00100000:0.0:1788869442.528665:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c82cedb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2125b9b3-626e-4cbe-be83-fb446e976ce2+21:10395:x1875765413061248:12345-192.168.201.39@tcp:101:lfs.0 Request processed in 1249us (1452us total) trans 4294967364 rc 0/0 00000100:00100000:0.0:1788869442.528673:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 86 00000100:00100000:1.0:1788869442.534360:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1788869442.534423:0:5755:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765413061376 00000100:00100000:0.0:1788869442.534436:0:5755:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765413061376 00000100:00100000:0.0:1788869442.534511:0:5755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 87 00000100:00100000:0.0:1788869442.534523:0:5755:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c810733800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2125b9b3-626e-4cbe-be83-fb446e976ce2+21:10395:x1875765413061376:12345-192.168.201.39@tcp:54:lfs.0 00010000:00010000:0.0:1788869442.534623:0:5755:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94c81a583000/0x3d2d1916761d6a55 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869442.534639:0:5755:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94c81a583000/0x3d2d1916761d6a55 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869442.534652:0:5755:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94c81a583000/0x3d2d1916761d6a55 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869442.534685:0:5755:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94c81a583000/0x3d2d1916761d6a55 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869442.534693:0:5755:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94c81a583000/0x3d2d1916761d6a55 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869442.534701:0:5755:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94c81a583000/0x3d2d1916761d6a55 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869442.534708:0:5755:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94c81a583000 already unused, calling callback (ffffffffc21124f0) 00010000:00010000:0.0:1788869442.534713:0:5755:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94c81a583000/0x3d2d1916761d6a55 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869442.534722:0:5755:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94c81a583000/0x3d2d1916761d6a55 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869442.534737:0:5755:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff94c803990d00) 00010000:00010000:0.0:1788869442.534741:0:5755:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788869442.534746:0:5755:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94c81a583000/0x3d2d1916761d6a55 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869442.534752:0:5755:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94c81a583000/0x3d2d1916761d6a55 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788869442.534854:0:5755:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c810733800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2125b9b3-626e-4cbe-be83-fb446e976ce2+21:10395:x1875765413061376:12345-192.168.201.39@tcp:54:lfs.0 Request processed in 333us (508us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869442.534864:0:5755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 87 00000100:00100000:3.0:1788869442.535945:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1788869442.536051:0:5758:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765413061632 00000100:00100000:0.0:1788869442.536057:0:5758:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765413061632 00000100:00100000:0.0:1788869442.536088:0:5758:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 21 00000100:00100000:0.0:1788869442.536094:0:5758:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c818768450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2125b9b3-626e-4cbe-be83-fb446e976ce2+21:10395:x1875765413061632:12345-192.168.201.39@tcp:35:lfs.0 00000100:00100000:0.0:1788869442.536433:0:5758:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c818768450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2125b9b3-626e-4cbe-be83-fb446e976ce2+22:10395:x1875765413061632:12345-192.168.201.39@tcp:35:lfs.0 Request processed in 337us (489us total) trans 4294967365 rc 0/0 00000100:00100000:0.0:1788869442.536441:0:5758:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 21 00000100:00100000:3.0:1788869442.550569:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1788869442.550683:0:5757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765413061888 00000100:00100000:2.0:1788869442.550710:0:5757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765413061888 00000100:00100000:2.0:1788869442.550785:0:5757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 88 00000100:00100000:2.0:1788869442.550797:0:5757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c82ced8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2125b9b3-626e-4cbe-be83-fb446e976ce2+22:9927:x1875765413061888:12345-192.168.201.39@tcp:101:bash.0 00010000:00010000:2.0:1788869442.550828:0:5757:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788869442.550864:0:5757:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94c805039000/0x3d2d1916761d6a5c lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x375c01024903594a expref: -99 pid: 5757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869442.550993:0:5757:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94c805039200/0x3d2d1916761d6a63 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869442.551008:0:5757:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff94c81a582e00/0x3d2d1916761d6a47 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0x375c010249035943 expref: 23 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869442.551019:0:5757:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff94c805039200/0x3d2d1916761d6a63 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869442.551064:0:5757:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff94c81a582e00/0x3d2d1916761d6a47 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.39@tcp remote: 0x375c010249035943 expref: 23 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869442.551078:0:5757:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff94c81a582e00/0x3d2d1916761d6a47 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.39@tcp remote: 0x375c010249035943 expref: 23 pid: 5786 timeout: 290 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788869442.551092:0:5757:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94c835a7ca80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5757:1875765421462400:192.168.201.39@tcp:104: 00000100:00100000:2.0:1788869442.551201:0:5757:0:(client.c:2702:ptlrpc_set_wait()) set ffff94c83510e180 going to sleep for 11 seconds 00000100:00100000:1.0:1788869442.554138:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1788869442.554194:0:5741:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765413062016 00000100:00100000:3.0:1788869442.554207:0:5741:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765413062016 00000100:00100000:2.0:1788869442.554333:0:5757:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94c835a7ca80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5757:1875765421462400:192.168.201.39@tcp:104: 00010000:00010000:3.0:1788869442.554364:0:5741:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff94c81a582e00/0x3d2d1916761d6a47 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.39@tcp remote: 0x375c010249035943 expref: 24 pid: 5786 timeout: 290 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869442.554365:0:5757:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff94c805039200/0x3d2d1916761d6a63 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5757 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788869442.554412:0:5741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 48 00000100:00100000:3.0:1788869442.554424:0:5741:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c810730000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2125b9b3-626e-4cbe-be83-fb446e976ce2+24:2347:x1875765413062016:12345-192.168.201.39@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788869442.554448:0:5741:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788869442.554456:0:5741:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff94c81a582e00/0x3d2d1916761d6a47 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.39@tcp remote: 0x375c010249035943 expref: 24 pid: 5786 timeout: 290 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869442.554472:0:5741:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff94c81a582e00/0x3d2d1916761d6a47 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.39@tcp remote: 0x375c010249035943 expref: 24 pid: 5786 timeout: 290 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869442.554522:0:5741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94c81a582e00/0x3d2d1916761d6a47 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.39@tcp remote: 0x375c010249035943 expref: 24 pid: 5786 timeout: 290 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869442.554539:0:5741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff94c803990d00) 00010000:00010000:3.0:1788869442.554545:0:5741:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff94c805039200/0x3d2d1916761d6a63 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869442.554556:0:5741:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff94c805039200/0x3d2d1916761d6a63 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869442.554564:0:5741:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94c805039200/0x3d2d1916761d6a63 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869442.554590:0:5741:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788869442.554618:0:5757:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff94c805039200/0x3d2d1916761d6a63 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869442.554630:0:5757:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94c805039200/0x3d2d1916761d6a63 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5757 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788869442.554652:0:5741:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c810730000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2125b9b3-626e-4cbe-be83-fb446e976ce2+23:2347:x1875765413062016:12345-192.168.201.39@tcp:103:ldlm_bl.0 Request processed in 232us (527us total) trans 0 rc 0/0 00000004:00200000:2.0:1788869442.554654:0:5757:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 9 00000100:00100000:3.0:1788869442.554661:0:5741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 48 00010000:00010000:2.0:1788869442.554853:0:5757:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94c805039000/0x3d2d1916761d6a5c lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0x375c01024903594a expref: 24 pid: 5757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869442.554866:0:5757:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94c805039200/0x3d2d1916761d6a63 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0x375c01024903594a expref: 23 pid: 5757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869442.554872:0:5757:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff94c803990d00) 00010000:00010000:2.0:1788869442.554874:0:5757:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1788869442.554876:0:5757:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94c805039200, rc 0) 00000100:00100000:2.0:1788869442.554919:0:5757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c82ced8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2125b9b3-626e-4cbe-be83-fb446e976ce2+23:9927:x1875765413061888:12345-192.168.201.39@tcp:101:bash.0 Request processed in 4125us (4365us total) trans 4294967366 rc 0/0 00000100:00100000:2.0:1788869442.554926:0:5757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 88 00000100:00100000:1.0:1788869442.557106:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1788869442.557207:0:5756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765413062272 00000100:00100000:3.0:1788869442.557216:0:5756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765413062272 00000100:00100000:3.0:1788869442.557295:0:5756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 89 00000100:00100000:3.0:1788869442.557307:0:5756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c810731f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2125b9b3-626e-4cbe-be83-fb446e976ce2+23:9927:x1875765413062272:12345-192.168.201.39@tcp:36:bash.0 00010000:00010000:3.0:1788869442.557628:0:5756:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504d600/0x3d2d1916761d6a71 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869442.557647:0:5756:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504d600/0x3d2d1916761d6a71 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869442.557661:0:5756:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504d600/0x3d2d1916761d6a71 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788869442.557738:0:5756:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967367 00000004:00010000:3.0:1788869442.557779:0:5756:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000076e71ab reply state 00000000505c806b transno 4294967368 ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504d600/0x3d2d1916761d6a71 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788869442.557788:0:5756:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000001:00080000:3.0:1788869442.557837:0:5756:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967368 00000100:00100000:3.0:1788869442.557949:0:5756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c810731f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2125b9b3-626e-4cbe-be83-fb446e976ce2+27:9927:x1875765413062272:12345-192.168.201.39@tcp:36:bash.0 Request processed in 645us (852us total) trans 4294967369 rc 0/0 00000100:00100000:3.0:1788869442.557958:0:5756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 89 00000020:00080000:3.0:1788869442.557963:0:5756:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00010000:00010000:1.0:1788869442.563390:0:3270:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504d600/0x3d2d1916761d6a71 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869442.563414:0:3270:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504d600/0x3d2d1916761d6a71 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869442.563423:0:3270:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504d600/0x3d2d1916761d6a71 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869442.563431:0:3270:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94c83504d600 already unused, calling callback (ffffffffc21124f0) 00010000:00010000:1.0:1788869442.563436:0:3270:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504d600/0x3d2d1916761d6a71 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869442.563446:0:3270:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504d600/0x3d2d1916761d6a71 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869442.563468:0:3270:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff94c803990d00) 00010000:00010000:1.0:1788869442.563471:0:3270:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788869442.563477:0:3270:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504d600/0x3d2d1916761d6a71 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869442.563484:0:3270:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504d600/0x3d2d1916761d6a71 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788869442.563577:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1788869442.563719:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765413062400 00000100:00100000:0.0:1788869442.563732:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765413062400 00000100:00100000:0.0:1788869442.563810:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 90 00000100:00100000:0.0:1788869442.563822:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c82ced9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2125b9b3-626e-4cbe-be83-fb446e976ce2+26:9927:x1875765413062400:12345-192.168.201.39@tcp:101:bash.0 00010000:00010000:0.0:1788869442.563854:0:5786:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788869442.563875:0:5786:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94c81a583000/0x3d2d1916761d6a78 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x375c010249035951 expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869442.563946:0:5786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94c81a583000/0x3d2d1916761d6a78 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.39@tcp remote: 0x375c010249035951 expref: 27 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869442.563961:0:5786:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94c81a583000/0x3d2d1916761d6a78 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.39@tcp remote: 0x375c010249035951 expref: 27 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869442.563980:0:5786:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff94c803990d00) 00010000:00010000:0.0:1788869442.563994:0:5786:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788869442.563997:0:5786:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94c81a583000, rc 0) 00000100:00100000:0.0:1788869442.564066:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c82ced9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2125b9b3-626e-4cbe-be83-fb446e976ce2+27:9927:x1875765413062400:12345-192.168.201.39@tcp:101:bash.0 Request processed in 246us (494us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869442.564074:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 90 00000100:00100000:1.0:1788869442.566057:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1788869442.566140:0:6546:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765413062528 00000100:00100000:2.0:1788869442.566149:0:6546:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765413062528 00000100:00100000:2.0:1788869442.566208:0:6546:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 33 00000100:00100000:2.0:1788869442.566218:0:6546:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c810730a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2125b9b3-626e-4cbe-be83-fb446e976ce2+6:9927:x1875765413062528:12345-192.168.201.39@tcp:101:bash.0 00010000:00010000:2.0:1788869442.566245:0:6546:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788869442.566293:0:6546:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a046f8e3/0x3d2d1916761d6a7f lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x375c010249035958 expref: -99 pid: 6546 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788869442.566325:0:6546:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x3:0x0] initial LVB size: 9, mtime: 0x6a9ffb40, atime: 0x6a9ffb3f, ctime: 0x6a9ffb40, blocks: 0xb 00010000:00010000:2.0:1788869442.566347:0:6546:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=190s v=(0 0) 00010000:00010000:2.0:1788869442.566364:0:6546:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788869442.566372:0:6546:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a046f8e3/0x3d2d1916761d6a7f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.201.39@tcp remote: 0x375c010249035958 expref: 7 pid: 6546 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869442.566386:0:6546:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000a046f8e3/0x3d2d1916761d6a7f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.39@tcp remote: 0x375c010249035958 expref: 7 pid: 6546 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869442.566395:0:6546:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94c805039000, rc 0) 00000100:00100000:2.0:1788869442.566440:0:6546:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c810730a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2125b9b3-626e-4cbe-be83-fb446e976ce2+7:9927:x1875765413062528:12345-192.168.201.39@tcp:101:bash.0 Request processed in 224us (392us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869442.566446:0:6546:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 33 00000100:00100000:1.0:1788869442.569373:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1788869442.569440:0:6550:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765413062656 00000100:00100000:2.0:1788869442.569451:0:6550:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765413062656 00002000:00010000:2.0:1788869442.569499:0:6550:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/3 (0->18446744073709551615) 00002000:00100000:2.0:1788869442.569504:0:6550:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff94c810732d80 with x1875765413062656 ext(0->18446744073709551615) 00002000:00010000:2.0:1788869442.569517:0:6550:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff94c810732d80. 00000100:00100000:2.0:1788869442.569547:0:6550:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 1 00000100:00100000:2.0:1788869442.569556:0:6550:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c810732d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:2125b9b3-626e-4cbe-be83-fb446e976ce2+7:2348:x1875765413062656:12345-192.168.201.39@tcp:10:bash.0 00002000:00010000:2.0:1788869442.569870:0:6550:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:2.0:1788869442.569873:0:6550:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb mtime from disk: 1788869440 -> 1788869441 00002000:00010000:2.0:1788869442.569875:0:6550:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb atime from disk: 1788869439 -> 1788869439 00002000:00010000:2.0:1788869442.569876:0:6550:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb ctime from disk: 1788869440 -> 1788869441 00002000:00010000:2.0:1788869442.569878:0:6550:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb blocks from disk: 11 -> 11 00000100:00100000:2.0:1788869442.569953:0:6550:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c810732d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:2125b9b3-626e-4cbe-be83-fb446e976ce2+8:2348:x1875765413062656:12345-192.168.201.39@tcp:10:bash.0 Request processed in 398us (591us total) trans 4294967306 rc 0/0 00000100:00100000:2.0:1788869442.569959:0:6550:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 1 00002000:00010000:2.0:1788869442.569977:0:6550:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/3 (0->18446744073709551615) 00002000:00100000:2.0:1788869442.569980:0:6550:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff94c810732d80 with x1875765413062656 ext(0->18446744073709551615) 00002000:00010000:2.0:1788869442.569985:0:6550:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff94c810732d80. 00000100:00100000:3.0:1788869442.609666:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1788869442.609746:0:5755:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765413062784 00000100:00100000:0.0:1788869442.609775:0:5755:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765413062784 00000100:00100000:0.0:1788869442.609867:0:5755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 91 00000100:00100000:0.0:1788869442.609886:0:5755:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c82ced8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2125b9b3-626e-4cbe-be83-fb446e976ce2+27:10409:x1875765413062784:12345-192.168.201.39@tcp:34:lfs.0 00010000:00010000:0.0:1788869442.609996:0:5755:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff94c81a582a00/0x3d2d1916761d6a86 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869442.610016:0:5755:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94c81a582a00/0x3d2d1916761d6a86 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869442.610031:0:5755:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94c81a582a00/0x3d2d1916761d6a86 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869442.610053:0:5755:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94c81a583e00/0x3d2d1916761d6a8d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869442.610058:0:5755:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94c81a583e00/0x3d2d1916761d6a8d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869442.610063:0:5755:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94c81a583e00/0x3d2d1916761d6a8d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869442.610516:0:5755:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94c81a582200/0x3d2d1916761d6a94 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869442.610526:0:5755:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94c81a582200/0x3d2d1916761d6a94 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869442.610541:0:5755:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94c81a582200/0x3d2d1916761d6a94 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788869442.610596:0:5755:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff94c81a582200/0x3d2d1916761d6a94 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869442.610610:0:5755:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff94c81a582a00/0x3d2d1916761d6a86 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869442.610617:0:5755:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94c81a582a00/0x3d2d1916761d6a86 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869442.610626:0:5755:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94c81a582a00/0x3d2d1916761d6a86 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869442.610632:0:5755:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94c81a582a00 already unused, calling callback (ffffffffc21124f0) 00010000:00010000:0.0:1788869442.610637:0:5755:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94c81a582a00/0x3d2d1916761d6a86 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869442.610654:0:5755:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94c81a582a00/0x3d2d1916761d6a86 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869442.610670:0:5755:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff94c81a585400) 00010000:00010000:0.0:1788869442.610673:0:5755:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788869442.610678:0:5755:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94c81a582a00/0x3d2d1916761d6a86 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869442.610683:0:5755:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94c81a582a00/0x3d2d1916761d6a86 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869442.610694:0:5755:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94c81a583e00/0x3d2d1916761d6a8d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869442.610703:0:5755:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94c81a583e00/0x3d2d1916761d6a8d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869442.610707:0:5755:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94c81a583e00/0x3d2d1916761d6a8d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869442.610710:0:5755:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94c81a583e00 already unused, calling callback (ffffffffc21124f0) 00010000:00010000:0.0:1788869442.610712:0:5755:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94c81a583e00/0x3d2d1916761d6a8d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869442.610715:0:5755:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94c81a583e00/0x3d2d1916761d6a8d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869442.610719:0:5755:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff94c803990c00) 00010000:00010000:0.0:1788869442.610721:0:5755:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788869442.610723:0:5755:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94c81a583e00/0x3d2d1916761d6a8d lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869442.610726:0:5755:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94c81a583e00/0x3d2d1916761d6a8d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869442.610738:0:5755:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94c81a582200/0x3d2d1916761d6a94 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869442.610744:0:5755:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94c81a582200/0x3d2d1916761d6a94 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869442.610749:0:5755:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94c81a582200/0x3d2d1916761d6a94 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869442.610754:0:5755:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94c81a582200 already unused, calling callback (ffffffffc21124f0) 00010000:00010000:0.0:1788869442.610772:0:5755:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94c81a582200/0x3d2d1916761d6a94 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869442.610779:0:5755:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94c81a582200/0x3d2d1916761d6a94 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869442.610787:0:5755:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff94c803990d00) 00010000:00010000:0.0:1788869442.610790:0:5755:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788869442.610793:0:5755:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94c81a582200/0x3d2d1916761d6a94 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869442.610799:0:5755:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94c81a582200/0x3d2d1916761d6a94 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788869442.610885:0:5755:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c82ced8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2125b9b3-626e-4cbe-be83-fb446e976ce2+27:10409:x1875765413062784:12345-192.168.201.39@tcp:34:lfs.0 Request processed in 1006us (1231us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869442.610892:0:5755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 91 00000100:00100000:1.0:1788869442.629557:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1788869442.629864:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765413063040 00000100:00100000:0.0:1788869442.629878:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765413063040 00000100:00100000:0.0:1788869442.629957:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 92 00000100:00100000:0.0:1788869442.629970:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c810731180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2125b9b3-626e-4cbe-be83-fb446e976ce2+27:10412:x1875765413063040:12345-192.168.201.39@tcp:101:lfs.0 00010000:00010000:0.0:1788869442.630000:0:5786:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788869442.630028:0:5786:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94c81a582200/0x3d2d1916761d6a9b lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x375c01024903595f expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869442.630192:0:5786:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff94c81a583e00/0x3d2d1916761d6aa2 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869442.630211:0:5786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94c81a583e00/0x3d2d1916761d6aa2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869442.630244:0:5786:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94c81a583e00/0x3d2d1916761d6aa2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869442.630302:0:5786:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94c81a582a00/0x3d2d1916761d6aa9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869442.630311:0:5786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94c81a582a00/0x3d2d1916761d6aa9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869442.630318:0:5786:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94c81a582a00/0x3d2d1916761d6aa9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869442.630673:0:5786:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94c81a583400/0x3d2d1916761d6ab0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869442.630682:0:5786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94c81a583400/0x3d2d1916761d6ab0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869442.630690:0:5786:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94c81a583400/0x3d2d1916761d6ab0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788869442.630702:0:5786:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:0.0:1788869442.630824:0:5786:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff94c81a583e00/0x3d2d1916761d6aa2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869442.630830:0:5786:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94c81a583e00/0x3d2d1916761d6aa2 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869442.630835:0:5786:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94c81a583e00/0x3d2d1916761d6aa2 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869442.630840:0:5786:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94c81a583e00 already unused, calling callback (ffffffffc21124f0) 00010000:00010000:0.0:1788869442.630851:0:5786:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94c81a583e00/0x3d2d1916761d6aa2 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869442.630860:0:5786:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94c81a583e00/0x3d2d1916761d6aa2 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869442.630873:0:5786:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff94c81a585400) 00010000:00010000:0.0:1788869442.630877:0:5786:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788869442.630881:0:5786:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94c81a583e00/0x3d2d1916761d6aa2 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869442.630888:0:5786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94c81a583e00/0x3d2d1916761d6aa2 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869442.630902:0:5786:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94c81a582a00/0x3d2d1916761d6aa9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869442.630908:0:5786:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94c81a582a00/0x3d2d1916761d6aa9 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869442.630913:0:5786:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94c81a582a00/0x3d2d1916761d6aa9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869442.630918:0:5786:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94c81a582a00 already unused, calling callback (ffffffffc21124f0) 00010000:00010000:0.0:1788869442.630920:0:5786:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94c81a582a00/0x3d2d1916761d6aa9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869442.630925:0:5786:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94c81a582a00/0x3d2d1916761d6aa9 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869442.630932:0:5786:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff94c803990c00) 00010000:00010000:0.0:1788869442.630934:0:5786:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788869442.630943:0:5786:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94c81a582a00/0x3d2d1916761d6aa9 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869442.630948:0:5786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94c81a582a00/0x3d2d1916761d6aa9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869442.630991:0:5786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94c81a582200/0x3d2d1916761d6a9b lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0x375c01024903595f expref: 30 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869442.631006:0:5786:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94c81a583400/0x3d2d1916761d6ab0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0x375c01024903595f expref: 29 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869442.631014:0:5786:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff94c803990d00) 00010000:00010000:0.0:1788869442.631017:0:5786:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1788869442.631019:0:5786:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94c81a583400, rc 0) 00000100:00100000:0.0:1788869442.631095:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c810731180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2125b9b3-626e-4cbe-be83-fb446e976ce2+29:10412:x1875765413063040:12345-192.168.201.39@tcp:101:lfs.0 Request processed in 1127us (1552us total) trans 4294967370 rc 0/0 00000100:00100000:0.0:1788869442.631104:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 92 00000100:00100000:1.0:1788869442.633887:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1788869442.633953:0:5756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765413063168 00000100:00100000:3.0:1788869442.633965:0:5756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765413063168 00000100:00100000:3.0:1788869442.634036:0:5756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 93 00000100:00100000:3.0:1788869442.634047:0:5756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c83fbb0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2125b9b3-626e-4cbe-be83-fb446e976ce2+29:10412:x1875765413063168:12345-192.168.201.39@tcp:54:lfs.0 00010000:00010000:3.0:1788869442.634126:0:5756:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504d400/0x3d2d1916761d6abe lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869442.634145:0:5756:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff94c805039200/0x3d2d1916761d6a63 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0x375c01024903594a expref: 29 pid: 5757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869442.634156:0:5756:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504d400/0x3d2d1916761d6abe lrc: 4/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869442.634199:0:5756:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff94c805039200/0x3d2d1916761d6a63 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.39@tcp remote: 0x375c01024903594a expref: 29 pid: 5757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869442.634232:0:5756:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff94c805039200/0x3d2d1916761d6a63 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.39@tcp remote: 0x375c01024903594a expref: 29 pid: 5757 timeout: 290 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788869442.634246:0:5756:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94c82ced9f80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5756:1875765421462528:192.168.201.39@tcp:104: 00000100:00100000:3.0:1788869442.634377:0:5756:0:(client.c:2702:ptlrpc_set_wait()) set ffff94c8357d5b40 going to sleep for 11 seconds 00000100:00100000:0.0:1788869442.636295:0:5756:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94c82ced9f80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5756:1875765421462528:192.168.201.39@tcp:104: 00010000:00010000:0.0:1788869442.636334:0:5756:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504d400/0x3d2d1916761d6abe lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788869442.636338:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1788869442.636383:0:5759:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765413063424 00000100:00100000:2.0:1788869442.636390:0:5759:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765413063424 00000100:00100000:2.0:1788869442.636447:0:5759:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 22 00000100:00100000:2.0:1788869442.636455:0:5759:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c82ceda680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2125b9b3-626e-4cbe-be83-fb446e976ce2+30:5553:x1875765413063424:12345-192.168.201.39@tcp:35:ldlm_bl.0 00000100:00100000:2.0:1788869442.636846:0:5759:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c82ceda680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2125b9b3-626e-4cbe-be83-fb446e976ce2+31:5553:x1875765413063424:12345-192.168.201.39@tcp:35:ldlm_bl.0 Request processed in 389us (523us total) trans 4294967371 rc 0/0 00000100:00100000:2.0:1788869442.636855:0:5759:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 22 00000100:00100000:1.0:1788869442.641388:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1788869442.641974:0:5739:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765413063552 00000100:00100000:2.0:1788869442.641988:0:5739:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765413063552 00010000:00010000:2.0:1788869442.642044:0:5739:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff94c805039200/0x3d2d1916761d6a63 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.39@tcp remote: 0x375c01024903594a expref: 31 pid: 5757 timeout: 290 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788869442.642097:0:5739:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 49 00000100:00100000:2.0:1788869442.642110:0:5739:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c83513f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2125b9b3-626e-4cbe-be83-fb446e976ce2+31:2347:x1875765413063552:12345-192.168.201.39@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788869442.642130:0:5739:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788869442.642138:0:5739:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff94c805039200/0x3d2d1916761d6a63 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.39@tcp remote: 0x375c01024903594a expref: 31 pid: 5757 timeout: 290 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869442.642153:0:5739:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff94c805039200/0x3d2d1916761d6a63 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.39@tcp remote: 0x375c01024903594a expref: 31 pid: 5757 timeout: 290 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869442.642181:0:5739:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94c805039200/0x3d2d1916761d6a63 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.39@tcp remote: 0x375c01024903594a expref: 31 pid: 5757 timeout: 290 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869442.642214:0:5739:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff94c803990d00) 00010000:00010000:2.0:1788869442.642220:0:5739:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504d400/0x3d2d1916761d6abe lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869442.642230:0:5739:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504d400/0x3d2d1916761d6abe lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869442.642239:0:5739:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504d400/0x3d2d1916761d6abe lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869442.642314:0:5739:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788869442.642339:0:5756:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504d400/0x3d2d1916761d6abe lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869442.642349:0:5756:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504d400/0x3d2d1916761d6abe lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788869442.642382:0:5739:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c83513f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2125b9b3-626e-4cbe-be83-fb446e976ce2+30:2347:x1875765413063552:12345-192.168.201.39@tcp:103:ldlm_bl.0 Request processed in 274us (1006us total) trans 0 rc 0/0 00010000:00010000:0.0:1788869442.642384:0:5756:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504d400/0x3d2d1916761d6abe lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788869442.642398:0:5739:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 49 00010000:00010000:0.0:1788869442.642408:0:5756:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504d400/0x3d2d1916761d6abe lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869442.642413:0:5756:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504d400/0x3d2d1916761d6abe lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869442.642417:0:5756:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94c83504d400 already unused, calling callback (ffffffffc21124f0) 00010000:00010000:0.0:1788869442.642421:0:5756:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504d400/0x3d2d1916761d6abe lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869442.642427:0:5756:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504d400/0x3d2d1916761d6abe lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869442.642435:0:5756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff94c803990d00) 00010000:00010000:0.0:1788869442.642437:0:5756:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788869442.642439:0:5756:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504d400/0x3d2d1916761d6abe lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869442.642443:0:5756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504d400/0x3d2d1916761d6abe lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788869442.642486:0:5756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c83fbb0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2125b9b3-626e-4cbe-be83-fb446e976ce2+29:10412:x1875765413063168:12345-192.168.201.39@tcp:54:lfs.0 Request processed in 8441us (8608us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869442.642495:0:5756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 93 00000100:00100000:1.0:1788869442.644138:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1788869442.644196:0:5758:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765413063808 00000100:00100000:0.0:1788869442.644203:0:5758:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765413063808 00000100:00100000:0.0:1788869442.644290:0:5758:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 23 00000100:00100000:0.0:1788869442.644305:0:5758:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c83513e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2125b9b3-626e-4cbe-be83-fb446e976ce2+29:10412:x1875765413063808:12345-192.168.201.39@tcp:35:lfs.0 00000100:00100000:0.0:1788869442.644573:0:5758:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c83513e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2125b9b3-626e-4cbe-be83-fb446e976ce2+30:10412:x1875765413063808:12345-192.168.201.39@tcp:35:lfs.0 Request processed in 275us (440us total) trans 4294967372 rc 0/0 00000100:00100000:0.0:1788869442.644584:0:5758:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 23 00000100:00100000:3.0:1788869442.685529:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1788869442.685623:0:5757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765413064064 00000100:00100000:2.0:1788869442.685641:0:5757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765413064064 00000100:00100000:2.0:1788869442.685730:0:5757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 94 00000100:00100000:2.0:1788869442.685744:0:5757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c82cedaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2125b9b3-626e-4cbe-be83-fb446e976ce2+30:10423:x1875765413064064:12345-192.168.201.39@tcp:101:cat.0 00010000:00010000:2.0:1788869442.685793:0:5757:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788869442.685821:0:5757:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94c805039200/0x3d2d1916761d6ac5 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x375c010249035966 expref: -99 pid: 5757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869442.685944:0:5757:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff94c805038000/0x3d2d1916761d6acc lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869442.685961:0:5757:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94c805038000/0x3d2d1916761d6acc lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869442.685973:0:5757:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94c805038000/0x3d2d1916761d6acc lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869442.685992:0:5757:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94c805038600/0x3d2d1916761d6ad3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869442.685997:0:5757:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94c805038600/0x3d2d1916761d6ad3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869442.686001:0:5757:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94c805038600/0x3d2d1916761d6ad3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869442.686383:0:5757:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94c805038a00/0x3d2d1916761d6ada lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869442.686390:0:5757:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94c805038a00/0x3d2d1916761d6ada lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869442.686394:0:5757:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94c805038a00/0x3d2d1916761d6ada lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5757 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788869442.686403:0:5757:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 8 00010000:00010000:2.0:1788869442.686512:0:5757:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff94c805038000/0x3d2d1916761d6acc lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869442.686520:0:5757:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94c805038000/0x3d2d1916761d6acc lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869442.686526:0:5757:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94c805038000/0x3d2d1916761d6acc lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869442.686533:0:5757:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94c805038000 already unused, calling callback (ffffffffc21124f0) 00010000:00010000:2.0:1788869442.686538:0:5757:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94c805038000/0x3d2d1916761d6acc lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869442.686555:0:5757:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94c805038000/0x3d2d1916761d6acc lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869442.686568:0:5757:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff94c81a585400) 00010000:00010000:2.0:1788869442.686571:0:5757:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788869442.686576:0:5757:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94c805038000/0x3d2d1916761d6acc lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869442.686582:0:5757:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94c805038000/0x3d2d1916761d6acc lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869442.686596:0:5757:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94c805038600/0x3d2d1916761d6ad3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869442.686602:0:5757:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94c805038600/0x3d2d1916761d6ad3 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869442.686608:0:5757:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94c805038600/0x3d2d1916761d6ad3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869442.686613:0:5757:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94c805038600 already unused, calling callback (ffffffffc21124f0) 00010000:00010000:2.0:1788869442.686616:0:5757:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94c805038600/0x3d2d1916761d6ad3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869442.686622:0:5757:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94c805038600/0x3d2d1916761d6ad3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869442.686629:0:5757:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff94c802f3fe00) 00010000:00010000:2.0:1788869442.686632:0:5757:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788869442.686635:0:5757:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94c805038600/0x3d2d1916761d6ad3 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869442.686650:0:5757:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94c805038600/0x3d2d1916761d6ad3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869442.686697:0:5757:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94c805039200/0x3d2d1916761d6ac5 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0x375c010249035966 expref: 33 pid: 5757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869442.686709:0:5757:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94c805038a00/0x3d2d1916761d6ada lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0x375c010249035966 expref: 32 pid: 5757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869442.686714:0:5757:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff94c803990d00) 00010000:00010000:2.0:1788869442.686716:0:5757:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788869442.686718:0:5757:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94c805038a00, rc 0) 00000100:00100000:2.0:1788869442.686812:0:5757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c82cedaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2125b9b3-626e-4cbe-be83-fb446e976ce2+32:10423:x1875765413064064:12345-192.168.201.39@tcp:101:cat.0 Request processed in 1071us (1292us total) trans 4294967373 rc 0/0 00000100:00100000:2.0:1788869442.686821:0:5757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 94 00000100:00100000:1.0:1788869442.692510:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1788869442.692560:0:5759:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765413064320 00000100:00100000:2.0:1788869442.692572:0:5759:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765413064320 00000100:00100000:2.0:1788869442.692631:0:5759:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 24 00000100:00100000:2.0:1788869442.692639:0:5759:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c83513d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2125b9b3-626e-4cbe-be83-fb446e976ce2+32:10423:x1875765413064320:12345-192.168.201.39@tcp:35:cat.0 00000100:00100000:2.0:1788869442.692962:0:5759:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c83513d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2125b9b3-626e-4cbe-be83-fb446e976ce2+33:10423:x1875765413064320:12345-192.168.201.39@tcp:35:cat.0 Request processed in 323us (477us total) trans 4294967374 rc 0/0 00000100:00100000:2.0:1788869442.692972:0:5759:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 24 00000100:00100000:1.0:1788869442.703389:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1788869442.703462:0:5755:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765413064576 00000100:00100000:0.0:1788869442.703474:0:5755:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765413064576 00000100:00100000:0.0:1788869442.703545:0:5755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 95 00000100:00100000:0.0:1788869442.703553:0:5755:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c83513fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2125b9b3-626e-4cbe-be83-fb446e976ce2+33:10424:x1875765413064576:12345-192.168.201.39@tcp:36:rm.0 00010000:00010000:0.0:1788869442.703654:0:5755:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:0.0:1788869442.703686:0:5755:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94c805038a00/0x3d2d1916761d6ada lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.39@tcp remote: 0x375c010249035966 expref: 33 pid: 5757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869442.703709:0:5755:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94c81a583400/0x3d2d1916761d6ab0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.39@tcp remote: 0x375c01024903595f expref: 32 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869442.703719:0:5755:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94c81a583000/0x3d2d1916761d6a78 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.39@tcp remote: 0x375c010249035951 expref: 31 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869442.703727:0:5755:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff94c803990d00) 00010000:00010000:0.0:1788869442.703737:0:5755:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788869442.703773:0:5755:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94c81a582200/0x3d2d1916761d6ae8 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869442.703787:0:5755:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94c81a582200/0x3d2d1916761d6ae8 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869442.703795:0:5755:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94c81a582200/0x3d2d1916761d6ae8 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869442.703807:0:5755:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94c81a582a00/0x3d2d1916761d6aef lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869442.703821:0:5755:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94c81a582a00/0x3d2d1916761d6aef lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869442.703825:0:5755:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94c81a582a00/0x3d2d1916761d6aef lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869442.704461:0:5755:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94c81a583e00/0x3d2d1916761d6af6 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869442.704469:0:5755:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94c81a583e00/0x3d2d1916761d6af6 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869442.704475:0:5755:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94c81a583e00/0x3d2d1916761d6af6 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788869442.705338:0:5755:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].4, 64 off8472 00010000:00010000:0.0:1788869442.705398:0:5755:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94c81a582e00/0x3d2d1916761d6afd lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869442.705406:0:5755:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94c81a582e00/0x3d2d1916761d6afd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869442.705412:0:5755:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94c81a582e00/0x3d2d1916761d6afd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869442.705418:0:5755:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94c81a582e00/0x3d2d1916761d6afd lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869442.705423:0:5755:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94c81a582e00/0x3d2d1916761d6afd lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869442.705426:0:5755:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94c81a582e00/0x3d2d1916761d6afd lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869442.705504:0:5755:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788869442.705525:0:5755:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94c81a583e00/0x3d2d1916761d6af6 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869442.705530:0:5755:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94c81a583e00/0x3d2d1916761d6af6 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869442.705534:0:5755:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94c81a583e00/0x3d2d1916761d6af6 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869442.705538:0:5755:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94c81a583e00 already unused, calling callback (ffffffffc21124f0) 00010000:00010000:0.0:1788869442.705542:0:5755:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94c81a583e00/0x3d2d1916761d6af6 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869442.705548:0:5755:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94c81a583e00/0x3d2d1916761d6af6 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869442.705555:0:5755:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff94c803990200) 00010000:00010000:0.0:1788869442.705557:0:5755:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1788869442.705560:0:5755:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94c81a583e00/0x3d2d1916761d6af6 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869442.705564:0:5755:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94c81a583e00/0x3d2d1916761d6af6 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869442.705579:0:5755:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94c81a582200/0x3d2d1916761d6ae8 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869442.705583:0:5755:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94c81a582200/0x3d2d1916761d6ae8 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869442.705586:0:5755:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94c81a582200/0x3d2d1916761d6ae8 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869442.705594:0:5755:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94c81a582200 already unused, calling callback (ffffffffc21124f0) 00010000:00010000:0.0:1788869442.705596:0:5755:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94c81a582200/0x3d2d1916761d6ae8 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869442.705601:0:5755:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94c81a582200/0x3d2d1916761d6ae8 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869442.705609:0:5755:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff94c81a585400) 00010000:00010000:0.0:1788869442.705611:0:5755:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788869442.705614:0:5755:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94c81a582200/0x3d2d1916761d6ae8 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869442.705620:0:5755:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94c81a582200/0x3d2d1916761d6ae8 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788869442.705631:0:5755:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000071ba81da reply state 00000000b9186a2f transno 4294967375 ns: mdt-lustre-MDT0000_UUID lock: ffff94c81a582a00/0x3d2d1916761d6aef lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788869442.705641:0:5755:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788869442.705732:0:5755:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c83513fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2125b9b3-626e-4cbe-be83-fb446e976ce2+32:10424:x1875765413064576:12345-192.168.201.39@tcp:36:rm.0 Request processed in 2177us (2356us total) trans 4294967375 rc 0/0 00000100:00100000:0.0:1788869442.705739:0:5755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 95 00010000:00010000:3.0:1788869442.705829:0:7447:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788869442.705835:0:7447:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94c81a582e00/0x3d2d1916761d6afd lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869442.705841:0:7447:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94c81a582e00 already unused, calling callback (ffffffffc1703220) 00010000:00010000:3.0:1788869442.705844:0:7447:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94c81a582e00/0x3d2d1916761d6afd lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869442.705849:0:7447:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94c81a582e00/0x3d2d1916761d6afd lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869442.705856:0:7447:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff94c803990200) 00010000:00010000:3.0:1788869442.705857:0:7447:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1788869442.705859:0:7447:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94c81a582e00/0x3d2d1916761d6afd lrc: 1/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869442.705863:0:7447:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94c81a582e00/0x3d2d1916761d6afd lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869442.705876:0:7447:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788869442.705877:0:7447:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788869442.705884:0:7447:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788869442.707116:0:3269:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94c81a582a00/0x3d2d1916761d6aef lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869442.707128:0:3269:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94c81a582a00/0x3d2d1916761d6aef lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869442.707140:0:3269:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94c81a582a00/0x3d2d1916761d6aef lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869442.707145:0:3269:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94c81a582a00 already unused, calling callback (ffffffffc21124f0) 00010000:00010000:2.0:1788869442.707148:0:3269:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94c81a582a00/0x3d2d1916761d6aef lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869442.707152:0:3269:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94c81a582a00/0x3d2d1916761d6aef lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869442.707161:0:3269:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff94c803990c00) 00010000:00010000:2.0:1788869442.707164:0:3269:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788869442.707166:0:3269:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94c81a582a00/0x3d2d1916761d6aef lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869442.707170:0:3269:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94c81a582a00/0x3d2d1916761d6aef lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788869442.725113:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1788869442.725614:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765413064832 00000100:00100000:0.0:1788869442.725627:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765413064832 00000100:00100000:0.0:1788869442.725700:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 96 00000100:00100000:0.0:1788869442.725712:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c83513c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2125b9b3-626e-4cbe-be83-fb446e976ce2+31:10430:x1875765413064832:12345-192.168.201.39@tcp:101:bash.0 00010000:00010000:0.0:1788869442.725746:0:5786:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788869442.725787:0:5786:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94c81a582200/0x3d2d1916761d6b04 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x375c01024903596d expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869442.726166:0:5786:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94c81a583e00/0x3d2d1916761d6b0b lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869442.726185:0:5786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94c81a583e00/0x3d2d1916761d6b0b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869442.726200:0:5786:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94c81a583e00/0x3d2d1916761d6b0b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869442.726216:0:5786:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94c81a583000/0x3d2d1916761d6b12 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869442.726224:0:5786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94c81a583000/0x3d2d1916761d6b12 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869442.726231:0:5786:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94c81a583000/0x3d2d1916761d6b12 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1788869442.726880:0:5786:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x3:0x0], index 0: 0 00010000:00010000:0.0:1788869442.727168:0:5786:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94c81a583400/0x3d2d1916761d6b19 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869442.727181:0:5786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94c81a583400/0x3d2d1916761d6b19 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869442.727190:0:5786:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94c81a583400/0x3d2d1916761d6b19 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869442.727232:0:5786:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94c81a583e00/0x3d2d1916761d6b0b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869442.727345:0:5786:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94c81a583e00/0x3d2d1916761d6b0b lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869442.727353:0:5786:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94c81a583e00/0x3d2d1916761d6b0b lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869442.727361:0:5786:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94c81a583e00 already unused, calling callback (ffffffffc21124f0) 00010000:00010000:0.0:1788869442.727366:0:5786:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94c81a583e00/0x3d2d1916761d6b0b lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869442.727375:0:5786:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94c81a583e00/0x3d2d1916761d6b0b lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869442.727390:0:5786:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff94c81a585400) 00010000:00010000:0.0:1788869442.727394:0:5786:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788869442.727399:0:5786:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94c81a583e00/0x3d2d1916761d6b0b lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869442.727406:0:5786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94c81a583e00/0x3d2d1916761d6b0b lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788869442.727422:0:5786:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000ec931756 reply state 00000000bc78b510 transno 4294967376 ns: mdt-lustre-MDT0000_UUID lock: ffff94c81a583000/0x3d2d1916761d6b12 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788869442.727432:0:5786:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1788869442.727471:0:5786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94c81a582200/0x3d2d1916761d6b04 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0x375c01024903596d expref: 34 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869442.727488:0:5786:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94c81a583400/0x3d2d1916761d6b19 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0x375c01024903596d expref: 33 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869442.727509:0:5786:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff94c803990500) 00010000:00010000:0.0:1788869442.727511:0:5786:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788869442.727514:0:5786:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94c81a583400, rc 0) 00000100:00100000:0.0:1788869442.727616:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c83513c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2125b9b3-626e-4cbe-be83-fb446e976ce2+34:10430:x1875765413064832:12345-192.168.201.39@tcp:101:bash.0 Request processed in 1905us (2516us total) trans 4294967376 rc 0/0 00000100:00100000:0.0:1788869442.727625:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 96 00010000:00010000:1.0:1788869442.729382:0:3270:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94c81a583000/0x3d2d1916761d6b12 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869442.729397:0:3270:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94c81a583000/0x3d2d1916761d6b12 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869442.729404:0:3270:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94c81a583000/0x3d2d1916761d6b12 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869442.729409:0:3270:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94c81a583000 already unused, calling callback (ffffffffc21124f0) 00010000:00010000:1.0:1788869442.729415:0:3270:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94c81a583000/0x3d2d1916761d6b12 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869442.729421:0:3270:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94c81a583000/0x3d2d1916761d6b12 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869442.729437:0:3270:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff94c803990d00) 00010000:00010000:1.0:1788869442.729440:0:3270:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788869442.729443:0:3270:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94c81a583000/0x3d2d1916761d6b12 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869442.729449:0:3270:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94c81a583000/0x3d2d1916761d6b12 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788869442.730431:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1788869442.730529:0:7884:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765413064960 00000100:00100000:2.0:1788869442.730542:0:7884:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765413064960 00000100:00080000:0.0:1788869442.730804:0:5751:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788869442.730829:0:7884:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 34 00000100:00100000:2.0:1788869442.730839:0:7884:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c83513c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:2125b9b3-626e-4cbe-be83-fb446e976ce2+7:2348:x1875765413064960:12345-192.168.201.39@tcp:101:bash.0 00010000:00010000:2.0:1788869442.730859:0:7884:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788869442.730878:0:7884:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f49ccba3/0x3d2d1916761d6b27 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x375c010249035974 expref: -99 pid: 7884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788869442.730909:0:7884:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788869442.730933:0:7884:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=191s v=(0 0) 00010000:00010000:2.0:1788869442.730949:0:7884:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788869442.730958:0:7884:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f49ccba3/0x3d2d1916761d6b27 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.39@tcp remote: 0x375c010249035974 expref: 8 pid: 7884 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869442.730980:0:7884:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000f49ccba3/0x3d2d1916761d6b27 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.39@tcp remote: 0x375c010249035974 expref: 8 pid: 7884 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869442.730995:0:7884:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94c805039200, rc 0) 00000100:00100000:2.0:1788869442.731064:0:7884:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c83513c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:2125b9b3-626e-4cbe-be83-fb446e976ce2+8:2348:x1875765413064960:12345-192.168.201.39@tcp:101:bash.0 Request processed in 227us (637us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869442.731069:0:7884:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 34 00000100:00100000:3.0:1788869442.733465:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1788869442.733520:0:6544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765413065088 00000100:00100000:1.0:1788869442.733531:0:6544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765413065088 00000100:00100000:1.0:1788869442.733587:0:6544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 35 00000100:00100000:1.0:1788869442.733598:0:6544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c82ced8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2125b9b3-626e-4cbe-be83-fb446e976ce2+8:10430:x1875765413065088:12345-192.168.201.39@tcp:101:bash.0 00010000:00010000:1.0:1788869442.733625:0:6544:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788869442.733645:0:6544:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005f210b03/0x3d2d1916761d6b2e lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x375c01024903597b expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869442.733674:0:6544:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000f49ccba3/0x3d2d1916761d6b27 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.39@tcp remote: 0x375c010249035974 expref: 9 pid: 7884 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869442.733683:0:6544:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788869442.733687:0:6544:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788869442.733692:0:6544:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005f210b03/0x3d2d1916761d6b2e lrc: 4/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.201.39@tcp remote: 0x375c01024903597b expref: 9 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869442.733728:0:6544:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000f49ccba3/0x3d2d1916761d6b27 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.39@tcp remote: 0x375c010249035974 expref: 9 pid: 7884 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869442.733741:0:6544:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000f49ccba3/0x3d2d1916761d6b27 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.39@tcp remote: 0x375c010249035974 expref: 9 pid: 7884 timeout: 291 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788869442.733774:0:6544:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94c83513f480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6544:1875765421462656:192.168.201.39@tcp:104: 00000100:00100000:1.0:1788869442.733897:0:6544:0:(client.c:2702:ptlrpc_set_wait()) set ffff94c806043cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788869442.735223:0:6544:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94c83513f480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6544:1875765421462656:192.168.201.39@tcp:104: 00010000:00010000:3.0:1788869442.735295:0:6544:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000005f210b03/0x3d2d1916761d6b2e lrc: 3/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.39@tcp remote: 0x375c01024903597b expref: 9 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869442.735315:0:6544:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94c83fde7c00, rc 0) 00000100:00100000:3.0:1788869442.735366:0:6544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c82ced8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2125b9b3-626e-4cbe-be83-fb446e976ce2+9:10430:x1875765413065088:12345-192.168.201.39@tcp:101:bash.0 Request processed in 1771us (1906us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869442.735376:0:6544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 35 00000100:00100000:0.0:1788869442.740497:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1788869442.740567:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765413065216 00000100:00100000:1.0:1788869442.740581:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765413065216 00010000:00010000:1.0:1788869442.740635:0:5788:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000f49ccba3/0x3d2d1916761d6b27 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.39@tcp remote: 0x375c010249035974 expref: 9 pid: 7884 timeout: 291 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788869442.740685:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 50 00000100:00100000:1.0:1788869442.740718:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c810ef3050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2125b9b3-626e-4cbe-be83-fb446e976ce2+9:2347:x1875765413065216:12345-192.168.201.39@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788869442.740742:0:5788:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788869442.740792:0:5788:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000f49ccba3/0x3d2d1916761d6b27 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.39@tcp remote: 0x375c010249035974 expref: 9 pid: 7884 timeout: 291 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869442.740810:0:5788:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000f49ccba3/0x3d2d1916761d6b27 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.39@tcp remote: 0x375c010249035974 expref: 9 pid: 7884 timeout: 291 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869442.740850:0:5788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f49ccba3/0x3d2d1916761d6b27 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.39@tcp remote: 0x375c010249035974 expref: 9 pid: 7884 timeout: 291 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869442.740872:0:5788:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788869442.740877:0:5788:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788869442.740888:0:5788:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000005f210b03/0x3d2d1916761d6b2e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.39@tcp remote: 0x375c01024903597b expref: 8 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869442.740896:0:5788:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005f210b03/0x3d2d1916761d6b2e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.39@tcp remote: 0x375c01024903597b expref: 8 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869442.740944:0:5788:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 000000005f210b03/0x3d2d1916761d6b2e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.39@tcp remote: 0x375c01024903597b expref: 8 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788869442.740961:0:5788:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94c83513dc00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:5788:1875765421462784:192.168.201.39@tcp:105: 00000100:00100000:1.0:1788869442.741151:0:5788:0:(client.c:2702:ptlrpc_set_wait()) set ffff94c806043480 going to sleep for 11 seconds 00000100:00100000:0.0:1788869442.742480:0:5788:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94c83513dc00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:5788:1875765421462784:192.168.201.39@tcp:105: 00010000:00010000:0.0:1788869442.742505:0:5788:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788869442.742560:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c810ef3050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2125b9b3-626e-4cbe-be83-fb446e976ce2+8:2347:x1875765413065216:12345-192.168.201.39@tcp:103:ldlm_bl.0 Request processed in 1836us (2079us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869442.742572:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 50 00000100:00100000:3.0:1788869442.743512:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1788869442.743960:0:5758:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765413065472 00000100:00100000:0.0:1788869442.743972:0:5758:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765413065472 00000100:00100000:0.0:1788869442.744035:0:5758:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 25 00000100:00100000:0.0:1788869442.744046:0:5758:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c82cedad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2125b9b3-626e-4cbe-be83-fb446e976ce2+33:10430:x1875765413065472:12345-192.168.201.39@tcp:35:bash.0 00000100:00100000:0.0:1788869442.744444:0:5758:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c82cedad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2125b9b3-626e-4cbe-be83-fb446e976ce2+34:10430:x1875765413065472:12345-192.168.201.39@tcp:35:bash.0 Request processed in 401us (936us total) trans 4294967377 rc 0/0 00000100:00100000:0.0:1788869442.744451:0:5758:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 25 00000100:00100000:1.0:1788869442.816228:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1788869442.816444:0:5756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765413065600 00000100:00100000:3.0:1788869442.816458:0:5756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765413065600 00000100:00100000:3.0:1788869442.816532:0:5756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 97 00000100:00100000:3.0:1788869442.816545:0:5756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c83513ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2125b9b3-626e-4cbe-be83-fb446e976ce2+34:10446:x1875765413065600:12345-192.168.201.39@tcp:101:lfs.0 00010000:00010000:3.0:1788869442.816577:0:5756:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788869442.816605:0:5756:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504c600/0x3d2d1916761d6b35 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x375c010249035982 expref: -99 pid: 5756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869442.817443:0:5756:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504ce00/0x3d2d1916761d6b3c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869442.817464:0:5756:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504ce00/0x3d2d1916761d6b3c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869442.817478:0:5756:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504ce00/0x3d2d1916761d6b3c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788869442.817555:0:5756:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 7680 00000004:00200000:3.0:1788869442.817576:0:5756:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:3.0:1788869442.817609:0:5756:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504ce00/0x3d2d1916761d6b3c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869442.818362:0:5756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504c600/0x3d2d1916761d6b35 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0x375c010249035982 expref: 36 pid: 5756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869442.818393:0:5756:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504ce00/0x3d2d1916761d6b3c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0x375c010249035982 expref: 35 pid: 5756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869442.818404:0:5756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff94c81a585400) 00010000:00010000:3.0:1788869442.818407:0:5756:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788869442.818411:0:5756:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94c83504ce00, rc 0) 00000100:00100000:3.0:1788869442.818506:0:5756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c83513ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2125b9b3-626e-4cbe-be83-fb446e976ce2+35:10446:x1875765413065600:12345-192.168.201.39@tcp:101:lfs.0 Request processed in 1962us (2289us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869442.818515:0:5756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 97 00000100:00100000:1.0:1788869442.821344:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1788869442.822644:0:5757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765413065856 00000100:00100000:2.0:1788869442.822669:0:5757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765413065856 00000100:00100000:2.0:1788869442.822773:0:5757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 98 00000100:00100000:2.0:1788869442.822786:0:5757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c83513d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2125b9b3-626e-4cbe-be83-fb446e976ce2+35:10446:x1875765413065856:12345-192.168.201.39@tcp:101:lfs.0 00010000:00010000:2.0:1788869442.822812:0:5757:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788869442.822840:0:5757:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94c805038600/0x3d2d1916761d6b43 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x375c010249035989 expref: -99 pid: 5757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869442.822962:0:5757:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94c805038000/0x3d2d1916761d6b4a lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869442.822974:0:5757:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff94c81a583400/0x3d2d1916761d6b19 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0x375c01024903596d expref: 36 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869442.822981:0:5757:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff94c805038000/0x3d2d1916761d6b4a lrc: 4/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869442.823036:0:5757:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff94c81a583400/0x3d2d1916761d6b19 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.39@tcp remote: 0x375c01024903596d expref: 36 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869442.823048:0:5757:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff94c81a583400/0x3d2d1916761d6b19 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.39@tcp remote: 0x375c01024903596d expref: 36 pid: 5786 timeout: 291 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788869442.823059:0:5757:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94c835a7ca80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5757:1875765421462912:192.168.201.39@tcp:104: 00000100:00100000:2.0:1788869442.823162:0:5757:0:(client.c:2702:ptlrpc_set_wait()) set ffff94c83510e3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788869442.827098:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1788869442.827171:0:5757:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94c835a7ca80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5757:1875765421462912:192.168.201.39@tcp:104: 00000100:00100000:3.0:1788869442.827175:0:5741:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765413065984 00000100:00100000:3.0:1788869442.827186:0:5741:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765413065984 00010000:00010000:2.0:1788869442.827214:0:5757:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff94c805038000/0x3d2d1916761d6b4a lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869442.827240:0:5741:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff94c81a583400/0x3d2d1916761d6b19 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.39@tcp remote: 0x375c01024903596d expref: 37 pid: 5786 timeout: 291 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788869442.827427:0:5741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 51 00000100:00100000:3.0:1788869442.827440:0:5741:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c83513f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2125b9b3-626e-4cbe-be83-fb446e976ce2+37:2348:x1875765413065984:12345-192.168.201.39@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788869442.827461:0:5741:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788869442.827470:0:5741:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff94c81a583400/0x3d2d1916761d6b19 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.39@tcp remote: 0x375c01024903596d expref: 37 pid: 5786 timeout: 291 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869442.827485:0:5741:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff94c81a583400/0x3d2d1916761d6b19 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.39@tcp remote: 0x375c01024903596d expref: 37 pid: 5786 timeout: 291 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869442.827529:0:5741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94c81a583400/0x3d2d1916761d6b19 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.39@tcp remote: 0x375c01024903596d expref: 37 pid: 5786 timeout: 291 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869442.827547:0:5741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff94c803990500) 00010000:00010000:3.0:1788869442.827553:0:5741:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff94c805038000/0x3d2d1916761d6b4a lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869442.827575:0:5741:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff94c805038000/0x3d2d1916761d6b4a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869442.827584:0:5741:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94c805038000/0x3d2d1916761d6b4a lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869442.827813:0:5741:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788869442.827887:0:5741:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c83513f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2125b9b3-626e-4cbe-be83-fb446e976ce2+36:2348:x1875765413065984:12345-192.168.201.39@tcp:103:ldlm_bl.0 Request processed in 449us (803us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869442.827905:0:5741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 51 00010000:00010000:2.0:1788869442.828160:0:5757:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff94c805038000/0x3d2d1916761d6b4a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869442.828169:0:5757:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94c805038000/0x3d2d1916761d6b4a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5757 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788869442.828194:0:5757:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:2.0:1788869442.828506:0:5757:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94c805038600/0x3d2d1916761d6b43 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0x375c010249035989 expref: 37 pid: 5757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869442.828526:0:5757:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94c805038000/0x3d2d1916761d6b4a lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0x375c010249035989 expref: 36 pid: 5757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869442.828535:0:5757:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff94c803990500) 00010000:00010000:2.0:1788869442.828538:0:5757:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1788869442.828550:0:5757:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94c805038000, rc 0) 00000100:00100000:2.0:1788869442.832178:0:5757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c83513d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2125b9b3-626e-4cbe-be83-fb446e976ce2+36:10446:x1875765413065856:12345-192.168.201.39@tcp:101:lfs.0 Request processed in 9378us (10830us total) trans 4294967378 rc 0/0 00000100:00100000:2.0:1788869442.832195:0:5757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 98 00000100:00100000:1.0:1788869442.836140:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1788869442.836213:0:5755:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765413066240 00000100:00100000:0.0:1788869442.836226:0:5755:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765413066240 00000100:00100000:0.0:1788869442.836406:0:5755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 99 00000100:00100000:0.0:1788869442.836419:0:5755:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c83513c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2125b9b3-626e-4cbe-be83-fb446e976ce2+36:10446:x1875765413066240:12345-192.168.201.39@tcp:101:lfs.0 00010000:00010000:0.0:1788869442.836466:0:5755:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788869442.836470:0:5755:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1788869442.836502:0:5755:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94c805038000/0x3d2d1916761d6b4a lrc: 0/0,0 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.39@tcp remote: 0x375c010249035989 expref: 36 pid: 5757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869442.836524:0:5755:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff94c803990500) 00010000:00010000:0.0:1788869442.836535:0:5755:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788869442.836552:0:5755:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94c81a583e00/0x3d2d1916761d6b58 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x375c010249035990 expref: -99 pid: 5755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869442.836686:0:5755:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94c81a583400/0x3d2d1916761d6b5f lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869442.836708:0:5755:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94c81a583400/0x3d2d1916761d6b5f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869442.836718:0:5755:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94c81a583400/0x3d2d1916761d6b5f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788869442.836732:0:5755:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:0.0:1788869442.836902:0:5755:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94c81a583e00/0x3d2d1916761d6b58 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0x375c010249035990 expref: 38 pid: 5755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869442.836917:0:5755:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94c81a583400/0x3d2d1916761d6b5f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0x375c010249035990 expref: 37 pid: 5755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869442.836925:0:5755:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff94c803990800) 00010000:00010000:0.0:1788869442.836928:0:5755:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1788869442.836930:0:5755:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94c81a583400, rc 0) 00000100:00100000:0.0:1788869442.837010:0:5755:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c83513c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2125b9b3-626e-4cbe-be83-fb446e976ce2+37:10446:x1875765413066240:12345-192.168.201.39@tcp:101:lfs.0 Request processed in 594us (884us total) trans 4294967379 rc 0/0 00000100:00100000:0.0:1788869442.837018:0:5755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 99 00000100:00100000:1.0:1788869442.840551:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1788869442.840765:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765413066368 00000100:00100000:0.0:1788869442.840779:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765413066368 00000100:00100000:0.0:1788869442.840854:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 100 00000100:00100000:0.0:1788869442.840866:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c83513d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2125b9b3-626e-4cbe-be83-fb446e976ce2+37:10446:x1875765413066368:12345-192.168.201.39@tcp:101:lfs.0 00010000:00010000:0.0:1788869442.840897:0:5786:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788869442.840922:0:5786:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94c81a583000/0x3d2d1916761d6b6d lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x375c010249035997 expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869442.841008:0:5786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94c81a583000/0x3d2d1916761d6b6d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.39@tcp remote: 0x375c010249035997 expref: 38 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869442.841025:0:5786:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94c81a583000/0x3d2d1916761d6b6d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.39@tcp remote: 0x375c010249035997 expref: 38 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869442.841045:0:5786:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff94c803990800) 00010000:00010000:0.0:1788869442.841049:0:5786:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788869442.841054:0:5786:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94c81a583000, rc 0) 00000100:00100000:0.0:1788869442.841124:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c83513d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2125b9b3-626e-4cbe-be83-fb446e976ce2+38:10446:x1875765413066368:12345-192.168.201.39@tcp:101:lfs.0 Request processed in 260us (587us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869442.841131:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 100 00000100:00100000:1.0:1788869442.845682:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1788869442.845831:0:7884:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765413066496 00000100:00100000:2.0:1788869442.845845:0:7884:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765413066496 00000100:00100000:2.0:1788869442.846000:0:7884:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 36 00000100:00100000:2.0:1788869442.846014:0:7884:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c83513ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:2125b9b3-626e-4cbe-be83-fb446e976ce2+8:2348:x1875765413066496:12345-192.168.201.39@tcp:1:lfs.0 00010000:00010000:2.0:1788869442.846082:0:7884:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000052cb237f/0x3d2d1916761d6b74 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 7884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869442.846109:0:7884:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000005f210b03/0x3d2d1916761d6b2e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.39@tcp remote: 0x375c01024903597b expref: 8 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869442.846119:0:7884:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788869442.846124:0:7884:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788869442.846129:0:7884:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000052cb237f/0x3d2d1916761d6b74 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 7884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869442.846174:0:7884:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000005f210b03/0x3d2d1916761d6b2e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.201.39@tcp remote: 0x375c01024903597b expref: 8 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869442.846189:0:7884:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000005f210b03/0x3d2d1916761d6b2e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.201.39@tcp remote: 0x375c01024903597b expref: 8 pid: 6544 timeout: 291 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788869442.846205:0:7884:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94c835a7ca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:7884:1875765421463040:192.168.201.39@tcp:104: 00000100:00100000:2.0:1788869442.846344:0:7884:0:(client.c:2702:ptlrpc_set_wait()) set ffff94c83510e3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788869442.854667:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1788869442.854693:0:7884:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94c835a7ca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:7884:1875765421463040:192.168.201.39@tcp:104: 00010000:00010000:2.0:1788869442.854729:0:7884:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000052cb237f/0x3d2d1916761d6b74 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 7884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788869442.854805:0:6552:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765413066624 00000100:00100000:3.0:1788869442.854815:0:6552:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765413066624 00002000:00100000:3.0:1788869442.854876:0:6552:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3:0x0] (0->8) req@ffff94c83513df80 x1875765413066624/t0(0) o4->2125b9b3-626e-4cbe-be83-fb446e976ce2@192.168.201.39@tcp:388/0 lens 504/0 e 0 to 0 dl 1788869453 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788869442.854888:0:6552:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff94c83513df80 with x1875765413066624 ext(0->8) 00010000:00010000:3.0:1788869442.854897:0:6552:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 000000005f210b03/0x3d2d1916761d6b2e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.39@tcp remote: 0x375c01024903597b expref: 9 pid: 6544 timeout: 291 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869442.854913:0:6552:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 000000005f210b03/0x3d2d1916761d6b2e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.39@tcp remote: 0x375c01024903597b expref: 9 pid: 6544 timeout: 291 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788869442.854943:0:6552:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff94c83513df80 00000100:00100000:3.0:1788869442.854981:0:6552:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 1 00000100:00100000:3.0:1788869442.854992:0:6552:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c83513df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:2125b9b3-626e-4cbe-be83-fb446e976ce2+9:2347:x1875765413066624:12345-192.168.201.39@tcp:4:lfs.0 00000100:00100000:3.0:1788869442.855659:0:6552:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c83513df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:2125b9b3-626e-4cbe-be83-fb446e976ce2+11:2347:x1875765413066624:12345-192.168.201.39@tcp:4:lfs.0 Request processed in 666us (1005us total) trans 4294967302 rc 0/0 00000100:00100000:3.0:1788869442.855669:0:6552:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 1 00002000:00100000:3.0:1788869442.855678:0:6552:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3:0x0] (0->8) req@ffff94c83513df80 x1875765413066624/t4294967302(0) o4->2125b9b3-626e-4cbe-be83-fb446e976ce2@192.168.201.39@tcp:388/0 lens 504/448 e 0 to 0 dl 1788869453 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788869442.855687:0:6552:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff94c83513df80 with x1875765413066624 ext(0->8) 00010000:00010000:3.0:1788869442.855693:0:6552:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 000000005f210b03/0x3d2d1916761d6b2e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.39@tcp remote: 0x375c01024903597b expref: 11 pid: 6544 timeout: 291 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869442.855706:0:6552:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 000000005f210b03/0x3d2d1916761d6b2e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.39@tcp remote: 0x375c01024903597b expref: 11 pid: 6544 timeout: 291 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788869442.855713:0:6552:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff94c83513df80 00000100:00100000:3.0:1788869442.859198:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1788869442.859289:0:5739:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765413066752 00000100:00100000:2.0:1788869442.859301:0:5739:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765413066752 00010000:00010000:2.0:1788869442.859347:0:5739:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000005f210b03/0x3d2d1916761d6b2e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.39@tcp remote: 0x375c01024903597b expref: 11 pid: 6544 timeout: 291 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788869442.859389:0:5739:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 52 00000100:00100000:2.0:1788869442.859397:0:5739:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c82ced9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2125b9b3-626e-4cbe-be83-fb446e976ce2+11:2346:x1875765413066752:12345-192.168.201.39@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788869442.859414:0:5739:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:2.0:1788869442.859435:0:5739:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:2.0:1788869442.859437:0:5739:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb mtime from disk: 0 -> 1788869441 00002000:00010000:2.0:1788869442.859439:0:5739:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb atime from disk: 0 -> 1788869441 00002000:00010000:2.0:1788869442.859441:0:5739:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb ctime from disk: 0 -> 1788869441 00010000:00010000:2.0:1788869442.859446:0:5739:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000005f210b03/0x3d2d1916761d6b2e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.39@tcp remote: 0x375c01024903597b expref: 11 pid: 6544 timeout: 291 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869442.859458:0:5739:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000005f210b03/0x3d2d1916761d6b2e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.201.39@tcp remote: 0x375c01024903597b expref: 11 pid: 6544 timeout: 291 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869442.859484:0:5739:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005f210b03/0x3d2d1916761d6b2e lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.201.39@tcp remote: 0x375c01024903597b expref: 11 pid: 6544 timeout: 291 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869442.859500:0:5739:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788869442.859519:0:5739:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788869442.859525:0:5739:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000052cb237f/0x3d2d1916761d6b74 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 7884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869442.859534:0:5739:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000052cb237f/0x3d2d1916761d6b74 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 7884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869442.859624:0:5739:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788869442.859680:0:5739:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c82ced9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2125b9b3-626e-4cbe-be83-fb446e976ce2+10:2346:x1875765413066752:12345-192.168.201.39@tcp:103:ldlm_bl.0 Request processed in 283us (496us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869442.859685:0:5739:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 52 00010000:00010000:1.0:1788869442.859882:0:7884:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000052cb237f/0x3d2d1916761d6b74 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 7884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869442.859902:0:7884:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000052cb237f/0x3d2d1916761d6b74 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 7884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869442.859932:0:7884:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000052cb237f/0x3d2d1916761d6b74 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 7884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869442.859941:0:7884:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000052cb237f/0x3d2d1916761d6b74 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 7884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869442.859950:0:7884:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000052cb237f/0x3d2d1916761d6b74 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 7884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869442.859957:0:7884:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94c805038600 already unused, calling callback (ffffffffc1703220) 00010000:00010000:1.0:1788869442.859961:0:7884:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000052cb237f/0x3d2d1916761d6b74 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 7884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869442.859971:0:7884:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000052cb237f/0x3d2d1916761d6b74 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 7884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869442.859998:0:7884:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000052cb237f/0x3d2d1916761d6b74 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 7884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869442.860006:0:7884:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000052cb237f/0x3d2d1916761d6b74 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 7884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788869442.860081:0:7884:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c83513ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:2125b9b3-626e-4cbe-be83-fb446e976ce2+9:2348:x1875765413066496:12345-192.168.201.39@tcp:1:lfs.0 Request processed in 14071us (14411us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869442.860091:0:7884:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 36 00000100:00100000:3.0:1788869442.865393:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1788869442.865447:0:5759:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765413067008 00000100:00100000:2.0:1788869442.865462:0:5759:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765413067008 00000100:00100000:2.0:1788869442.865566:0:5759:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 26 00000100:00100000:2.0:1788869442.865586:0:5759:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c818769450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2125b9b3-626e-4cbe-be83-fb446e976ce2+38:10446:x1875765413067008:12345-192.168.201.39@tcp:35:lfs.0 00000004:00010000:2.0:1788869442.865698:0:5759:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0x7:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff94c81a583400/0x3d2d1916761d6b5f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0x375c010249035990 expref: 38 pid: 5755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788869442.866088:0:5759:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967380 00000001:00080000:2.0:1788869442.866133:0:5759:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967381 00000001:00080000:2.0:1788869442.868123:0:5759:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967382 00010000:00010000:2.0:1788869442.868215:0:5759:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94c805039600/0x3d2d1916761d6b7b lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869442.868237:0:5759:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff94c81a583000/0x3d2d1916761d6b6d lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.39@tcp remote: 0x375c010249035997 expref: 42 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869442.868246:0:5759:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff94c805039600/0x3d2d1916761d6b7b lrc: 4/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869442.868318:0:5759:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff94c81a583000/0x3d2d1916761d6b6d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.201.39@tcp remote: 0x375c010249035997 expref: 42 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869442.868334:0:5759:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff94c81a583000/0x3d2d1916761d6b6d lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.201.39@tcp remote: 0x375c010249035997 expref: 42 pid: 5786 timeout: 291 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788869442.868349:0:5759:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94c835a7ca80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5759:1875765421463168:192.168.201.39@tcp:104: 00000100:00100000:2.0:1788869442.868452:0:5759:0:(client.c:2702:ptlrpc_set_wait()) set ffff94c83510e3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788869442.871705:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1788869442.871855:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765413067136 00000100:00100000:0.0:1788869442.871868:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765413067136 00010000:00010000:0.0:1788869442.871931:0:5788:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff94c81a583000/0x3d2d1916761d6b6d lrc: 5/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.39@tcp remote: 0x375c010249035997 expref: 43 pid: 5786 timeout: 291 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788869442.872059:0:5759:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94c835a7ca80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5759:1875765421463168:192.168.201.39@tcp:104: 00000100:00100000:0.0:1788869442.872068:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 53 00000100:00100000:0.0:1788869442.872083:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c82ced9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2125b9b3-626e-4cbe-be83-fb446e976ce2+43:2348:x1875765413067136:12345-192.168.201.39@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788869442.872101:0:5759:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff94c805039600/0x3d2d1916761d6b7b lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869442.872105:0:5788:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788869442.872116:0:5788:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff94c81a583000/0x3d2d1916761d6b6d lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.39@tcp remote: 0x375c010249035997 expref: 43 pid: 5786 timeout: 291 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869442.872132:0:5788:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff94c81a583000/0x3d2d1916761d6b6d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.201.39@tcp remote: 0x375c010249035997 expref: 43 pid: 5786 timeout: 291 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869442.872162:0:5788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94c81a583000/0x3d2d1916761d6b6d lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.201.39@tcp remote: 0x375c010249035997 expref: 43 pid: 5786 timeout: 291 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869442.872182:0:5788:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff94c803990800) 00010000:00010000:0.0:1788869442.872188:0:5788:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff94c805039600/0x3d2d1916761d6b7b lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869442.872200:0:5788:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff94c805039600/0x3d2d1916761d6b7b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869442.872209:0:5788:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94c805039600/0x3d2d1916761d6b7b lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869442.872231:0:5788:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788869442.872233:0:5759:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff94c805039600/0x3d2d1916761d6b7b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869442.872243:0:5759:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94c805039600/0x3d2d1916761d6b7b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5759 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788869442.872350:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c82ced9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2125b9b3-626e-4cbe-be83-fb446e976ce2+42:2348:x1875765413067136:12345-192.168.201.39@tcp:103:ldlm_bl.0 Request processed in 269us (658us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869442.872359:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 53 00000001:00080000:2.0:1788869442.872521:0:5759:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967383 00000001:00080000:2.0:1788869442.872897:0:5759:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967384 00000100:00100000:2.0:1788869442.873039:0:5759:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94c835a7ca80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5759:1875765421463296:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1788869442.873104:0:5759:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869442.873417:0:5759:0:(client.c:2702:ptlrpc_set_wait()) set ffff94c81075a240 going to sleep for 11 seconds 00000100:00100000:3.0:1788869442.874775:0:5760:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765421463296 00000100:00100000:3.0:1788869442.874791:0:5760:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765421463296 00000100:00100000:3.0:1788869442.874909:0:5760:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788869442.874921:0:5760:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c835a7ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:5759:x1875765421463296:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1788869442.875068:0:5760:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c835a7ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:5759:x1875765421463296:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 149us (1963us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869442.875087:0:5760:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788869442.875137:0:5759:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94c835a7ca80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5759:1875765421463296:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:0.0:1788869442.875682:0:5759:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967385 00000100:00100000:0.0:1788869442.875797:0:5759:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94c82cda8380 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5759:1875765421463424:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1788869442.875857:0:5759:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869442.875888:0:5759:0:(client.c:2702:ptlrpc_set_wait()) set ffff94c83fd696c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788869442.875929:0:5761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765421463424 00000100:00100000:2.0:1788869442.875934:0:5761:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765421463424 00000100:00100000:2.0:1788869442.875965:0:5761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788869442.875971:0:5761:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c82cda8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:5759:x1875765421463424:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1788869442.876243:0:5761:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c82cda8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+8:5759:x1875765421463424:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 271us (386us total) trans 4294967303 rc 0/0 00000100:00100000:2.0:1788869442.876280:0:5761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788869442.876318:0:5759:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94c82cda8380 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5759:1875765421463424:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:0.0:1788869442.876365:0:5759:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967386 00010000:00010000:0.0:1788869442.876403:0:5759:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94c805039600/0x3d2d1916761d6b7b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869442.876414:0:5759:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94c805039600/0x3d2d1916761d6b7b lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869442.876423:0:5759:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94c805039600/0x3d2d1916761d6b7b lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869442.876429:0:5759:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94c805039600 already unused, calling callback (ffffffffc21124f0) 00010000:00010000:0.0:1788869442.876435:0:5759:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94c805039600/0x3d2d1916761d6b7b lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869442.876444:0:5759:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94c805039600/0x3d2d1916761d6b7b lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869442.876462:0:5759:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff94c803990800) 00010000:00010000:0.0:1788869442.876465:0:5759:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:0.0:1788869442.876470:0:5759:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94c805039600/0x3d2d1916761d6b7b lrc: 2/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869442.876477:0:5759:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94c805039600/0x3d2d1916761d6b7b lrc: 0/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5759 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1788869442.876655:0:5759:0:(mdd_object.c:4016:mdd_close()) Object [0x200000401:0x8:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:0.0:1788869442.876822:0:5759:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].3, 64 off8384 00000004:00080000:0.0:1788869442.876835:0:5759:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 191168584411ns, next at 192168581826ns, rc = 0 00000001:00080000:0.0:1788869442.876843:0:5759:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967387 00010000:00010000:0.0:1788869442.876877:0:5759:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff94c803990800) 00010000:00010000:0.0:1788869442.876881:0:5759:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1788869442.876889:0:5759:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94c81a583400/0x3d2d1916761d6b5f lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.39@tcp remote: 0x375c010249035990 expref: 46 pid: 5755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788869442.877010:0:5759:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c818769450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2125b9b3-626e-4cbe-be83-fb446e976ce2+45:10446:x1875765413067008:12345-192.168.201.39@tcp:35:lfs.0 Request processed in 11426us (11630us total) trans 4294967388 rc 0/0 00000100:00100000:0.0:1788869442.877020:0:5759:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 26 00000020:00080000:0.0:1788869442.877024:0:5759:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:3.0:1788869442.879482:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1788869442.879676:0:5756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765413067264 00000100:00100000:0.0:1788869442.879687:0:5756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765413067264 00000100:00100000:0.0:1788869442.879853:0:5756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 101 00000100:00100000:0.0:1788869442.879867:0:5756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c82ced9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2125b9b3-626e-4cbe-be83-fb446e976ce2+45:10446:x1875765413067264:12345-192.168.201.39@tcp:101:lfs.0 00010000:00010000:0.0:1788869442.879907:0:5756:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788869442.879936:0:5756:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94c81a583000/0x3d2d1916761d6b82 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x375c01024903599e expref: -99 pid: 5756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869442.880012:0:5756:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94c81a583000/0x3d2d1916761d6b82 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.39@tcp remote: 0x375c01024903599e expref: 46 pid: 5756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869442.880030:0:5756:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94c81a583000/0x3d2d1916761d6b82 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.39@tcp remote: 0x375c01024903599e expref: 46 pid: 5756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869442.880052:0:5756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff94c803990500) 00010000:00010000:0.0:1788869442.880056:0:5756:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788869442.880076:0:5756:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94c81a583000, rc 0) 00000100:00100000:0.0:1788869442.880139:0:5756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c82ced9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2125b9b3-626e-4cbe-be83-fb446e976ce2+46:10446:x1875765413067264:12345-192.168.201.39@tcp:101:lfs.0 Request processed in 276us (669us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869442.880146:0:5756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 101 00000100:00100000:3.0:1788869442.885779:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1788869442.885850:0:5758:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765413067520 00000100:00100000:0.0:1788869442.885864:0:5758:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765413067520 00000100:00100000:0.0:1788869442.885943:0:5758:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 27 00000100:00100000:0.0:1788869442.885954:0:5758:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c82ceda300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2125b9b3-626e-4cbe-be83-fb446e976ce2+46:10446:x1875765413067520:12345-192.168.201.39@tcp:35:lfs.0 00000100:00100000:0.0:1788869442.886922:0:5758:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c82ceda300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2125b9b3-626e-4cbe-be83-fb446e976ce2+47:10446:x1875765413067520:12345-192.168.201.39@tcp:35:lfs.0 Request processed in 958us (1143us total) trans 4294967389 rc 0/0 00000100:00100000:0.0:1788869442.886935:0:5758:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 27 00000100:00100000:2.0:1788869442.954348:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1788869442.954477:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765413067648 00000100:00100000:0.0:1788869442.954488:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765413067648 00000100:00100000:0.0:1788869442.954547:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 102 00000100:00100000:0.0:1788869442.954558:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c835a7ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2125b9b3-626e-4cbe-be83-fb446e976ce2+47:10456:x1875765413067648:12345-192.168.201.39@tcp:34:lfs.0 00010000:00010000:0.0:1788869442.954634:0:5786:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff94c81a583400/0x3d2d1916761d6b89 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869442.954651:0:5786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94c81a583400/0x3d2d1916761d6b89 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869442.954663:0:5786:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94c81a583400/0x3d2d1916761d6b89 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869442.954678:0:5786:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94c81a583e00/0x3d2d1916761d6b90 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869442.954685:0:5786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94c81a583e00/0x3d2d1916761d6b90 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869442.954710:0:5786:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94c81a583e00/0x3d2d1916761d6b90 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869442.954850:0:5786:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94c81a582200/0x3d2d1916761d6b97 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869442.954859:0:5786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94c81a582200/0x3d2d1916761d6b97 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869442.954867:0:5786:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94c81a582200/0x3d2d1916761d6b97 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788869442.954907:0:5786:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff94c81a582200/0x3d2d1916761d6b97 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869442.954921:0:5786:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff94c81a583400/0x3d2d1916761d6b89 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869442.954927:0:5786:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94c81a583400/0x3d2d1916761d6b89 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869442.954934:0:5786:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94c81a583400/0x3d2d1916761d6b89 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869442.954940:0:5786:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94c81a583400 already unused, calling callback (ffffffffc21124f0) 00010000:00010000:0.0:1788869442.954945:0:5786:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94c81a583400/0x3d2d1916761d6b89 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869442.954952:0:5786:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94c81a583400/0x3d2d1916761d6b89 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869442.954965:0:5786:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff94c81a585400) 00010000:00010000:0.0:1788869442.954974:0:5786:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788869442.954979:0:5786:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94c81a583400/0x3d2d1916761d6b89 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869442.954986:0:5786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94c81a583400/0x3d2d1916761d6b89 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869442.955000:0:5786:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94c81a583e00/0x3d2d1916761d6b90 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869442.955006:0:5786:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94c81a583e00/0x3d2d1916761d6b90 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869442.955011:0:5786:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94c81a583e00/0x3d2d1916761d6b90 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869442.955017:0:5786:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94c81a583e00 already unused, calling callback (ffffffffc21124f0) 00010000:00010000:0.0:1788869442.955019:0:5786:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94c81a583e00/0x3d2d1916761d6b90 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869442.955025:0:5786:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94c81a583e00/0x3d2d1916761d6b90 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869442.955033:0:5786:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff94c803990800) 00010000:00010000:0.0:1788869442.955036:0:5786:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788869442.955039:0:5786:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94c81a583e00/0x3d2d1916761d6b90 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869442.955044:0:5786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94c81a583e00/0x3d2d1916761d6b90 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869442.955057:0:5786:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94c81a582200/0x3d2d1916761d6b97 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869442.955069:0:5786:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94c81a582200/0x3d2d1916761d6b97 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869442.955075:0:5786:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94c81a582200/0x3d2d1916761d6b97 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869442.955080:0:5786:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94c81a582200 already unused, calling callback (ffffffffc21124f0) 00010000:00010000:0.0:1788869442.955083:0:5786:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94c81a582200/0x3d2d1916761d6b97 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869442.955089:0:5786:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94c81a582200/0x3d2d1916761d6b97 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869442.955097:0:5786:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff94c803990500) 00010000:00010000:0.0:1788869442.955099:0:5786:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788869442.955102:0:5786:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94c81a582200/0x3d2d1916761d6b97 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869442.955108:0:5786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94c81a582200/0x3d2d1916761d6b97 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788869442.955187:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c835a7ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2125b9b3-626e-4cbe-be83-fb446e976ce2+47:10456:x1875765413067648:12345-192.168.201.39@tcp:34:lfs.0 Request processed in 630us (847us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869442.955196:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 102 00010000:00010000:0.0:1788869442.973004:0:5743:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788869442.986713:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1788869442.986848:0:5755:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765413067904 00000100:00100000:2.0:1788869442.986857:0:5755:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765413067904 00000100:00100000:2.0:1788869442.986989:0:5755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 103 00000100:00100000:2.0:1788869442.986998:0:5755:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c82ceda680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2125b9b3-626e-4cbe-be83-fb446e976ce2+47:10459:x1875765413067904:12345-192.168.201.39@tcp:101:lfs.0 00010000:00010000:2.0:1788869442.987015:0:5755:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788869442.987032:0:5755:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94c805039200/0x3d2d1916761d6b9e lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x375c0102490359a5 expref: -99 pid: 5755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869442.987109:0:5755:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff94c805038a00/0x3d2d1916761d6ba5 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869442.987120:0:5755:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94c805038a00/0x3d2d1916761d6ba5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869442.987129:0:5755:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94c805038a00/0x3d2d1916761d6ba5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869442.987139:0:5755:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94c805039800/0x3d2d1916761d6bac lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869442.987143:0:5755:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94c805039800/0x3d2d1916761d6bac lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869442.987147:0:5755:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94c805039800/0x3d2d1916761d6bac lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869442.987305:0:5755:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94c805039a00/0x3d2d1916761d6bb3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869442.987314:0:5755:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94c805039a00/0x3d2d1916761d6bb3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869442.987321:0:5755:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94c805039a00/0x3d2d1916761d6bb3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788869442.987330:0:5755:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:2.0:1788869442.987453:0:5755:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff94c805038a00/0x3d2d1916761d6ba5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869442.987461:0:5755:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94c805038a00/0x3d2d1916761d6ba5 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869442.987467:0:5755:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94c805038a00/0x3d2d1916761d6ba5 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869442.987473:0:5755:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94c805038a00 already unused, calling callback (ffffffffc21124f0) 00010000:00010000:2.0:1788869442.987481:0:5755:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94c805038a00/0x3d2d1916761d6ba5 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869442.987489:0:5755:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94c805038a00/0x3d2d1916761d6ba5 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869442.987500:0:5755:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff94c81a585400) 00010000:00010000:2.0:1788869442.987503:0:5755:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788869442.987508:0:5755:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94c805038a00/0x3d2d1916761d6ba5 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869442.987525:0:5755:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94c805038a00/0x3d2d1916761d6ba5 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869442.987542:0:5755:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94c805039800/0x3d2d1916761d6bac lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869442.987548:0:5755:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94c805039800/0x3d2d1916761d6bac lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869442.987554:0:5755:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94c805039800/0x3d2d1916761d6bac lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869442.987559:0:5755:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94c805039800 already unused, calling callback (ffffffffc21124f0) 00010000:00010000:2.0:1788869442.987562:0:5755:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94c805039800/0x3d2d1916761d6bac lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869442.987568:0:5755:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94c805039800/0x3d2d1916761d6bac lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869442.987576:0:5755:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff94c802f3fe00) 00010000:00010000:2.0:1788869442.987580:0:5755:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788869442.987583:0:5755:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94c805039800/0x3d2d1916761d6bac lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869442.987589:0:5755:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94c805039800/0x3d2d1916761d6bac lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869442.987627:0:5755:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94c805039200/0x3d2d1916761d6b9e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0x375c0102490359a5 expref: 50 pid: 5755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869442.987641:0:5755:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94c805039a00/0x3d2d1916761d6bb3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0x375c0102490359a5 expref: 49 pid: 5755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869442.987656:0:5755:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff94c803990500) 00010000:00010000:2.0:1788869442.987659:0:5755:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788869442.987662:0:5755:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94c805039a00, rc 0) 00000100:00100000:2.0:1788869442.987727:0:5755:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c82ceda680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2125b9b3-626e-4cbe-be83-fb446e976ce2+49:10459:x1875765413067904:12345-192.168.201.39@tcp:101:lfs.0 Request processed in 725us (1016us total) trans 4294967390 rc 0/0 00000100:00100000:2.0:1788869442.987735:0:5755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 103 00000100:00100000:3.0:1788869442.987786:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1788869442.987864:0:5748:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765413068032 00000100:00100000:1.0:1788869442.987871:0:5748:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765413068032 00000100:00100000:1.0:1788869442.987912:0:5748:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 266 00000100:00100000:1.0:1788869442.987921:0:5748:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c81f14c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3cca3acf-4935-4d0d-9982-d5d931f1c86b+13:2346:x1875765413068032:12345-192.168.201.39@tcp:400:kworker.0 00000100:00100000:1.0:1788869442.987975:0:5748:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c81f14c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3cca3acf-4935-4d0d-9982-d5d931f1c86b+13:2346:x1875765413068032:12345-192.168.201.39@tcp:400:kworker.0 Request processed in 49us (191us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869442.987982:0:5748:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 266 00000100:00100000:1.0:1788869442.988035:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1788869442.988432:0:5756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765413068160 00000100:00100000:0.0:1788869442.988436:0:5756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765413068160 00000100:00100000:0.0:1788869442.988484:0:5756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 85 00000100:00100000:0.0:1788869442.988489:0:5756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c83513e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:10cd6f3c-009b-4acc-9ca5-e50cb17e412c+5:2346:x1875765413068160:12345-192.168.201.39@tcp:400:kworker.0 00000100:00100000:0.0:1788869442.988523:0:5756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c83513e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:10cd6f3c-009b-4acc-9ca5-e50cb17e412c+5:2346:x1875765413068160:12345-192.168.201.39@tcp:400:kworker.0 Request processed in 34us (489us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869442.988528:0:5756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 85 00000100:00080000:3.0:1788869442.988727:0:5751:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788869442.991099:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1788869442.991193:0:5756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765413068288 00000100:00100000:0.0:1788869442.991202:0:5756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765413068288 00000100:00100000:0.0:1788869442.991291:0:5756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 104 00000100:00100000:0.0:1788869442.991300:0:5756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c82cedad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2125b9b3-626e-4cbe-be83-fb446e976ce2+49:10459:x1875765413068288:12345-192.168.201.39@tcp:54:lfs.0 00010000:00010000:0.0:1788869442.991357:0:5756:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94c81a583e00/0x3d2d1916761d6bc1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869442.991373:0:5756:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94c81a583e00/0x3d2d1916761d6bc1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869442.991384:0:5756:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94c81a583e00/0x3d2d1916761d6bc1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869442.991411:0:5756:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94c81a583e00/0x3d2d1916761d6bc1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869442.991419:0:5756:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94c81a583e00/0x3d2d1916761d6bc1 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869442.991426:0:5756:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94c81a583e00/0x3d2d1916761d6bc1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869442.991432:0:5756:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94c81a583e00 already unused, calling callback (ffffffffc21124f0) 00010000:00010000:0.0:1788869442.991437:0:5756:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94c81a583e00/0x3d2d1916761d6bc1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869442.991456:0:5756:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94c81a583e00/0x3d2d1916761d6bc1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869442.991481:0:5756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff94c803990500) 00010000:00010000:0.0:1788869442.991484:0:5756:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788869442.991489:0:5756:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94c81a583e00/0x3d2d1916761d6bc1 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869442.991496:0:5756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94c81a583e00/0x3d2d1916761d6bc1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788869442.991553:0:5756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c82cedad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2125b9b3-626e-4cbe-be83-fb446e976ce2+49:10459:x1875765413068288:12345-192.168.201.39@tcp:54:lfs.0 Request processed in 254us (472us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869442.991561:0:5756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 104 00000100:00100000:0.0:1788869442.993555:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1788869442.993980:0:5759:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765413068544 00000100:00100000:2.0:1788869442.993989:0:5759:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765413068544 00000100:00100000:2.0:1788869442.994075:0:5759:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 28 00000100:00100000:2.0:1788869442.994095:0:5759:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c82cda9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2125b9b3-626e-4cbe-be83-fb446e976ce2+49:10459:x1875765413068544:12345-192.168.201.39@tcp:35:lfs.0 00000100:00100000:2.0:1788869442.994343:0:5759:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c82cda9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2125b9b3-626e-4cbe-be83-fb446e976ce2+50:10459:x1875765413068544:12345-192.168.201.39@tcp:35:lfs.0 Request processed in 259us (792us total) trans 4294967391 rc 0/0 00000100:00100000:2.0:1788869442.994352:0:5759:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 28 00000100:00100000:1.0:1788869443.048315:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1788869443.048450:0:5755:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765413068800 00000100:00100000:3.0:1788869443.048461:0:5755:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765413068800 00000100:00100000:3.0:1788869443.048573:0:5755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 105 00000100:00100000:3.0:1788869443.048584:0:5755:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c83513ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2125b9b3-626e-4cbe-be83-fb446e976ce2+50:10469:x1875765413068800:12345-192.168.201.39@tcp:101:bash.0 00010000:00010000:3.0:1788869443.048607:0:5755:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788869443.048621:0:5755:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1788869443.048649:0:5755:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504ce00/0x3d2d1916761d6b3c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.39@tcp remote: 0x375c010249035982 expref: 50 pid: 5756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869443.048669:0:5755:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff94c81a585400) 00010000:00010000:3.0:1788869443.048676:0:5755:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788869443.048689:0:5755:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504c600/0x3d2d1916761d6bc8 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x375c0102490359ac expref: -99 pid: 5755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869443.048801:0:5755:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504ca00/0x3d2d1916761d6bcf lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1788869443.048913:0:5751:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1788869443.049005:0:5755:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff94c805039a00/0x3d2d1916761d6bb3 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0x375c0102490359a5 expref: 50 pid: 5755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869443.049017:0:5755:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504ca00/0x3d2d1916761d6bcf lrc: 4/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869443.049079:0:5755:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff94c805039a00/0x3d2d1916761d6bb3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.39@tcp remote: 0x375c0102490359a5 expref: 50 pid: 5755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869443.049093:0:5755:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff94c805039a00/0x3d2d1916761d6bb3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.39@tcp remote: 0x375c0102490359a5 expref: 50 pid: 5755 timeout: 291 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788869443.049107:0:5755:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94c835a16300 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5755:1875765421463552:192.168.201.39@tcp:104: 00000100:00100000:3.0:1788869443.049204:0:5755:0:(client.c:2702:ptlrpc_set_wait()) set ffff94c8357d5f00 going to sleep for 11 seconds 00000100:00100000:0.0:1788869443.056481:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1788869443.056623:0:5755:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94c835a16300 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5755:1875765421463552:192.168.201.39@tcp:104: 00010000:00010000:3.0:1788869443.056652:0:5755:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504ca00/0x3d2d1916761d6bcf lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788869443.056807:0:5741:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765413068928 00000100:00100000:2.0:1788869443.056824:0:5741:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765413068928 00010000:00010000:2.0:1788869443.056866:0:5741:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff94c805039a00/0x3d2d1916761d6bb3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.39@tcp remote: 0x375c0102490359a5 expref: 51 pid: 5755 timeout: 291 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788869443.056906:0:5741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 54 00000100:00100000:2.0:1788869443.056915:0:5741:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c82cdaad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2125b9b3-626e-4cbe-be83-fb446e976ce2+51:2348:x1875765413068928:12345-192.168.201.39@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788869443.056930:0:5741:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788869443.056936:0:5741:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff94c805039a00/0x3d2d1916761d6bb3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.39@tcp remote: 0x375c0102490359a5 expref: 51 pid: 5755 timeout: 291 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869443.056948:0:5741:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff94c805039a00/0x3d2d1916761d6bb3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.39@tcp remote: 0x375c0102490359a5 expref: 51 pid: 5755 timeout: 291 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869443.056984:0:5741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94c805039a00/0x3d2d1916761d6bb3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.39@tcp remote: 0x375c0102490359a5 expref: 51 pid: 5755 timeout: 291 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869443.057000:0:5741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff94c803990500) 00010000:00010000:2.0:1788869443.057005:0:5741:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504ca00/0x3d2d1916761d6bcf lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869443.057015:0:5741:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504ca00/0x3d2d1916761d6bcf lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869443.057022:0:5741:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504ca00/0x3d2d1916761d6bcf lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869443.057042:0:5741:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788869443.057095:0:5741:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c82cdaad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2125b9b3-626e-4cbe-be83-fb446e976ce2+50:2348:x1875765413068928:12345-192.168.201.39@tcp:103:ldlm_bl.0 Request processed in 180us (624us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869443.057102:0:5741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 54 00010000:00010000:0.0:1788869443.057159:0:5755:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504ca00/0x3d2d1916761d6bcf lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869443.057167:0:5755:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504ca00/0x3d2d1916761d6bcf lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788869443.057185:0:5755:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:0.0:1788869443.057371:0:5755:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504c600/0x3d2d1916761d6bc8 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0x375c0102490359ac expref: 51 pid: 5755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869443.057387:0:5755:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504ca00/0x3d2d1916761d6bcf lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0x375c0102490359ac expref: 50 pid: 5755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869443.057394:0:5755:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff94c803990500) 00010000:00010000:0.0:1788869443.057397:0:5755:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1788869443.057406:0:5755:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94c83504ca00, rc 0) 00000100:00100000:0.0:1788869443.057433:0:5755:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c83513ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2125b9b3-626e-4cbe-be83-fb446e976ce2+50:10469:x1875765413068800:12345-192.168.201.39@tcp:101:bash.0 Request processed in 8851us (9126us total) trans 4294967392 rc 0/0 00000100:00100000:0.0:1788869443.057439:0:5755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 105 00000100:00100000:0.0:1788869443.062910:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1788869443.063112:0:5756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765413069184 00000100:00100000:3.0:1788869443.063122:0:5756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765413069184 00000100:00100000:3.0:1788869443.063237:0:5756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 106 00000100:00100000:3.0:1788869443.063289:0:5756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c82cda9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2125b9b3-626e-4cbe-be83-fb446e976ce2+50:10469:x1875765413069184:12345-192.168.201.39@tcp:36:bash.0 00010000:00010000:3.0:1788869443.063595:0:5756:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504ce00/0x3d2d1916761d6bdd lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869443.063614:0:5756:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504ce00/0x3d2d1916761d6bdd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869443.063626:0:5756:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504ce00/0x3d2d1916761d6bdd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788869443.063676:0:5756:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967393 00000004:00010000:3.0:1788869443.063703:0:5756:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000997eaf3a reply state 000000002c725301 transno 4294967394 ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504ce00/0x3d2d1916761d6bdd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788869443.063718:0:5756:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788869443.063821:0:5756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c82cda9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2125b9b3-626e-4cbe-be83-fb446e976ce2+53:10469:x1875765413069184:12345-192.168.201.39@tcp:36:bash.0 Request processed in 573us (919us total) trans 4294967394 rc 0/0 00000100:00100000:3.0:1788869443.063828:0:5756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 106 00000020:00080000:3.0:1788869443.063833:0:5756:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1788869443.070389:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1788869443.070583:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765413069312 00000100:00100000:1.0:1788869443.070592:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765413069312 00000100:00100000:1.0:1788869443.070648:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 107 00000100:00100000:1.0:1788869443.070658:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c82cdab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2125b9b3-626e-4cbe-be83-fb446e976ce2+53:10469:x1875765413069312:12345-192.168.201.39@tcp:101:bash.0 00010000:00010000:1.0:1788869443.070683:0:5786:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788869443.070702:0:5786:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94c83fde6a00/0x3d2d1916761d6be4 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x375c0102490359b3 expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869443.070807:0:5786:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94c83fde6800/0x3d2d1916761d6beb lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869443.070822:0:5786:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504ca00/0x3d2d1916761d6bcf lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0x375c0102490359ac expref: 54 pid: 5755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869443.070828:0:5786:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504ce00/0x3d2d1916761d6bdd lrc: 2/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869443.070835:0:5786:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff94c83fde6800/0x3d2d1916761d6beb lrc: 5/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869443.070852:0:5786:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504ce00/0x3d2d1916761d6bdd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869443.070875:0:5786:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504ca00/0x3d2d1916761d6bcf lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.39@tcp remote: 0x375c0102490359ac expref: 54 pid: 5755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869443.070889:0:5786:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504ca00/0x3d2d1916761d6bcf lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.39@tcp remote: 0x375c0102490359ac expref: 54 pid: 5755 timeout: 291 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788869443.070903:0:5786:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94c83513ca80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:5786:1875765421463680:192.168.201.39@tcp:104: 00000100:00100000:1.0:1788869443.070982:0:5786:0:(client.c:2702:ptlrpc_set_wait()) set ffff94c806043a80 going to sleep for 11 seconds 00010000:00010000:2.0:1788869443.071456:0:3269:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504ce00/0x3d2d1916761d6bdd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000020 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869443.071467:0:3269:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504ce00/0x3d2d1916761d6bdd lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000020 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869443.071474:0:3269:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504ce00/0x3d2d1916761d6bdd lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869443.071480:0:3269:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94c83504ce00 already unused, calling callback (ffffffffc21124f0) 00010000:00010000:2.0:1788869443.071484:0:3269:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504ce00/0x3d2d1916761d6bdd lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869443.071503:0:3269:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504ce00/0x3d2d1916761d6bdd lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000020 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869443.071517:0:3269:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff94c803990500) 00010000:00010000:2.0:1788869443.071521:0:3269:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788869443.071524:0:3269:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff94c83fde6800/0x3d2d1916761d6beb lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869443.071533:0:3269:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504ce00/0x3d2d1916761d6bdd lrc: 2/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000020 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869443.071540:0:3269:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504ce00/0x3d2d1916761d6bdd lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000020 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788869443.078081:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1788869443.078319:0:7448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765413069440 00000100:00100000:3.0:1788869443.078328:0:7448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765413069440 00010000:00010000:3.0:1788869443.078383:0:7448:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504ca00/0x3d2d1916761d6bcf lrc: 5/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.39@tcp remote: 0x375c0102490359ac expref: 54 pid: 5755 timeout: 291 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788869443.078418:0:7448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 55 00000100:00100000:3.0:1788869443.078427:0:7448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c82cda8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:2125b9b3-626e-4cbe-be83-fb446e976ce2+54:2347:x1875765413069440:12345-192.168.201.39@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788869443.078442:0:7448:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788869443.078449:0:7448:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504ca00/0x3d2d1916761d6bcf lrc: 5/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.39@tcp remote: 0x375c0102490359ac expref: 54 pid: 5755 timeout: 291 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869443.078463:0:7448:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504ca00/0x3d2d1916761d6bcf lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.39@tcp remote: 0x375c0102490359ac expref: 54 pid: 5755 timeout: 291 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869443.078484:0:7448:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff94c803990500) 00010000:00010000:3.0:1788869443.078489:0:7448:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff94c83fde6800/0x3d2d1916761d6beb lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869443.078499:0:7448:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff94c83fde6800/0x3d2d1916761d6beb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869443.078508:0:7448:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94c83fde6800/0x3d2d1916761d6beb lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869443.078542:0:7448:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788869443.078599:0:7448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c82cda8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:2125b9b3-626e-4cbe-be83-fb446e976ce2+54:2347:x1875765413069440:12345-192.168.201.39@tcp:103:ldlm_bl.0 Request processed in 173us (527us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869443.078606:0:7448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 55 00010000:00010000:1.0:1788869443.078847:0:5786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504ca00/0x3d2d1916761d6bcf lrc: 0/0,0 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.39@tcp remote: 0x375c0102490359ac expref: 53 pid: 5755 timeout: 291 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788869443.078864:0:5786:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94c83513ca80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:5786:1875765421463680:192.168.201.39@tcp:104: 00010000:00010000:1.0:1788869443.078892:0:5786:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff94c83fde6800/0x3d2d1916761d6beb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869443.078901:0:5786:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff94c83fde6800/0x3d2d1916761d6beb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869443.078907:0:5786:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94c83fde6800/0x3d2d1916761d6beb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788869443.078952:0:5786:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:1.0:1788869443.078956:0:5786:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1788869443.078977:0:5786:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff94c83fde6800/0x3d2d1916761d6beb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869443.079005:0:5786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94c83fde6a00/0x3d2d1916761d6be4 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0x375c0102490359b3 expref: 53 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869443.079020:0:5786:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94c83fde6800/0x3d2d1916761d6beb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0x375c0102490359b3 expref: 52 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869443.079026:0:5786:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff94c803990500) 00010000:00010000:1.0:1788869443.079029:0:5786:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788869443.079031:0:5786:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94c83fde6800, rc 0) 00000100:00100000:1.0:1788869443.079057:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c82cdab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2125b9b3-626e-4cbe-be83-fb446e976ce2+52:10469:x1875765413069312:12345-192.168.201.39@tcp:101:bash.0 Request processed in 8401us (8687us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869443.079064:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 107 00000100:00100000:1.0:1788869443.082200:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1788869443.082541:0:5758:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765413069696 00000100:00100000:0.0:1788869443.082613:0:5758:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765413069696 00000100:00100000:0.0:1788869443.082706:0:5758:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 29 00000100:00100000:0.0:1788869443.082716:0:5758:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c83513ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2125b9b3-626e-4cbe-be83-fb446e976ce2+52:10469:x1875765413069696:12345-192.168.201.39@tcp:35:bash.0 00000100:00100000:0.0:1788869443.082968:0:5758:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c83513ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2125b9b3-626e-4cbe-be83-fb446e976ce2+53:10469:x1875765413069696:12345-192.168.201.39@tcp:35:bash.0 Request processed in 253us (779us total) trans 4294967395 rc 0/0 00000100:00100000:0.0:1788869443.082977:0:5758:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 29 00000100:00100000:2.0:1788869443.128924:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1788869443.129041:0:5757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765413069824 00000100:00100000:3.0:1788869443.129051:0:5757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765413069824 00000100:00100000:3.0:1788869443.129121:0:5757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 108 00000100:00100000:3.0:1788869443.129132:0:5757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c83c6f1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2125b9b3-626e-4cbe-be83-fb446e976ce2+53:10475:x1875765413069824:12345-192.168.201.39@tcp:101:lfs.0 00010000:00010000:3.0:1788869443.129156:0:5757:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788869443.129175:0:5757:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504ce00/0x3d2d1916761d6bf2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x375c0102490359ba expref: -99 pid: 5757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869443.129239:0:5757:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504c600/0x3d2d1916761d6bf9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869443.129387:0:5757:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504c600/0x3d2d1916761d6bf9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869443.129400:0:5757:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504c600/0x3d2d1916761d6bf9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5757 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788869443.129460:0:5757:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 7680 00000004:00200000:3.0:1788869443.129464:0:5757:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:3.0:1788869443.129485:0:5757:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504c600/0x3d2d1916761d6bf9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869443.129509:0:5757:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504ce00/0x3d2d1916761d6bf2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0x375c0102490359ba expref: 55 pid: 5757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869443.129547:0:5757:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504c600/0x3d2d1916761d6bf9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0x375c0102490359ba expref: 54 pid: 5757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869443.129556:0:5757:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff94c81a585400) 00010000:00010000:3.0:1788869443.129559:0:5757:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788869443.129563:0:5757:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94c83504c600, rc 0) 00000100:00100000:3.0:1788869443.130039:0:5757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c83c6f1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2125b9b3-626e-4cbe-be83-fb446e976ce2+54:10475:x1875765413069824:12345-192.168.201.39@tcp:101:lfs.0 Request processed in 908us (1124us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869443.130048:0:5757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 108 00000100:00100000:3.0:1788869443.135178:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1788869443.135489:0:5755:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765413069952 00000100:00100000:0.0:1788869443.135500:0:5755:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765413069952 00000100:00100000:0.0:1788869443.135558:0:5755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 109 00000100:00100000:0.0:1788869443.135568:0:5755:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c835a16300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2125b9b3-626e-4cbe-be83-fb446e976ce2+54:10475:x1875765413069952:12345-192.168.201.39@tcp:101:lfs.0 00010000:00010000:0.0:1788869443.135587:0:5755:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788869443.135607:0:5755:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94c81a582a00/0x3d2d1916761d6c00 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x375c0102490359c1 expref: -99 pid: 5755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869443.135668:0:5755:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff94c81a582e00/0x3d2d1916761d6c07 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869443.135682:0:5755:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94c81a582e00/0x3d2d1916761d6c07 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869443.135709:0:5755:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94c81a582e00/0x3d2d1916761d6c07 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869443.135726:0:5755:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94c81a583400/0x3d2d1916761d6c0e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869443.135733:0:5755:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94c81a583400/0x3d2d1916761d6c0e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869443.135739:0:5755:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94c81a583400/0x3d2d1916761d6c0e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869443.135843:0:5755:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94c81a583e00/0x3d2d1916761d6c15 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869443.135852:0:5755:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94c81a583e00/0x3d2d1916761d6c15 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869443.135858:0:5755:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94c81a583e00/0x3d2d1916761d6c15 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788869443.135889:0:5755:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:0.0:1788869443.135893:0:5755:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1788869443.135909:0:5755:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff94c81a583e00/0x3d2d1916761d6c15 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869443.135920:0:5755:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94c81a583e00/0x3d2d1916761d6c15 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869443.135927:0:5755:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff94c81a582e00/0x3d2d1916761d6c07 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869443.135944:0:5755:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94c81a582e00/0x3d2d1916761d6c07 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869443.135950:0:5755:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94c81a582e00/0x3d2d1916761d6c07 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869443.135956:0:5755:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94c81a582e00 already unused, calling callback (ffffffffc21124f0) 00010000:00010000:0.0:1788869443.135960:0:5755:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94c81a582e00/0x3d2d1916761d6c07 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869443.135966:0:5755:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94c81a582e00/0x3d2d1916761d6c07 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869443.135977:0:5755:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff94c81a585400) 00010000:00010000:0.0:1788869443.135980:0:5755:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788869443.135984:0:5755:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94c81a582e00/0x3d2d1916761d6c07 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869443.135990:0:5755:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94c81a582e00/0x3d2d1916761d6c07 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869443.136002:0:5755:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94c81a583400/0x3d2d1916761d6c0e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869443.136007:0:5755:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94c81a583400/0x3d2d1916761d6c0e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869443.136012:0:5755:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94c81a583400/0x3d2d1916761d6c0e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869443.136017:0:5755:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94c81a583400 already unused, calling callback (ffffffffc21124f0) 00010000:00010000:0.0:1788869443.136025:0:5755:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94c81a583400/0x3d2d1916761d6c0e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869443.136031:0:5755:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94c81a583400/0x3d2d1916761d6c0e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869443.136037:0:5755:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff94c803990800) 00010000:00010000:0.0:1788869443.136040:0:5755:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788869443.136042:0:5755:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94c81a583400/0x3d2d1916761d6c0e lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869443.136047:0:5755:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94c81a583400/0x3d2d1916761d6c0e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869443.136074:0:5755:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94c81a582a00/0x3d2d1916761d6c00 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0x375c0102490359c1 expref: 56 pid: 5755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869443.136087:0:5755:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94c81a583e00/0x3d2d1916761d6c15 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0x375c0102490359c1 expref: 55 pid: 5755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869443.136094:0:5755:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff94c803990500) 00010000:00010000:0.0:1788869443.136096:0:5755:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788869443.136099:0:5755:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94c81a583e00, rc 0) 00000100:00100000:0.0:1788869443.136159:0:5755:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c835a16300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2125b9b3-626e-4cbe-be83-fb446e976ce2+55:10475:x1875765413069952:12345-192.168.201.39@tcp:101:lfs.0 Request processed in 592us (989us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869443.136166:0:5755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 109 00000100:00100000:1.0:1788869443.138848:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1788869443.138922:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765413070080 00000100:00100000:0.0:1788869443.138930:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765413070080 00000100:00100000:0.0:1788869443.139046:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 5 00000100:00100000:0.0:1788869443.139057:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c83513e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2125b9b3-626e-4cbe-be83-fb446e976ce2+55:2348:x1875765413070080:12345-192.168.201.39@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788869443.139085:0:5788:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788869443.139109:0:5788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94c81a583e00/0x3d2d1916761d6c15 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.39@tcp remote: 0x375c0102490359c1 expref: 55 pid: 5755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869443.139128:0:5788:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff94c803990500) 00010000:00010000:0.0:1788869443.139133:0:5788:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788869443.139187:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c83513e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2125b9b3-626e-4cbe-be83-fb446e976ce2+54:2348:x1875765413070080:12345-192.168.201.39@tcp:103:ldlm_bl.0 Request processed in 132us (346us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869443.139194:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 5 00000100:00100000:2.0:1788869443.143187:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1788869443.143358:0:5756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765413070336 00000100:00100000:0.0:1788869443.143367:0:5756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765413070336 00000100:00100000:0.0:1788869443.143479:0:5756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 110 00000100:00100000:0.0:1788869443.143489:0:5756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c81f1f1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2125b9b3-626e-4cbe-be83-fb446e976ce2+54:10475:x1875765413070336:12345-192.168.201.39@tcp:101:lfs.0 00010000:00010000:0.0:1788869443.143511:0:5756:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788869443.143531:0:5756:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94c81a582a00/0x3d2d1916761d6c1c lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x375c0102490359c8 expref: -99 pid: 5756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869443.143627:0:5756:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94c81a583400/0x3d2d1916761d6c23 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869443.143648:0:5756:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff94c83fde6800/0x3d2d1916761d6beb lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0x375c0102490359b3 expref: 55 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869443.143658:0:5756:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff94c81a583400/0x3d2d1916761d6c23 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869443.143690:0:5756:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff94c83fde6800/0x3d2d1916761d6beb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.39@tcp remote: 0x375c0102490359b3 expref: 55 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869443.143720:0:5756:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff94c83fde6800/0x3d2d1916761d6beb lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.39@tcp remote: 0x375c0102490359b3 expref: 55 pid: 5786 timeout: 291 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788869443.143733:0:5756:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94c82cda9180 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5756:1875765421463808:192.168.201.39@tcp:104: 00000100:00100000:0.0:1788869443.143828:0:5756:0:(client.c:2702:ptlrpc_set_wait()) set ffff94c83fd69a80 going to sleep for 11 seconds 00000100:00100000:3.0:1788869443.148501:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1788869443.148602:0:5756:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94c82cda9180 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5756:1875765421463808:192.168.201.39@tcp:104: 00010000:00010000:0.0:1788869443.148628:0:5756:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff94c81a583400/0x3d2d1916761d6c23 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788869443.148706:0:5739:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765413070464 00000100:00100000:2.0:1788869443.148713:0:5739:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765413070464 00010000:00010000:2.0:1788869443.148758:0:5739:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff94c83fde6800/0x3d2d1916761d6beb lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.39@tcp remote: 0x375c0102490359b3 expref: 56 pid: 5786 timeout: 291 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788869443.148796:0:5739:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 56 00000100:00100000:2.0:1788869443.148805:0:5739:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c810ef0050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2125b9b3-626e-4cbe-be83-fb446e976ce2+56:2348:x1875765413070464:12345-192.168.201.39@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788869443.148819:0:5739:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788869443.148825:0:5739:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff94c83fde6800/0x3d2d1916761d6beb lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.39@tcp remote: 0x375c0102490359b3 expref: 56 pid: 5786 timeout: 291 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869443.148836:0:5739:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff94c83fde6800/0x3d2d1916761d6beb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.39@tcp remote: 0x375c0102490359b3 expref: 56 pid: 5786 timeout: 291 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869443.149027:0:5739:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94c83fde6800/0x3d2d1916761d6beb lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.39@tcp remote: 0x375c0102490359b3 expref: 56 pid: 5786 timeout: 291 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869443.149043:0:5739:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff94c803990500) 00010000:00010000:2.0:1788869443.149048:0:5739:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff94c81a583400/0x3d2d1916761d6c23 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869443.149057:0:5739:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff94c81a583400/0x3d2d1916761d6c23 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869443.149065:0:5739:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94c81a583400/0x3d2d1916761d6c23 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869443.149133:0:5739:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788869443.149185:0:5739:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c810ef0050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2125b9b3-626e-4cbe-be83-fb446e976ce2+55:2348:x1875765413070464:12345-192.168.201.39@tcp:103:ldlm_bl.0 Request processed in 381us (693us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869443.149192:0:5739:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 56 00010000:00010000:0.0:1788869443.149642:0:5756:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff94c81a583400/0x3d2d1916761d6c23 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869443.149650:0:5756:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94c81a583400/0x3d2d1916761d6c23 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788869443.149670:0:5756:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:0.0:1788869443.149824:0:5756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94c81a582a00/0x3d2d1916761d6c1c lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0x375c0102490359c8 expref: 56 pid: 5756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869443.149840:0:5756:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94c81a583400/0x3d2d1916761d6c23 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0x375c0102490359c8 expref: 55 pid: 5756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869443.149848:0:5756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff94c803990500) 00010000:00010000:0.0:1788869443.149851:0:5756:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1788869443.149853:0:5756:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94c81a583400, rc 0) 00000100:00100000:0.0:1788869443.151937:0:5756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c81f1f1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2125b9b3-626e-4cbe-be83-fb446e976ce2+55:10475:x1875765413070336:12345-192.168.201.39@tcp:101:lfs.0 Request processed in 8440us (8749us total) trans 4294967396 rc 0/0 00000100:00100000:0.0:1788869443.151965:0:5756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 110 00000100:00100000:3.0:1788869443.155127:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1788869443.155793:0:5740:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765413070720 00000100:00100000:1.0:1788869443.155822:0:5740:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765413070720 00000100:00100000:1.0:1788869443.155922:0:5740:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 6 00000100:00100000:1.0:1788869443.155932:0:5740:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c835a15880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2125b9b3-626e-4cbe-be83-fb446e976ce2+55:10475:x1875765413070720:12345-192.168.201.39@tcp:103:lfs.0 00010000:00010000:1.0:1788869443.155948:0:5740:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788869443.155979:0:5740:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94c81a583000/0x3d2d1916761d6b82 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.39@tcp remote: 0x375c01024903599e expref: 55 pid: 5756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869443.155998:0:5740:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff94c803990500) 00010000:00010000:1.0:1788869443.156002:0:5740:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788869443.156061:0:5740:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c835a15880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2125b9b3-626e-4cbe-be83-fb446e976ce2+54:10475:x1875765413070720:12345-192.168.201.39@tcp:103:lfs.0 Request processed in 131us (949us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869443.156067:0:5740:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 6 00000100:00100000:0.0:1788869443.160904:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1788869443.160972:0:5755:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765413070848 00000100:00100000:3.0:1788869443.160989:0:5755:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765413070848 00000100:00100000:3.0:1788869443.161057:0:5755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 111 00000100:00100000:3.0:1788869443.161069:0:5755:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c82cda9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2125b9b3-626e-4cbe-be83-fb446e976ce2+54:10475:x1875765413070848:12345-192.168.201.39@tcp:58:lfs.0 00010000:00010000:3.0:1788869443.161198:0:5755:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504ce00/0x3d2d1916761d6c31 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869443.161221:0:5755:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504ce00/0x3d2d1916761d6c31 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869443.161232:0:5755:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504ce00/0x3d2d1916761d6c31 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788869443.162690:0:5755:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].2, 136 off8464 00000100:00100000:2.0:1788869443.162945:0:5755:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c82cda9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2125b9b3-626e-4cbe-be83-fb446e976ce2+54:10475:x1875765413070848:12345-192.168.201.39@tcp:58:lfs.0 Request processed in 1873us (2045us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869443.162958:0:5755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 111 00000100:00100000:0.0:1788869443.165731:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1788869443.166057:0:5757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765413070976 00000100:00100000:2.0:1788869443.166071:0:5757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765413070976 00000100:00100000:2.0:1788869443.166142:0:5757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 112 00000100:00100000:2.0:1788869443.166155:0:5757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c82cda8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2125b9b3-626e-4cbe-be83-fb446e976ce2+54:10475:x1875765413070976:12345-192.168.201.39@tcp:101:lfs.0 00010000:00010000:2.0:1788869443.166181:0:5757:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788869443.166207:0:5757:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94c805038a00/0x3d2d1916761d6c38 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x375c0102490359cf expref: -99 pid: 5757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869443.166978:0:5757:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504ce00/0x3d2d1916761d6c31 lrc: 2/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869443.166996:0:5757:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff94c805038a00/0x3d2d1916761d6c38 lrc: 4/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.39@tcp remote: 0x375c0102490359cf expref: 55 pid: 5757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869443.167021:0:5757:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504ce00/0x3d2d1916761d6c31 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869443.167037:0:5757:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94c805038a00/0x3d2d1916761d6c38 lrc: 3/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.39@tcp remote: 0x375c0102490359cf expref: 55 pid: 5757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869443.167053:0:5757:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff94c803990500) 00010000:00010000:2.0:1788869443.167057:0:5757:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788869443.167061:0:5757:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff94c805038a00/0x3d2d1916761d6c38 lrc: 3/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.39@tcp remote: 0x375c0102490359cf expref: 55 pid: 5757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869443.167070:0:5757:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94c805038a00, rc 0) 00000100:00100000:2.0:1788869443.167183:0:5757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c82cda8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2125b9b3-626e-4cbe-be83-fb446e976ce2+55:10475:x1875765413070976:12345-192.168.201.39@tcp:101:lfs.0 Request processed in 1030us (1458us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869443.167192:0:5757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 112 00000040:00080000:2.0:1788869443.355613:0:11485:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788869443.355624:0:11485:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788869443.355691:0:11485:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 3 count 3 00000040:00080000:2.0:1788869443.355701:0:11485:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1788869443.355873:0:11485:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94c81f1f1c00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11485:1875765421463936:192.168.201.39@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1788869443.356007:0:11485:0:(client.c:2702:ptlrpc_set_wait()) set ffff94c81075a600 going to sleep for 11 seconds 00000100:00100000:0.0:1788869443.359410:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1788869443.359450:0:11485:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94c81f1f1c00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11485:1875765421463936:192.168.201.39@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1788869443.359484:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765413071104 00000100:00100000:1.0:1788869443.359498:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765413071104 00000100:00100000:1.0:1788869443.359581:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 113 00000100:00100000:1.0:1788869443.359594:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c82cda9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2125b9b3-626e-4cbe-be83-fb446e976ce2+55:10476:x1875765413071104:12345-192.168.201.39@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1788869443.359638:0:5786:0:(mdt_handler.c:8041:mdt_fid2path()) path get [0x200000401:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1788869443.359768:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c82cda9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2125b9b3-626e-4cbe-be83-fb446e976ce2+55:10476:x1875765413071104:12345-192.168.201.39@tcp:53:lhsmtool_posix.0 Request processed in 177us (370us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869443.359773:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 113 00000100:00100000:0.0:1788869443.362854:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1788869443.362983:0:5756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765413071232 00000100:00100000:3.0:1788869443.362996:0:5756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765413071232 00000100:00100000:3.0:1788869443.363087:0:5756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 114 00000100:00100000:3.0:1788869443.363100:0:5756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c82cdaa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2125b9b3-626e-4cbe-be83-fb446e976ce2+55:10476:x1875765413071232:12345-192.168.201.39@tcp:34:lhsmtool_posix.0 00010000:00010000:3.0:1788869443.363197:0:5756:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504d400/0x3d2d1916761d6c3f lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869443.363213:0:5756:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504d400/0x3d2d1916761d6c3f lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869443.363223:0:5756:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504d400/0x3d2d1916761d6c3f lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869443.364536:0:5756:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504d600/0x3d2d1916761d6c46 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869443.364561:0:5756:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504d600/0x3d2d1916761d6c46 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869443.364574:0:5756:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504d600/0x3d2d1916761d6c46 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869443.364610:0:5756:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504c000/0x3d2d1916761d6c4d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869443.364620:0:5756:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504c000/0x3d2d1916761d6c4d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869443.364627:0:5756:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504c000/0x3d2d1916761d6c4d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788869443.364673:0:5756:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:3.0:1788869443.364678:0:5756:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1788869443.364692:0:5756:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504c000/0x3d2d1916761d6c4d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869443.364729:0:5756:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504d400/0x3d2d1916761d6c3f lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869443.364735:0:5756:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504d400/0x3d2d1916761d6c3f lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869443.364741:0:5756:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504d400/0x3d2d1916761d6c3f lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869443.364761:0:5756:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94c83504d400 already unused, calling callback (ffffffffc21124f0) 00010000:00010000:3.0:1788869443.364766:0:5756:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504d400/0x3d2d1916761d6c3f lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869443.364772:0:5756:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504d400/0x3d2d1916761d6c3f lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869443.364785:0:5756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff94c819394200) 00010000:00010000:3.0:1788869443.364788:0:5756:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788869443.364792:0:5756:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504d400/0x3d2d1916761d6c3f lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869443.364799:0:5756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504d400/0x3d2d1916761d6c3f lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869443.364815:0:5756:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504d600/0x3d2d1916761d6c46 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869443.364821:0:5756:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504d600/0x3d2d1916761d6c46 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869443.364826:0:5756:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504d600/0x3d2d1916761d6c46 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869443.364837:0:5756:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94c83504d600 already unused, calling callback (ffffffffc21124f0) 00010000:00010000:3.0:1788869443.364840:0:5756:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504d600/0x3d2d1916761d6c46 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869443.364846:0:5756:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504d600/0x3d2d1916761d6c46 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869443.364855:0:5756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x77a79f1b (ffff94c819394800) 00010000:00010000:3.0:1788869443.364857:0:5756:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788869443.364860:0:5756:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504d600/0x3d2d1916761d6c46 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869443.364866:0:5756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504d600/0x3d2d1916761d6c46 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869443.364880:0:5756:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504c000/0x3d2d1916761d6c4d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869443.364895:0:5756:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504c000/0x3d2d1916761d6c4d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869443.364901:0:5756:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504c000/0x3d2d1916761d6c4d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869443.364907:0:5756:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94c83504c000 already unused, calling callback (ffffffffc21124f0) 00010000:00010000:3.0:1788869443.364910:0:5756:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504c000/0x3d2d1916761d6c4d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869443.364916:0:5756:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504c000/0x3d2d1916761d6c4d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869443.364934:0:5756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff94c803990500) 00010000:00010000:3.0:1788869443.364937:0:5756:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788869443.364940:0:5756:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504c000/0x3d2d1916761d6c4d lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869443.364947:0:5756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504c000/0x3d2d1916761d6c4d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788869443.365044:0:5756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c82cdaa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2125b9b3-626e-4cbe-be83-fb446e976ce2+55:10476:x1875765413071232:12345-192.168.201.39@tcp:34:lhsmtool_posix.0 Request processed in 1943us (2200us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869443.365054:0:5756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 114 00000100:00100000:2.0:1788869443.367056:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1788869443.367323:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765413071488 00000100:00100000:1.0:1788869443.367338:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765413071488 00000100:00100000:1.0:1788869443.367415:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 115 00000100:00100000:1.0:1788869443.367426:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c81f1f1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2125b9b3-626e-4cbe-be83-fb446e976ce2+55:10476:x1875765413071488:12345-192.168.201.39@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788869443.367447:0:5786:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788869443.367469:0:5786:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94c83fde6a00/0x3d2d1916761d6c54 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x375c0102490359d6 expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869443.367600:0:5786:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94c83fde7400/0x3d2d1916761d6c5b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869443.367615:0:5786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94c83fde7400/0x3d2d1916761d6c5b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869443.367639:0:5786:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94c83fde7400/0x3d2d1916761d6c5b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788869443.367657:0:5786:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:1.0:1788869443.367774:0:5786:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94c83fde7400/0x3d2d1916761d6c5b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869443.367782:0:5786:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94c83fde7400/0x3d2d1916761d6c5b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869443.367789:0:5786:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94c83fde7400/0x3d2d1916761d6c5b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869443.367796:0:5786:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94c83fde7400 already unused, calling callback (ffffffffc21124f0) 00010000:00010000:1.0:1788869443.367800:0:5786:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94c83fde7400/0x3d2d1916761d6c5b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869443.367807:0:5786:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94c83fde7400/0x3d2d1916761d6c5b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869443.367819:0:5786:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff94c803990500) 00010000:00010000:1.0:1788869443.367822:0:5786:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1788869443.367827:0:5786:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94c83fde7400/0x3d2d1916761d6c5b lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869443.367844:0:5786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94c83fde7400/0x3d2d1916761d6c5b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869443.367893:0:5786:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94c83fde6a00/0x3d2d1916761d6c54 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0x375c0102490359d6 expref: 57 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869443.367905:0:5786:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff94c819394200) 00010000:00010000:1.0:1788869443.367907:0:5786:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788869443.367911:0:5786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94c83fde6a00/0x3d2d1916761d6c54 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.39@tcp remote: 0x375c0102490359d6 expref: 57 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869443.367921:0:5786:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94c83fde6a00, rc 0) 00000100:00100000:1.0:1788869443.367978:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c81f1f1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2125b9b3-626e-4cbe-be83-fb446e976ce2+56:10476:x1875765413071488:12345-192.168.201.39@tcp:101:lhsmtool_posix.0 Request processed in 554us (969us total) trans 4294967397 rc 301/301 00000100:00100000:1.0:1788869443.367985:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 115 00000100:00100000:0.0:1788869443.370685:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1788869443.370832:0:5757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765413071616 00000100:00100000:2.0:1788869443.370841:0:5757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765413071616 00000100:00100000:2.0:1788869443.370898:0:5757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 116 00000100:00100000:2.0:1788869443.370908:0:5757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c82cdaaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2125b9b3-626e-4cbe-be83-fb446e976ce2+56:10476:x1875765413071616:12345-192.168.201.39@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1788869443.370942:0:5757:0:(mdt_handler.c:8041:mdt_fid2path()) path get [0x200000401:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1788869443.371047:0:5757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c82cdaaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2125b9b3-626e-4cbe-be83-fb446e976ce2+56:10476:x1875765413071616:12345-192.168.201.39@tcp:53:lhsmtool_posix.0 Request processed in 140us (368us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869443.371055:0:5757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 116 00000100:00100000:0.0:1788869443.375914:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1788869443.376771:0:5755:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765413071872 00000100:00100000:2.0:1788869443.376780:0:5755:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765413071872 00000100:00100000:2.0:1788869443.376835:0:5755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 117 00000100:00100000:2.0:1788869443.376842:0:5755:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c82cdaad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2125b9b3-626e-4cbe-be83-fb446e976ce2+56:10476:x1875765413071872:12345-192.168.201.39@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788869443.376860:0:5755:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788869443.376862:0:5755:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1788869443.376884:0:5755:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504c600/0x3d2d1916761d6bf9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.39@tcp remote: 0x375c0102490359ba expref: 56 pid: 5757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869443.376897:0:5755:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff94c81a585400) 00010000:00010000:2.0:1788869443.376900:0:5755:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788869443.376910:0:5755:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94c805039400/0x3d2d1916761d6c69 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x375c0102490359dd expref: -99 pid: 5755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788869443.377302:0:5755:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x4:0x0], index 1: 0 00010000:00010000:2.0:1788869443.377484:0:5755:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94c805039e00/0x3d2d1916761d6c70 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869443.377505:0:5755:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94c805039e00/0x3d2d1916761d6c70 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869443.377512:0:5755:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94c805039e00/0x3d2d1916761d6c70 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869443.377550:0:5755:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94c805039400/0x3d2d1916761d6c69 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0x375c0102490359dd expref: 58 pid: 5755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869443.377561:0:5755:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94c805039e00/0x3d2d1916761d6c70 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0x375c0102490359dd expref: 57 pid: 5755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869443.377566:0:5755:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff94c802f3f700) 00010000:00010000:2.0:1788869443.377567:0:5755:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788869443.377569:0:5755:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94c805039e00, rc 0) 00000100:00100000:2.0:1788869443.377630:0:5755:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c82cdaad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2125b9b3-626e-4cbe-be83-fb446e976ce2+57:10476:x1875765413071872:12345-192.168.201.39@tcp:101:lhsmtool_posix.0 Request processed in 787us (1726us total) trans 4294967398 rc 0/0 00000100:00100000:2.0:1788869443.377646:0:5755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 117 00000100:00100000:0.0:1788869443.379773:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1788869443.379854:0:5756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765413072128 00000100:00100000:3.0:1788869443.379868:0:5756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765413072128 00000100:00100000:3.0:1788869443.379946:0:5756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 118 00000100:00100000:3.0:1788869443.379960:0:5756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c82cda8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2125b9b3-626e-4cbe-be83-fb446e976ce2+57:10476:x1875765413072128:12345-192.168.201.39@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1788869443.380040:0:5756:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788869443.380083:0:5756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94c805039e00/0x3d2d1916761d6c70 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.39@tcp remote: 0x375c0102490359dd expref: 57 pid: 5755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869443.380103:0:5756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff94c802f3f700) 00010000:00010000:3.0:1788869443.380120:0:5756:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788869443.380148:0:5756:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504c000/0x3d2d1916761d6c7e lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869443.380163:0:5756:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504c000/0x3d2d1916761d6c7e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869443.380172:0:5756:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504c000/0x3d2d1916761d6c7e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869443.381441:0:5756:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504d600/0x3d2d1916761d6c85 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x6e23370e bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869443.381467:0:5756:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504d600/0x3d2d1916761d6c85 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x6e23370e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869443.381480:0:5756:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504d600/0x3d2d1916761d6c85 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x6e23370e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869443.381567:0:5756:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504c000/0x3d2d1916761d6c7e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869443.381576:0:5756:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504c000/0x3d2d1916761d6c7e lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869443.381584:0:5756:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504c000/0x3d2d1916761d6c7e lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869443.381590:0:5756:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94c83504c000 already unused, calling callback (ffffffffc21124f0) 00010000:00010000:3.0:1788869443.381595:0:5756:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504c000/0x3d2d1916761d6c7e lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869443.381604:0:5756:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504c000/0x3d2d1916761d6c7e lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869443.381617:0:5756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff94c81a585400) 00010000:00010000:3.0:1788869443.381620:0:5756:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788869443.381625:0:5756:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504c000/0x3d2d1916761d6c7e lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869443.381632:0:5756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504c000/0x3d2d1916761d6c7e lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869443.381662:0:5756:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504d600/0x3d2d1916761d6c85 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x6e23370e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869443.381669:0:5756:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504d600/0x3d2d1916761d6c85 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x6e23370e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869443.381676:0:5756:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504d600/0x3d2d1916761d6c85 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x6e23370e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869443.381682:0:5756:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94c83504d600 already unused, calling callback (ffffffffc21124f0) 00010000:00010000:3.0:1788869443.381685:0:5756:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504d600/0x3d2d1916761d6c85 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x6e23370e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869443.381691:0:5756:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504d600/0x3d2d1916761d6c85 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x6e23370e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869443.381700:0:5756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x6e23370e (ffff94c819394800) 00010000:00010000:3.0:1788869443.381716:0:5756:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788869443.381720:0:5756:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504d600/0x3d2d1916761d6c85 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x6e23370e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869443.381726:0:5756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504d600/0x3d2d1916761d6c85 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x6e23370e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788869443.381842:0:5756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c82cda8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2125b9b3-626e-4cbe-be83-fb446e976ce2+56:10476:x1875765413072128:12345-192.168.201.39@tcp:36:lhsmtool_posix.0 Request processed in 1882us (2097us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788869443.381853:0:5756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 118 00000100:00100000:0.0:1788869443.383095:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1788869443.383155:0:5755:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765413072256 00000100:00100000:2.0:1788869443.383165:0:5755:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765413072256 00000100:00100000:2.0:1788869443.383222:0:5755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 119 00000100:00100000:2.0:1788869443.383229:0:5755:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c810730700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2125b9b3-626e-4cbe-be83-fb446e976ce2+56:10476:x1875765413072256:12345-192.168.201.39@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788869443.383245:0:5755:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788869443.383288:0:5755:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94c805038800/0x3d2d1916761d6c8c lrc: 2/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x375c0102490359e4 expref: -99 pid: 5755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869443.383314:0:5755:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94c805038c00/0x3d2d1916761d6c93 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869443.383341:0:5755:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94c805038c00/0x3d2d1916761d6c93 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869443.383350:0:5755:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94c805038c00/0x3d2d1916761d6c93 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869443.383435:0:5755:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94c805038800/0x3d2d1916761d6c8c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0x375c0102490359e4 expref: 58 pid: 5755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869443.383452:0:5755:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94c805038c00/0x3d2d1916761d6c93 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0x375c0102490359e4 expref: 57 pid: 5755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869443.383460:0:5755:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff94c802f3fb00) 00010000:00010000:2.0:1788869443.383462:0:5755:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1788869443.383465:0:5755:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94c805038c00, rc 0) 00000100:00100000:2.0:1788869443.383507:0:5755:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c810730700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2125b9b3-626e-4cbe-be83-fb446e976ce2+57:10476:x1875765413072256:12345-192.168.201.39@tcp:101:lhsmtool_posix.0 Request processed in 278us (431us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869443.383512:0:5755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 119 00000100:00100000:0.0:1788869443.384666:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1788869443.385092:0:5757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765413072512 00000100:00100000:2.0:1788869443.385099:0:5757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765413072512 00000100:00100000:2.0:1788869443.385139:0:5757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 120 00000100:00100000:2.0:1788869443.385145:0:5757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c810730000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2125b9b3-626e-4cbe-be83-fb446e976ce2+57:10476:x1875765413072512:12345-192.168.201.39@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1788869443.385196:0:5757:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94c805038400/0x3d2d1916761d6c9a lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869443.385206:0:5757:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94c805038400/0x3d2d1916761d6c9a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869443.385223:0:5757:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94c805038400/0x3d2d1916761d6c9a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5757 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788869443.385470:0:5757:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].5, 88 off8560 00000004:00080000:2.0:1788869443.385478:0:5757:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 191677227391ns, next at 192677225455ns, rc = 0 00000004:00010000:2.0:1788869443.385557:0:5757:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000d6cbae98 reply state 0000000029665194 transno 4294967399 ns: mdt-lustre-MDT0000_UUID lock: ffff94c805038400/0x3d2d1916761d6c9a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5757 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788869443.385563:0:5757:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788869443.385629:0:5757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c810730000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2125b9b3-626e-4cbe-be83-fb446e976ce2+59:10476:x1875765413072512:12345-192.168.201.39@tcp:36:lhsmtool_posix.0 Request processed in 485us (970us total) trans 4294967399 rc 0/0 00000100:00100000:2.0:1788869443.385635:0:5757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 120 00000100:00100000:0.0:1788869443.387857:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1788869443.387927:0:5755:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765413072640 00000100:00100000:2.0:1788869443.387940:0:5755:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765413072640 00010000:00010000:1.0:1788869443.387967:0:3270:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94c805038400/0x3d2d1916761d6c9a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869443.387982:0:3270:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94c805038400/0x3d2d1916761d6c9a lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869443.387992:0:3270:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94c805038400/0x3d2d1916761d6c9a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869443.387999:0:3270:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94c805038400 already unused, calling callback (ffffffffc21124f0) 00010000:00010000:1.0:1788869443.388005:0:3270:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94c805038400/0x3d2d1916761d6c9a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869443.388015:0:3270:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94c805038400/0x3d2d1916761d6c9a lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5757 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788869443.388039:0:5755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 121 00010000:00010000:1.0:1788869443.388052:0:3270:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff94c802f3fb00) 00010000:00010000:1.0:1788869443.388058:0:3270:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:2.0:1788869443.388064:0:5755:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c82c842300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2125b9b3-626e-4cbe-be83-fb446e976ce2+59:10476:x1875765413072640:12345-192.168.201.39@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788869443.388066:0:3270:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94c805038400/0x3d2d1916761d6c9a lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869443.388087:0:3270:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94c805038400/0x3d2d1916761d6c9a lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869443.388103:0:5755:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788869443.388124:0:5755:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94c805039800/0x3d2d1916761d6ca1 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x375c0102490359eb expref: -99 pid: 5755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869443.388181:0:5755:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94c805039800/0x3d2d1916761d6ca1 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.39@tcp remote: 0x375c0102490359eb expref: 59 pid: 5755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869443.388195:0:5755:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94c805039800/0x3d2d1916761d6ca1 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.39@tcp remote: 0x375c0102490359eb expref: 59 pid: 5755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869443.388213:0:5755:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff94c802f3fb00) 00010000:00010000:2.0:1788869443.388227:0:5755:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788869443.388230:0:5755:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94c805039800, rc 0) 00000100:00100000:2.0:1788869443.388314:0:5755:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c82c842300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2125b9b3-626e-4cbe-be83-fb446e976ce2+59:10476:x1875765413072640:12345-192.168.201.39@tcp:101:lhsmtool_posix.0 Request processed in 264us (468us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869443.388322:0:5755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 121 00000100:00100000:0.0:1788869443.389943:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1788869443.390327:0:6546:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765413072768 00000100:00100000:2.0:1788869443.390341:0:6546:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765413072768 00000100:00100000:2.0:1788869443.390414:0:6546:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 37 00000100:00100000:2.0:1788869443.390426:0:6546:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c82c841880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2125b9b3-626e-4cbe-be83-fb446e976ce2+8:2347:x1875765413072768:12345-192.168.201.39@tcp:2:lhsmtool_posix.0 00000100:00100000:2.0:1788869443.390705:0:6546:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c82c841880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2125b9b3-626e-4cbe-be83-fb446e976ce2+9:2347:x1875765413072768:12345-192.168.201.39@tcp:2:lhsmtool_posix.0 Request processed in 282us (767us total) trans 4294967307 rc 0/0 00000100:00100000:2.0:1788869443.390713:0:6546:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 37 00000100:00100000:1.0:1788869443.391844:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1788869443.391902:0:5759:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765413073024 00000100:00100000:2.0:1788869443.391921:0:5759:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765413073024 00000100:00100000:0.0:1788869443.392157:0:5758:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 30 00000100:00100000:0.0:1788869443.392168:0:5758:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c83513d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2125b9b3-626e-4cbe-be83-fb446e976ce2+59:10476:x1875765413073024:12345-192.168.201.39@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1788869443.392319:0:5759:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 2 min 2 max 80 00000100:00100000:2.0:1788869443.392328:0:5759:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_002' 00000100:00100000:0.0:1788869443.392519:0:5758:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c83513d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2125b9b3-626e-4cbe-be83-fb446e976ce2+60:10476:x1875765413073024:12345-192.168.201.39@tcp:35:lhsmtool_posix.0 Request processed in 353us (682us total) trans 4294967400 rc 0/0 00000100:00100000:0.0:1788869443.392527:0:5758:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 30 00000100:00100000:0.0:1788869443.394460:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1788869443.394538:0:5757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765413073280 00000100:00100000:2.0:1788869443.394558:0:5757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765413073280 00000100:00100000:2.0:1788869443.394619:0:5757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 122 00000100:00100000:2.0:1788869443.394636:0:5757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c83fae9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2125b9b3-626e-4cbe-be83-fb446e976ce2+60:10476:x1875765413073280:12345-192.168.201.39@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1788869443.394736:0:5757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c83fae9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2125b9b3-626e-4cbe-be83-fb446e976ce2+60:10476:x1875765413073280:12345-192.168.201.39@tcp:57:lhsmtool_posix.0 Request processed in 101us (286us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869443.394753:0:5757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 122 00000100:00100000:1.0:1788869443.396018:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1788869443.396236:0:5755:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765413073408 00000100:00100000:2.0:1788869443.396244:0:5755:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765413073408 00000100:00100000:2.0:1788869443.396316:0:5755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 123 00000100:00100000:2.0:1788869443.396420:0:5755:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c83513f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2125b9b3-626e-4cbe-be83-fb446e976ce2+60:10476:x1875765413073408:12345-192.168.201.39@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788869443.396581:0:5755:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788869443.396601:0:5755:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94c805038800/0x3d2d1916761d6ca8 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x375c0102490359f2 expref: -99 pid: 5755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869443.396683:0:5755:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94c805039400/0x3d2d1916761d6caf lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869443.396698:0:5755:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94c805039400/0x3d2d1916761d6caf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869443.396711:0:5755:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94c805039400/0x3d2d1916761d6caf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788869443.396756:0:5755:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1788869443.396775:0:5755:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff94c805039400/0x3d2d1916761d6caf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869443.396802:0:5755:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94c805038800/0x3d2d1916761d6ca8 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0x375c0102490359f2 expref: 62 pid: 5755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869443.396822:0:5755:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94c805039400/0x3d2d1916761d6caf lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0x375c0102490359f2 expref: 61 pid: 5755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869443.396831:0:5755:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff94c802f3fb00) 00010000:00010000:2.0:1788869443.396834:0:5755:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1788869443.396837:0:5755:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94c805039400, rc 0) 00000100:00100000:2.0:1788869443.396892:0:5755:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c83513f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2125b9b3-626e-4cbe-be83-fb446e976ce2+61:10476:x1875765413073408:12345-192.168.201.39@tcp:101:lhsmtool_posix.0 Request processed in 568us (878us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869443.396900:0:5755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 123 00000100:00100000:1.0:1788869443.404046:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1788869443.404164:0:6547:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765413073536 00000100:00100000:0.0:1788869443.404178:0:6547:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765413073536 00000100:00100000:0.0:1788869443.404285:0:6547:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 38 00000100:00100000:0.0:1788869443.404297:0:6547:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c83513dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2125b9b3-626e-4cbe-be83-fb446e976ce2+9:2348:x1875765413073536:12345-192.168.201.39@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788869443.404322:0:6547:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788869443.404350:0:6547:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002b800faa/0x3d2d1916761d6cb6 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x375c0102490359f9 expref: -99 pid: 6547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788869443.404409:0:6547:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a9ffb42, blocks: 0x1 00010000:00010000:0.0:1788869443.404434:0:6547:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=191s v=(0 0) 00010000:00010000:0.0:1788869443.404440:0:6547:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788869443.404452:0:6547:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002b800faa/0x3d2d1916761d6cb6 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.39@tcp remote: 0x375c0102490359f9 expref: 10 pid: 6547 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869443.404472:0:6547:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000002b800faa/0x3d2d1916761d6cb6 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.39@tcp remote: 0x375c0102490359f9 expref: 10 pid: 6547 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869443.404489:0:6547:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94c81a583e00, rc 0) 00000100:00100000:0.0:1788869443.404562:0:6547:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c83513dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2125b9b3-626e-4cbe-be83-fb446e976ce2+10:2348:x1875765413073536:12345-192.168.201.39@tcp:101:lhsmtool_posix.0 Request processed in 267us (531us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869443.404570:0:6547:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 38 00000100:00100000:0.0:1788869443.406298:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1788869443.406362:0:5756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765413073792 00000100:00100000:3.0:1788869443.406371:0:5756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765413073792 00000100:00100000:3.0:1788869443.406439:0:5756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 124 00000100:00100000:3.0:1788869443.406462:0:5756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c83faead80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2125b9b3-626e-4cbe-be83-fb446e976ce2+61:10476:x1875765413073792:12345-192.168.201.39@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1788869443.406574:0:5756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c83faead80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2125b9b3-626e-4cbe-be83-fb446e976ce2+61:10476:x1875765413073792:12345-192.168.201.39@tcp:57:lhsmtool_posix.0 Request processed in 116us (282us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869443.406583:0:5756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 124 00000100:00100000:3.0:1788869443.407802:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1788869443.407881:0:6544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765413073920 00000100:00100000:1.0:1788869443.407887:0:6544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765413073920 00000100:00100000:1.0:1788869443.407931:0:6544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 39 00000100:00100000:1.0:1788869443.407941:0:6544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c835a17b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2125b9b3-626e-4cbe-be83-fb446e976ce2+10:10476:x1875765413073920:12345-192.168.201.39@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788869443.407958:0:6544:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788869443.407979:0:6544:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005f210b03/0x3d2d1916761d6cbd lrc: 2/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x375c010249035a00 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869443.408012:0:6544:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000002b800faa/0x3d2d1916761d6cb6 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.39@tcp remote: 0x375c0102490359f9 expref: 11 pid: 6547 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869443.408022:0:6544:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788869443.408026:0:6544:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788869443.408036:0:6544:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005f210b03/0x3d2d1916761d6cbd lrc: 4/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.201.39@tcp remote: 0x375c010249035a00 expref: 11 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869443.408086:0:6544:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000002b800faa/0x3d2d1916761d6cb6 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.39@tcp remote: 0x375c0102490359f9 expref: 11 pid: 6547 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869443.408102:0:6544:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000002b800faa/0x3d2d1916761d6cb6 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.39@tcp remote: 0x375c0102490359f9 expref: 11 pid: 6547 timeout: 291 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788869443.408130:0:6544:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94c83513f480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6544:1875765421464064:192.168.201.39@tcp:104: 00000100:00100000:1.0:1788869443.408227:0:6544:0:(client.c:2702:ptlrpc_set_wait()) set ffff94c806043540 going to sleep for 11 seconds 00000100:00100000:3.0:1788869443.409572:0:6544:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94c83513f480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6544:1875765421464064:192.168.201.39@tcp:104: 00010000:00010000:3.0:1788869443.409605:0:6544:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000005f210b03/0x3d2d1916761d6cbd lrc: 3/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.39@tcp remote: 0x375c010249035a00 expref: 11 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869443.409624:0:6544:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94c83fde7c00, rc 0) 00000100:00100000:3.0:1788869443.409761:0:6544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c835a17b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2125b9b3-626e-4cbe-be83-fb446e976ce2+11:10476:x1875765413073920:12345-192.168.201.39@tcp:101:lhsmtool_posix.0 Request processed in 1820us (1959us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869443.409775:0:6544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 39 00000100:00100000:1.0:1788869443.409829:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1788869443.409888:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765413074048 00000100:00100000:2.0:1788869443.409894:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765413074048 00010000:00010000:2.0:1788869443.409925:0:5788:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000002b800faa/0x3d2d1916761d6cb6 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.39@tcp remote: 0x375c0102490359f9 expref: 11 pid: 6547 timeout: 291 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788869443.409958:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 57 00000100:00100000:2.0:1788869443.409967:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c83513f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2125b9b3-626e-4cbe-be83-fb446e976ce2+11:2348:x1875765413074048:12345-192.168.201.39@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788869443.409988:0:5788:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788869443.410014:0:5788:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000002b800faa/0x3d2d1916761d6cb6 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.39@tcp remote: 0x375c0102490359f9 expref: 11 pid: 6547 timeout: 291 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869443.410030:0:5788:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000002b800faa/0x3d2d1916761d6cb6 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.39@tcp remote: 0x375c0102490359f9 expref: 11 pid: 6547 timeout: 291 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869443.410056:0:5788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002b800faa/0x3d2d1916761d6cb6 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.39@tcp remote: 0x375c0102490359f9 expref: 11 pid: 6547 timeout: 291 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869443.410071:0:5788:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788869443.410075:0:5788:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788869443.410084:0:5788:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000005f210b03/0x3d2d1916761d6cbd lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.39@tcp remote: 0x375c010249035a00 expref: 10 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869443.410097:0:5788:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005f210b03/0x3d2d1916761d6cbd lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.39@tcp remote: 0x375c010249035a00 expref: 10 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869443.410131:0:5788:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000005f210b03/0x3d2d1916761d6cbd lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.39@tcp remote: 0x375c010249035a00 expref: 10 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788869443.410161:0:5788:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94c81f1f0380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:5788:1875765421464192:192.168.201.39@tcp:105: 00000100:00100000:2.0:1788869443.410231:0:5788:0:(client.c:2702:ptlrpc_set_wait()) set ffff94c81075acc0 going to sleep for 11 seconds 00000100:00100000:1.0:1788869443.412339:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1788869443.412434:0:6550:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765413074176 00000100:00100000:3.0:1788869443.412443:0:6550:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765413074176 00002000:00100000:3.0:1788869443.412494:0:6550:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x4:0x0] (0->12) req@ffff94c83513f100 x1875765413074176/t0(0) o4->2125b9b3-626e-4cbe-be83-fb446e976ce2@192.168.201.39@tcp:389/0 lens 504/0 e 0 to 0 dl 1788869454 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788869443.412507:0:6550:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff94c83513f100 with x1875765413074176 ext(0->12) 00002000:00010000:3.0:1788869443.412514:0:6550:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff94c83513f100 00000100:00100000:3.0:1788869443.412555:0:6550:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 2 00000100:00100000:3.0:1788869443.412563:0:6550:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c83513f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:2125b9b3-626e-4cbe-be83-fb446e976ce2+11:2347:x1875765413074176:12345-192.168.201.39@tcp:4:lhsmtool_posix.0 00000100:00100000:0.0:1788869443.412566:0:6551:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 3 min 3 max 116 00000100:00100000:0.0:1788869443.412578:0:6551:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_003' 00000100:00100000:3.0:1788869443.413125:0:6550:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c83513f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:2125b9b3-626e-4cbe-be83-fb446e976ce2+13:2347:x1875765413074176:12345-192.168.201.39@tcp:4:lhsmtool_posix.0 Request processed in 561us (796us total) trans 4294967308 rc 0/0 00000100:00100000:3.0:1788869443.413134:0:6550:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 2 00002000:00100000:3.0:1788869443.413148:0:6550:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x4:0x0] (0->12) req@ffff94c83513f100 x1875765413074176/t4294967308(0) o4->2125b9b3-626e-4cbe-be83-fb446e976ce2@192.168.201.39@tcp:389/0 lens 504/448 e 0 to 0 dl 1788869454 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788869443.413158:0:6550:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff94c83513f100 with x1875765413074176 ext(0->12) 00002000:00010000:3.0:1788869443.413162:0:6550:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff94c83513f100 00000100:00100000:2.0:1788869443.413842:0:5788:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94c81f1f0380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:5788:1875765421464192:192.168.201.39@tcp:105: 00010000:00010000:2.0:1788869443.413871:0:5788:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788869443.413905:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c83513f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2125b9b3-626e-4cbe-be83-fb446e976ce2+12:2348:x1875765413074048:12345-192.168.201.39@tcp:103:ldlm_bl.0 Request processed in 3940us (4077us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869443.413917:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 57 00000100:00100000:1.0:1788869443.414307:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1788869443.414337:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765413074304 00000100:00100000:0.0:1788869443.414344:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765413074304 00000100:00100000:0.0:1788869443.414384:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 125 00000100:00100000:0.0:1788869443.414408:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c83513e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2125b9b3-626e-4cbe-be83-fb446e976ce2+61:10476:x1875765413074304:12345-192.168.201.39@tcp:44:lhsmtool_posix.0 00000001:00080000:3.0:1788869443.431017:0:5777:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967400 is committed 00000004:00080000:3.0:1788869443.431075:0:5777:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3 committed 00000020:00080000:3.0:1788869443.431109:0:5777:0:(update_trans.c:58:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff94c83fd69d80 refcount 2 committed 0 result 0 batchid 3 00000020:00080000:3.0:1788869443.431115:0:5777:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff94c80605ee00 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff94c83fd69600 00000020:00080000:3.0:1788869443.431119:0:5777:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff94c80605ef00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff94c83c6ed400 00000020:00080000:1.0:1788869443.431162:0:5791:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000100:00100000:2.0:1788869443.431170:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c83513e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2125b9b3-626e-4cbe-be83-fb446e976ce2+44:10476:x1875765413074304:12345-192.168.201.39@tcp:44:lhsmtool_posix.0 Request processed in 16755us (16855us total) trans 0 rc 0/0 00000020:00080000:3.0:1788869443.431180:0:5777:0:(update_trans.c:1348:distribute_txn_batchid_cb()) lustre-MDT0000: 1 batchid updated 00000004:00080000:3.0:1788869443.431193:0:5777:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 5 committed 00000100:00100000:2.0:1788869443.431198:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 125 00000020:00080000:1.0:1788869443.431207:0:5791:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000020:00080000:1.0:1788869443.431223:0:5791:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000020:00080000:3.0:1788869443.431284:0:5777:0:(update_trans.c:58:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff94c807dff900 refcount 2 committed 0 result 0 batchid 2 00000020:00080000:3.0:1788869443.431287:0:5777:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff94c808f47100 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff94c807dff0c0 00000020:00080000:3.0:1788869443.431289:0:5777:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff94c808f47000 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff94c83c7f8400 00000100:00100000:3.0:1788869443.431352:0:3284:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94c83fae9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3284:1875765421464320:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1788869443.431422:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869443.431428:0:3285:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94c82ccfed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3285:1875765421464448:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1788869443.431443:0:3286:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94c82ccfd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3286:1875765421464576:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1788869443.431578:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00080000:1.0:1788869443.431583:0:5791:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 3 committed batchid 1 00000100:00100000:3.0:1788869443.431615:0:7884:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765421464320 00000100:00100000:3.0:1788869443.431624:0:7884:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765421464320 00000100:00100000:3.0:1788869443.431666:0:7884:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765421464448 00000100:00100000:3.0:1788869443.431669:0:7884:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765421464448 00000100:00100000:3.0:1788869443.431751:0:7884:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1788869443.431761:0:7884:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c835a14380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+8:3284:x1875765421464320:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:3.0:1788869443.431796:0:7884:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:3 count 1 00000100:00100000:2.0:1788869443.431799:0:6547:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1788869443.431806:0:6544:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 4 min 3 max 116 00000100:00100000:2.0:1788869443.431815:0:6547:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c83faeb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3285:x1875765421464448:12345-0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1788869443.431818:0:6544:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_004' 00002000:00080000:2.0:1788869443.431836:0:6547:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:3 count 1 00002000:00010000:3.0:1788869443.431842:0:7884:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x3:0x0] initial LVB size: 9, mtime: 0x6a9ffb41, atime: 0x6a9ffb41, ctime: 0x6a9ffb41, blocks: 0x1 00000020:00080000:1.0:1788869443.431849:0:5791:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00010000:00010000:3.0:1788869443.431853:0:7884:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000075018e36/0x3d2d1916761d6cc4 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 7884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869443.431856:0:6547:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f49ccba3/0x3d2d1916761d6ccb lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869443.431888:0:7884:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=191s v=(0 0) 00010000:00010000:2.0:1788869443.431894:0:6547:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000a046f8e3/0x3d2d1916761d6a7f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.39@tcp remote: 0x375c010249035958 expref: 11 pid: 6546 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869443.431896:0:7884:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788869443.431905:0:7884:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000075018e36/0x3d2d1916761d6cc4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 7884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869443.431929:0:6547:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x3:0x0].0x0 since=1s v=(0 0) 00010000:00010000:3.0:1788869443.431932:0:7884:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000075018e36/0x3d2d1916761d6cc4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 7884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869443.431933:0:6547:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788869443.431944:0:6547:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f49ccba3/0x3d2d1916761d6ccb lrc: 4/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869443.431948:0:7884:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000075018e36/0x3d2d1916761d6cc4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 7884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869443.431961:0:7884:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000075018e36/0x3d2d1916761d6cc4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 7884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869443.431990:0:7884:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788869443.432004:0:6547:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000a046f8e3/0x3d2d1916761d6a7f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.39@tcp remote: 0x375c010249035958 expref: 11 pid: 6546 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788869443.432016:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788869443.432024:0:6547:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000a046f8e3/0x3d2d1916761d6a7f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.39@tcp remote: 0x375c010249035958 expref: 11 pid: 6546 timeout: 291 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788869443.432041:0:6547:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94c81f1f0380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6547:1875765421464704:192.168.201.39@tcp:104: 00010000:00010000:0.0:1788869443.432054:0:5742:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788869443.432069:0:5742:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000075018e36/0x3d2d1916761d6cc4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 7884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788869443.432074:0:6544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765421464576 00000100:00100000:1.0:1788869443.432080:0:6544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765421464576 00010000:00010000:0.0:1788869443.432083:0:5742:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94c83504d600 already unused, calling callback (ffffffffc1703220) 00010000:00010000:0.0:1788869443.432090:0:5742:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000075018e36/0x3d2d1916761d6cc4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 7884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869443.432102:0:5742:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000075018e36/0x3d2d1916761d6cc4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 7884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788869443.432111:0:6547:0:(client.c:2702:ptlrpc_set_wait()) set ffff94c81075acc0 going to sleep for 11 seconds 00010000:00010000:0.0:1788869443.432124:0:5742:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000075018e36/0x3d2d1916761d6cc4 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 7884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869443.432134:0:5742:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000075018e36/0x3d2d1916761d6cc4 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 7884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869443.432154:0:5742:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788869443.432156:0:5742:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788869443.432158:0:5742:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788869443.432194:0:11822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1788869443.432204:0:11822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c82ccff100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+7:3286:x1875765421464576:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:1.0:1788869443.432393:0:11822:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:1.0:1788869443.432398:0:11822:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb mtime from disk: 0 -> 1788869442 00002000:00010000:1.0:1788869443.432401:0:11822:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1788869443.432409:0:11822:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb ctime from disk: 1788869442 -> 1788869442 00002000:00010000:1.0:1788869443.432412:0:11822:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:1.0:1788869443.432464:0:11822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c82ccff100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+8:3286:x1875765421464576:12345-0@lo:2:osp-syn-1-0.0 Request processed in 261us (449us total) trans 4294967309 rc 0/0 00000100:00100000:1.0:1788869443.432473:0:11822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000004:00080000:0.0:1788869443.432514:0:3286:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94c82ccfd500/2, rc 0, transno 4294967309 00000100:00100000:0.0:1788869443.432530:0:3286:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94c82ccfd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3286:1875765421464576:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1788869443.432673:0:7884:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c835a14380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+9:3284:x1875765421464320:12345-0@lo:6:osp-syn-0-0.0 Request processed in 913us (1249us total) trans 4294967304 rc 0/0 00000100:00100000:3.0:1788869443.432681:0:7884:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000004:00080000:0.0:1788869443.432695:0:3284:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94c83fae9500/2, rc 0, transno 4294967304 00000100:00100000:0.0:1788869443.432701:0:3284:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94c83fae9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3284:1875765421464320:0@lo:6:osp-syn-0-0.0 00000100:00080000:3.0:1788869443.432704:0:5751:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788869443.435452:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1788869443.435500:0:6544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765413074432 00000100:00100000:0.0:1788869443.435513:0:6544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765413074432 00000100:00100000:1.0:1788869443.435533:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1788869443.435603:0:6544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 43 00000100:00100000:0.0:1788869443.435616:0:6544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c82ccfc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2125b9b3-626e-4cbe-be83-fb446e976ce2+12:2347:x1875765413074432:12345-192.168.201.39@tcp:16:lhsmtool_posix.0 00000100:00100000:3.0:1788869443.435652:0:5739:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765413074560 00000100:00100000:3.0:1788869443.435659:0:5739:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765413074560 00000100:00100000:2.0:1788869443.435666:0:6547:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94c81f1f0380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6547:1875765421464704:192.168.201.39@tcp:104: 00010000:00010000:3.0:1788869443.435693:0:5739:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000a046f8e3/0x3d2d1916761d6a7f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.39@tcp remote: 0x375c010249035958 expref: 13 pid: 6546 timeout: 291 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869443.435698:0:6547:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000f49ccba3/0x3d2d1916761d6ccb lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788869443.435755:0:5739:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 58 00000100:00100000:3.0:1788869443.435764:0:5739:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c82ccfd180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2125b9b3-626e-4cbe-be83-fb446e976ce2+13:2346:x1875765413074560:12345-192.168.201.39@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788869443.435784:0:5739:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788869443.435791:0:5739:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000a046f8e3/0x3d2d1916761d6a7f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.39@tcp remote: 0x375c010249035958 expref: 13 pid: 6546 timeout: 291 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869443.435804:0:5739:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000a046f8e3/0x3d2d1916761d6a7f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.39@tcp remote: 0x375c010249035958 expref: 13 pid: 6546 timeout: 291 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869443.435835:0:5739:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a046f8e3/0x3d2d1916761d6a7f lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.39@tcp remote: 0x375c010249035958 expref: 13 pid: 6546 timeout: 291 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869443.435855:0:5739:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788869443.435860:0:5739:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788869443.435867:0:5739:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000f49ccba3/0x3d2d1916761d6ccb lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869443.435879:0:5739:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f49ccba3/0x3d2d1916761d6ccb lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869443.435909:0:5739:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788869443.435927:0:6547:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000f49ccba3/0x3d2d1916761d6ccb lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869443.435936:0:6547:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f49ccba3/0x3d2d1916761d6ccb lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869443.435945:0:6547:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f49ccba3/0x3d2d1916761d6ccb lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869443.435951:0:6547:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f49ccba3/0x3d2d1916761d6ccb lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788869443.435960:0:5739:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c82ccfd180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2125b9b3-626e-4cbe-be83-fb446e976ce2+12:2346:x1875765413074560:12345-192.168.201.39@tcp:103:ldlm_bl.0 Request processed in 197us (426us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869443.435970:0:5739:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 58 00010000:00010000:2.0:1788869443.435993:0:6547:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1788869443.436713:0:6547:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c83faeb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+8:3285:x1875765421464448:12345-0@lo:6:osp-syn-1-0.0 Request processed in 4901us (5133us total) trans 4294967310 rc 0/0 00000100:00100000:2.0:1788869443.436721:0:6547:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000004:00080000:0.0:1788869443.436736:0:3285:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94c82ccfed80/2, rc 0, transno 4294967310 00000100:00100000:0.0:1788869443.436756:0:3285:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94c82ccfed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3285:1875765421464448:0@lo:6:osp-syn-1-0.0 00010000:00010000:2.0:1788869443.436759:0:7447:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788869443.436767:0:7447:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f49ccba3/0x3d2d1916761d6ccb lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869443.436777:0:7447:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94c805039200 already unused, calling callback (ffffffffc1703220) 00010000:00010000:2.0:1788869443.436783:0:7447:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f49ccba3/0x3d2d1916761d6ccb lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869443.436794:0:7447:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f49ccba3/0x3d2d1916761d6ccb lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869443.436810:0:7447:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f49ccba3/0x3d2d1916761d6ccb lrc: 1/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869443.436819:0:7447:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f49ccba3/0x3d2d1916761d6ccb lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869443.436842:0:7447:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788869443.436844:0:7447:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788869443.436845:0:7447:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1788869443.449185:0:7458:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967309 is committed 00000001:00080000:0.0:1788869443.449210:0:7458:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967310 is committed 00000001:00080000:0.0:1788869443.449217:0:7458:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967307 is committed 00000001:00080000:0.0:1788869443.449270:0:7458:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967308 is committed 00000100:00100000:2.0:1788869443.449357:0:6544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c82ccfc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2125b9b3-626e-4cbe-be83-fb446e976ce2+6:2347:x1875765413074432:12345-192.168.201.39@tcp:16:lhsmtool_posix.0 Request processed in 13734us (13907us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869443.449383:0:6544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 43 00000100:00100000:1.0:1788869443.450909:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1788869443.450962:0:5757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765413074816 00000100:00100000:2.0:1788869443.450974:0:5757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765413074816 00000100:00100000:2.0:1788869443.451049:0:5757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 126 00000100:00100000:2.0:1788869443.451062:0:5757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c82ccfce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2125b9b3-626e-4cbe-be83-fb446e976ce2+15:10476:x1875765413074816:12345-192.168.201.39@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1788869443.451135:0:5757:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788869443.451169:0:5757:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94c805039400/0x3d2d1916761d6caf lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.39@tcp remote: 0x375c0102490359f2 expref: 15 pid: 5755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869443.451194:0:5757:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff94c802f3fb00) 00010000:00010000:2.0:1788869443.451199:0:5757:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788869443.451239:0:5757:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94c805039a00/0x3d2d1916761d6cd2 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869443.451295:0:5757:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94c805039a00/0x3d2d1916761d6cd2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869443.451308:0:5757:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94c805039a00/0x3d2d1916761d6cd2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5757 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788869443.451606:0:5757:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000850fcda8 reply state 000000005edff18b transno 4294967401 ns: mdt-lustre-MDT0000_UUID lock: ffff94c805039a00/0x3d2d1916761d6cd2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5757 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788869443.451617:0:5757:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788869443.451714:0:5757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c82ccfce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2125b9b3-626e-4cbe-be83-fb446e976ce2+16:10476:x1875765413074816:12345-192.168.201.39@tcp:36:lhsmtool_posix.0 Request processed in 654us (809us total) trans 4294967401 rc 0/0 00000100:00100000:2.0:1788869443.451722:0:5757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 126 00000100:00100000:1.0:1788869443.453472:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1788869443.453599:0:11822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765413074944 00000100:00100000:3.0:1788869443.453611:0:11822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765413074944 00000100:00100000:3.0:1788869443.453707:0:11822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 44 00000100:00100000:3.0:1788869443.453720:0:11822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c82ccfdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:2125b9b3-626e-4cbe-be83-fb446e976ce2+6:2345:x1875765413074944:12345-192.168.201.39@tcp:2:lhsmtool_posix.0 00010000:00010000:2.0:1788869443.453788:0:3269:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94c805039a00/0x3d2d1916761d6cd2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869443.453808:0:3269:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94c805039a00/0x3d2d1916761d6cd2 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869443.453817:0:3269:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94c805039a00/0x3d2d1916761d6cd2 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869443.453824:0:3269:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94c805039a00 already unused, calling callback (ffffffffc21124f0) 00010000:00010000:2.0:1788869443.453829:0:3269:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94c805039a00/0x3d2d1916761d6cd2 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869443.453836:0:3269:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94c805039a00/0x3d2d1916761d6cd2 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869443.453851:0:3269:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff94c802f3fb00) 00010000:00010000:2.0:1788869443.453853:0:3269:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788869443.453857:0:3269:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94c805039a00/0x3d2d1916761d6cd2 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869443.453862:0:3269:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94c805039a00/0x3d2d1916761d6cd2 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5757 initiator: MDT0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788869443.454061:0:11822:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb size from disk: 13 -> 13 00002000:00010000:3.0:1788869443.454065:0:11822:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb mtime from disk: 1788869442 -> 1788869441 00002000:00010000:3.0:1788869443.454067:0:11822:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb atime from disk: 0 -> 1788869441 00002000:00010000:3.0:1788869443.454070:0:11822:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb ctime from disk: 1788869442 -> 1788869441 00002000:00010000:3.0:1788869443.454071:0:11822:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:3.0:1788869443.454140:0:11822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c82ccfdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:2125b9b3-626e-4cbe-be83-fb446e976ce2+7:2345:x1875765413074944:12345-192.168.201.39@tcp:2:lhsmtool_posix.0 Request processed in 424us (678us total) trans 4294967311 rc 0/0 00000100:00100000:3.0:1788869443.454150:0:11822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 44 00000100:00100000:0.0:1788869443.457785:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1788869443.458705:0:5755:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765413075200 00000100:00100000:2.0:1788869443.458720:0:5755:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765413075200 00000100:00100000:2.0:1788869443.458804:0:5755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 127 00000100:00100000:2.0:1788869443.458815:0:5755:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c83fae8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2125b9b3-626e-4cbe-be83-fb446e976ce2+15:10476:x1875765413075200:12345-192.168.201.39@tcp:55:lhsmtool_posix.0 00010000:00010000:2.0:1788869443.458902:0:5755:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94c805039200/0x3d2d1916761d6cd9 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869443.458923:0:5755:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff94c805038c00/0x3d2d1916761d6c93 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0x375c0102490359e4 expref: 15 pid: 5755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869443.458957:0:5755:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff94c805039200/0x3d2d1916761d6cd9 lrc: 4/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869443.458999:0:5755:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff94c805038c00/0x3d2d1916761d6c93 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.39@tcp remote: 0x375c0102490359e4 expref: 15 pid: 5755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869443.459013:0:5755:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff94c805038c00/0x3d2d1916761d6c93 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.39@tcp remote: 0x375c0102490359e4 expref: 15 pid: 5755 timeout: 291 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788869443.459031:0:5755:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94c81f1f0380 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5755:1875765421464832:192.168.201.39@tcp:104: 00000100:00100000:2.0:1788869443.459128:0:5755:0:(client.c:2702:ptlrpc_set_wait()) set ffff94c81075a240 going to sleep for 11 seconds 00000100:00100000:0.0:1788869443.462169:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1788869443.462244:0:5740:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765413075328 00000100:00100000:1.0:1788869443.462350:0:5740:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765413075328 00010000:00010000:1.0:1788869443.462408:0:5740:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff94c805038c00/0x3d2d1916761d6c93 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.39@tcp remote: 0x375c0102490359e4 expref: 16 pid: 5755 timeout: 291 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788869443.462445:0:5755:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94c81f1f0380 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5755:1875765421464832:192.168.201.39@tcp:104: 00000100:00100000:1.0:1788869443.462456:0:5740:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 59 00000100:00100000:1.0:1788869443.462469:0:5740:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c83fae9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2125b9b3-626e-4cbe-be83-fb446e976ce2+16:2348:x1875765413075328:12345-192.168.201.39@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788869443.462482:0:5755:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff94c805039200/0x3d2d1916761d6cd9 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869443.462489:0:5740:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788869443.462500:0:5740:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff94c805038c00/0x3d2d1916761d6c93 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.39@tcp remote: 0x375c0102490359e4 expref: 16 pid: 5755 timeout: 291 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869443.462516:0:5740:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff94c805038c00/0x3d2d1916761d6c93 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.39@tcp remote: 0x375c0102490359e4 expref: 16 pid: 5755 timeout: 291 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869443.462549:0:5740:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94c805038c00/0x3d2d1916761d6c93 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.39@tcp remote: 0x375c0102490359e4 expref: 16 pid: 5755 timeout: 291 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869443.462569:0:5740:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff94c802f3fb00) 00010000:00010000:1.0:1788869443.462575:0:5740:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff94c805039200/0x3d2d1916761d6cd9 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869443.462604:0:5740:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff94c805039200/0x3d2d1916761d6cd9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869443.462613:0:5740:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94c805039200/0x3d2d1916761d6cd9 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869443.462642:0:5740:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788869443.462658:0:5755:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff94c805039200/0x3d2d1916761d6cd9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869443.462667:0:5755:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94c805039200/0x3d2d1916761d6cd9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869443.462716:0:5755:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94c805039200/0x3d2d1916761d6cd9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869443.462724:0:5755:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94c805039200/0x3d2d1916761d6cd9 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788869443.462732:0:5740:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c83fae9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2125b9b3-626e-4cbe-be83-fb446e976ce2+15:2348:x1875765413075328:12345-192.168.201.39@tcp:103:ldlm_bl.0 Request processed in 263us (575us total) trans 0 rc 0/0 00010000:00010000:2.0:1788869443.462735:0:5755:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94c805039200/0x3d2d1916761d6cd9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788869443.462754:0:5740:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 59 00010000:00010000:2.0:1788869443.462773:0:5755:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94c805039200 already unused, calling callback (ffffffffc21124f0) 00010000:00010000:2.0:1788869443.462779:0:5755:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94c805039200/0x3d2d1916761d6cd9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869443.462788:0:5755:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94c805039200/0x3d2d1916761d6cd9 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869443.462798:0:5755:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff94c802f3fb00) 00010000:00010000:2.0:1788869443.462801:0:5755:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:2.0:1788869443.462805:0:5755:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94c805039200/0x3d2d1916761d6cd9 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869443.462812:0:5755:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94c805039200/0x3d2d1916761d6cd9 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788869443.462854:0:5755:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c83fae8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2125b9b3-626e-4cbe-be83-fb446e976ce2+14:10476:x1875765413075200:12345-192.168.201.39@tcp:55:lhsmtool_posix.0 Request processed in 4042us (5084us total) trans 0 rc -22/-22 00000100:00100000:2.0:1788869443.462863:0:5755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 127 00000100:00100000:1.0:1788869443.466565:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1788869443.466657:0:6546:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765413075456 00000100:00100000:2.0:1788869443.466672:0:6546:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765413075456 00000100:00100000:2.0:1788869443.466765:0:6546:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 45 00000100:00100000:2.0:1788869443.466778:0:6546:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c82ccfe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2125b9b3-626e-4cbe-be83-fb446e976ce2+7:2347:x1875765413075456:12345-192.168.201.39@tcp:1:lhsmtool_posix.0 00010000:00010000:2.0:1788869443.466838:0:6546:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000a4c3e783/0x3d2d1916761d6ce0 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6546 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869443.466866:0:6546:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000005f210b03/0x3d2d1916761d6cbd lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.39@tcp remote: 0x375c010249035a00 expref: 7 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869443.466899:0:6546:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788869443.466905:0:6546:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788869443.466911:0:6546:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a4c3e783/0x3d2d1916761d6ce0 lrc: 4/1,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6546 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869443.466958:0:6546:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000005f210b03/0x3d2d1916761d6cbd lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.201.39@tcp remote: 0x375c010249035a00 expref: 7 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869443.466972:0:6546:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000005f210b03/0x3d2d1916761d6cbd lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.201.39@tcp remote: 0x375c010249035a00 expref: 7 pid: 6544 timeout: 291 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788869443.466990:0:6546:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94c81f1f0380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6546:1875765421464960:192.168.201.39@tcp:104: 00000100:00100000:2.0:1788869443.467102:0:6546:0:(client.c:2702:ptlrpc_set_wait()) set ffff94c81075a240 going to sleep for 11 seconds 00000100:00100000:2.0:1788869443.470772:0:6546:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94c81f1f0380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6546:1875765421464960:192.168.201.39@tcp:104: 00010000:00010000:2.0:1788869443.470813:0:6546:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000a4c3e783/0x3d2d1916761d6ce0 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6546 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788869443.472361:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1788869443.472444:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765413075584 00000100:00100000:2.0:1788869443.472456:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765413075584 00010000:00010000:2.0:1788869443.472516:0:5788:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000005f210b03/0x3d2d1916761d6cbd lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.39@tcp remote: 0x375c010249035a00 expref: 8 pid: 6544 timeout: 291 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788869443.472569:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 60 00000100:00100000:2.0:1788869443.472581:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c82ccfea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2125b9b3-626e-4cbe-be83-fb446e976ce2+8:2347:x1875765413075584:12345-192.168.201.39@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788869443.472620:0:5788:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788869443.472664:0:5788:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000005f210b03/0x3d2d1916761d6cbd lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.39@tcp remote: 0x375c010249035a00 expref: 8 pid: 6544 timeout: 291 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869443.472682:0:5788:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000005f210b03/0x3d2d1916761d6cbd lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.201.39@tcp remote: 0x375c010249035a00 expref: 8 pid: 6544 timeout: 291 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869443.472725:0:5788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005f210b03/0x3d2d1916761d6cbd lrc: 0/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.201.39@tcp remote: 0x375c010249035a00 expref: 8 pid: 6544 timeout: 291 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869443.472756:0:5788:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788869443.472762:0:5788:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788869443.472770:0:5788:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000a4c3e783/0x3d2d1916761d6ce0 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6546 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869443.472783:0:5788:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a4c3e783/0x3d2d1916761d6ce0 lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6546 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869443.472823:0:5788:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788869443.472897:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c82ccfea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2125b9b3-626e-4cbe-be83-fb446e976ce2+7:2347:x1875765413075584:12345-192.168.201.39@tcp:103:ldlm_bl.0 Request processed in 317us (544us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869443.472907:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 60 00010000:00010000:1.0:1788869443.473851:0:6546:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000a4c3e783/0x3d2d1916761d6ce0 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6546 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869443.473870:0:6546:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a4c3e783/0x3d2d1916761d6ce0 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6546 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869443.473908:0:6546:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000a4c3e783/0x3d2d1916761d6ce0 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6546 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869443.473919:0:6546:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a4c3e783/0x3d2d1916761d6ce0 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6546 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869443.473929:0:6546:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a4c3e783/0x3d2d1916761d6ce0 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6546 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869443.473958:0:6546:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94c805039a00 already unused, calling callback (ffffffffc1703220) 00010000:00010000:1.0:1788869443.473963:0:6546:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a4c3e783/0x3d2d1916761d6ce0 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6546 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869443.473973:0:6546:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a4c3e783/0x3d2d1916761d6ce0 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6546 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869443.473993:0:6546:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a4c3e783/0x3d2d1916761d6ce0 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6546 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869443.474001:0:6546:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a4c3e783/0x3d2d1916761d6ce0 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6546 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788869443.474102:0:6546:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c82ccfe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2125b9b3-626e-4cbe-be83-fb446e976ce2+6:2347:x1875765413075456:12345-192.168.201.39@tcp:1:lhsmtool_posix.0 Request processed in 7323us (7547us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869443.474113:0:6546:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 45 00000100:00100000:1.0:1788869443.476473:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1788869443.476542:0:5756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765413075840 00000100:00100000:3.0:1788869443.476554:0:5756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765413075840 00000100:00100000:3.0:1788869443.476627:0:5756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 128 00000100:00100000:3.0:1788869443.476641:0:5756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c82ccfca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2125b9b3-626e-4cbe-be83-fb446e976ce2+14:10476:x1875765413075840:12345-192.168.201.39@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1788869443.476762:0:5756:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504c000/0x3d2d1916761d6ce7 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869443.476789:0:5756:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504c000/0x3d2d1916761d6ce7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869443.476802:0:5756:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504c000/0x3d2d1916761d6ce7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869443.477117:0:5756:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504d400/0x3d2d1916761d6cee lrc: 3/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869443.477130:0:5756:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff94c805039800/0x3d2d1916761d6ca1 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.39@tcp remote: 0x375c0102490359eb expref: 15 pid: 5755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869443.477140:0:5756:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504d400/0x3d2d1916761d6cee lrc: 4/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869443.477198:0:5756:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff94c805039800/0x3d2d1916761d6ca1 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.201.39@tcp remote: 0x375c0102490359eb expref: 15 pid: 5755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869443.477214:0:5756:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff94c805039800/0x3d2d1916761d6ca1 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.201.39@tcp remote: 0x375c0102490359eb expref: 15 pid: 5755 timeout: 291 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788869443.477232:0:5756:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94c835a14000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5756:1875765421465088:192.168.201.39@tcp:104: 00000100:00100000:3.0:1788869443.477369:0:5756:0:(client.c:2702:ptlrpc_set_wait()) set ffff94c8357d5480 going to sleep for 11 seconds 00000100:00100000:3.0:1788869443.486671:0:5756:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94c835a14000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5756:1875765421465088:192.168.201.39@tcp:104: 00010000:00010000:3.0:1788869443.486704:0:5756:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504d400/0x3d2d1916761d6cee lrc: 3/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788869443.488886:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1788869443.489008:0:5739:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765413075968 00000100:00100000:3.0:1788869443.489020:0:5739:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765413075968 00010000:00010000:3.0:1788869443.489087:0:5739:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff94c805039800/0x3d2d1916761d6ca1 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.39@tcp remote: 0x375c0102490359eb expref: 16 pid: 5755 timeout: 291 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788869443.489198:0:5739:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 61 00000100:00100000:3.0:1788869443.489209:0:5739:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c82ccff800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2125b9b3-626e-4cbe-be83-fb446e976ce2+16:2348:x1875765413075968:12345-192.168.201.39@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788869443.489229:0:5739:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788869443.489237:0:5739:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff94c805039800/0x3d2d1916761d6ca1 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.39@tcp remote: 0x375c0102490359eb expref: 16 pid: 5755 timeout: 291 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869443.489298:0:5739:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff94c805039800/0x3d2d1916761d6ca1 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.201.39@tcp remote: 0x375c0102490359eb expref: 16 pid: 5755 timeout: 291 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869443.489351:0:5739:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94c805039800/0x3d2d1916761d6ca1 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.201.39@tcp remote: 0x375c0102490359eb expref: 16 pid: 5755 timeout: 291 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869443.489372:0:5739:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff94c802f3fb00) 00010000:00010000:3.0:1788869443.489378:0:5739:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504d400/0x3d2d1916761d6cee lrc: 3/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869443.489390:0:5739:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504d400/0x3d2d1916761d6cee lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869443.489399:0:5739:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504d400/0x3d2d1916761d6cee lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869443.489442:0:5739:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788869443.489511:0:5756:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504d400/0x3d2d1916761d6cee lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788869443.489520:0:5739:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c82ccff800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2125b9b3-626e-4cbe-be83-fb446e976ce2+15:2348:x1875765413075968:12345-192.168.201.39@tcp:103:ldlm_bl.0 Request processed in 310us (644us total) trans 0 rc 0/0 00010000:00010000:1.0:1788869443.489525:0:5756:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504d400/0x3d2d1916761d6cee lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788869443.489534:0:5739:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 61 00000001:00080000:1.0:1788869443.489826:0:5756:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967402 00000001:00080000:1.0:1788869443.490018:0:5756:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967403 00000001:00080000:1.0:1788869443.490081:0:5756:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967404 00000100:00100000:1.0:1788869443.490182:0:5756:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94c82ccfe300 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5756:1875765421465216:0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1788869443.490247:0:5756:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869443.490325:0:5756:0:(client.c:2702:ptlrpc_set_wait()) set ffff94c806043e40 going to sleep for 11 seconds 00000100:00100000:0.0:1788869443.490369:0:5760:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765421465216 00000100:00100000:0.0:1788869443.490378:0:5760:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765421465216 00000100:00100000:0.0:1788869443.490429:0:5760:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788869443.490439:0:5760:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c82ccfd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5756:x1875765421465216:12345-0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1788869443.490539:0:5760:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c82ccfd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5756:x1875765421465216:12345-0@lo:1000:mdt00_001.0 Request processed in 102us (292us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869443.490547:0:5760:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788869443.491493:0:5756:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967310 gen 2 00000004:00080000:1.0:1788869443.491503:0:5756:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967305 committed transno 4294967310 00000004:00080000:1.0:1788869443.491525:0:5756:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94c82ccfd500, transno 4294967309 00000004:00080000:1.0:1788869443.491548:0:5756:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94c82ccfed80, transno 4294967310 00000100:00100000:1.0:1788869443.491558:0:5756:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94c82ccfe300 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5756:1875765421465216:0@lo:1000:mdt00_001.0 00000001:00080000:1.0:1788869443.492176:0:5756:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967405 00000100:00100000:1.0:1788869443.492286:0:5756:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94c82ccfe300 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5756:1875765421465344:0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1788869443.492353:0:5756:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869443.492386:0:5756:0:(client.c:2702:ptlrpc_set_wait()) set ffff94c806043000 going to sleep for 11 seconds 00000100:00100000:0.0:1788869443.492412:0:5760:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765421465344 00000100:00100000:0.0:1788869443.492420:0:5760:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765421465344 00000100:00100000:0.0:1788869443.492474:0:5760:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788869443.492484:0:5760:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c82ccffb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5756:x1875765421465344:12345-0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1788869443.492736:0:5760:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c82ccffb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5756:x1875765421465344:12345-0@lo:1000:mdt00_001.0 Request processed in 253us (383us total) trans 4294967312 rc 0/0 00000100:00100000:0.0:1788869443.492756:0:5760:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788869443.494512:0:5756:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94c82ccfe300 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5756:1875765421465344:0@lo:1000:mdt00_001.0 00010000:00010000:1.0:1788869443.494574:0:5756:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504d400/0x3d2d1916761d6cee lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869443.494588:0:5756:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504d400/0x3d2d1916761d6cee lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869443.494597:0:5756:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504d400/0x3d2d1916761d6cee lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869443.494604:0:5756:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94c83504d400 already unused, calling callback (ffffffffc21124f0) 00010000:00010000:1.0:1788869443.494609:0:5756:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504d400/0x3d2d1916761d6cee lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869443.494679:0:5756:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504d400/0x3d2d1916761d6cee lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869443.494726:0:5756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff94c802f3fb00) 00010000:00010000:1.0:1788869443.494730:0:5756:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788869443.494736:0:5756:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504d400/0x3d2d1916761d6cee lrc: 2/0,0 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869443.494752:0:5756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504d400/0x3d2d1916761d6cee lrc: 0/0,0 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869443.494791:0:5756:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504ce00/0x3d2d1916761d6c31 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869443.494798:0:5756:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504ce00/0x3d2d1916761d6c31 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869443.494803:0:5756:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504ce00/0x3d2d1916761d6c31 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869443.494808:0:5756:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94c83504ce00 already unused, calling callback (ffffffffc21124f0) 00010000:00010000:1.0:1788869443.494811:0:5756:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504ce00/0x3d2d1916761d6c31 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869443.494817:0:5756:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504ce00/0x3d2d1916761d6c31 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869443.494825:0:5756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff94c803990500) 00010000:00010000:1.0:1788869443.494827:0:5756:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788869443.494836:0:5756:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff94c805038a00/0x3d2d1916761d6c38 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.39@tcp remote: 0x375c0102490359cf expref: 18 pid: 5757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869443.494849:0:5756:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff94c805038a00/0x3d2d1916761d6c38 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.201.39@tcp remote: 0x375c0102490359cf expref: 18 pid: 5757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869443.494866:0:5756:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94c805038a00/0x3d2d1916761d6c38 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.201.39@tcp remote: 0x375c0102490359cf expref: 18 pid: 5757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869443.494915:0:5756:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff94c805038a00/0x3d2d1916761d6c38 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.39@tcp remote: 0x375c0102490359cf expref: 18 pid: 5757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788869443.494931:0:5756:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94c82ccfc380 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5756:1875765421465472:192.168.201.39@tcp:105: 00000100:00100000:1.0:1788869443.495034:0:5756:0:(client.c:2702:ptlrpc_set_wait()) set ffff94c806043000 going to sleep for 11 seconds 00000100:00100000:1.0:1788869443.499038:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1788869443.499070:0:5756:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94c82ccfc380 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5756:1875765421465472:192.168.201.39@tcp:105: 00010000:00010000:3.0:1788869443.499121:0:5756:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504ce00/0x3d2d1916761d6c31 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869443.499134:0:5756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504ce00/0x3d2d1916761d6c31 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869443.499179:0:5756:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504c800/0x3d2d1916761d6cf5 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869443.499195:0:5756:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504c800/0x3d2d1916761d6cf5 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869443.499229:0:5756:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504c800/0x3d2d1916761d6cf5 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869443.499242:0:5756:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504c800/0x3d2d1916761d6cf5 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869443.499270:0:5756:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504c800/0x3d2d1916761d6cf5 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869443.499278:0:5756:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504c800/0x3d2d1916761d6cf5 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869443.499285:0:5756:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94c83504c800 already unused, calling callback (ffffffffc21124f0) 00010000:00010000:3.0:1788869443.499289:0:5756:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504c800/0x3d2d1916761d6cf5 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869443.499297:0:5756:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504c800/0x3d2d1916761d6cf5 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869443.499311:0:5756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff94c803990500) 00010000:00010000:3.0:1788869443.499315:0:5756:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788869443.499319:0:5756:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504c800/0x3d2d1916761d6cf5 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869443.499324:0:5756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504c800/0x3d2d1916761d6cf5 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869443.499334:0:5756:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504c000/0x3d2d1916761d6ce7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869443.499340:0:5756:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504c000/0x3d2d1916761d6ce7 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869443.499352:0:5756:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504c000/0x3d2d1916761d6ce7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869443.499357:0:5756:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94c83504c000 already unused, calling callback (ffffffffc21124f0) 00010000:00010000:3.0:1788869443.499360:0:5756:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504c000/0x3d2d1916761d6ce7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869443.499365:0:5756:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504c000/0x3d2d1916761d6ce7 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869443.499374:0:5756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff94c803990500) 00010000:00010000:3.0:1788869443.499377:0:5756:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1788869443.499379:0:5756:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504c000/0x3d2d1916761d6ce7 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869443.499385:0:5756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504c000/0x3d2d1916761d6ce7 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788869443.499757:0:5756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c82ccfca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2125b9b3-626e-4cbe-be83-fb446e976ce2+18:10476:x1875765413075840:12345-192.168.201.39@tcp:57:lhsmtool_posix.0 Request processed in 23118us (23295us total) trans 4294967406 rc 0/0 00000100:00100000:3.0:1788869443.499771:0:5756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 128 00000020:00080000:3.0:1788869443.499788:0:5756:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000100:00100000:0.0:1788869443.499896:0:5758:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765413076096 00000100:00100000:0.0:1788869443.499906:0:5758:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765413076096 00000040:00080000:2.0:1788869443.499908:0:11485:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788869443.499914:0:11485:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000100:00100000:0.0:1788869443.499967:0:5758:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 31 00000100:00100000:0.0:1788869443.499979:0:5758:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c82ccfc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2125b9b3-626e-4cbe-be83-fb446e976ce2+18:10475:x1875765413076096:12345-192.168.201.39@tcp:49:lfs.0 00000100:00100000:0.0:1788869443.500108:0:5758:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c82ccfc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2125b9b3-626e-4cbe-be83-fb446e976ce2+18:10475:x1875765413076096:12345-192.168.201.39@tcp:49:lfs.0 Request processed in 131us (1087us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869443.500116:0:5758:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 31 00000040:00080000:2.0:1788869443.501066:0:11485:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 3 00000040:00080000:2.0:1788869443.501078:0:11485:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1788869443.504045:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1788869443.504293:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765413076352 00000100:00100000:0.0:1788869443.504307:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1788869443.504323:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765413076352 00000100:00100000:2.0:1788869443.504398:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 129 00000100:00100000:1.0:1788869443.504408:0:11820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765413076608 00000100:00100000:2.0:1788869443.504412:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c83fae8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2125b9b3-626e-4cbe-be83-fb446e976ce2+18:10475:x1875765413076352:12345-192.168.201.39@tcp:58:lfs.0 00000100:00100000:1.0:1788869443.504415:0:11820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765413076608 00000100:00100000:1.0:1788869443.504454:0:11820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 32 00000100:00100000:1.0:1788869443.504464:0:11820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c818768850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:2125b9b3-626e-4cbe-be83-fb446e976ce2+19:10476:x1875765413076608:12345-192.168.201.39@tcp:35:lhsmtool_posix.0 00000004:00080000:0.0:1788869443.506385:0:11820:0:(mdd_object.c:4016:mdd_close()) Object [0x200000401:0x9:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:2.0:1788869443.506393:0:5786:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].3, 136 off8600 00000001:00080000:0.0:1788869443.506487:0:11820:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967407 00000100:00100000:2.0:1788869443.506519:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c83fae8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2125b9b3-626e-4cbe-be83-fb446e976ce2+21:10475:x1875765413076352:12345-192.168.201.39@tcp:58:lfs.0 Request processed in 2104us (2480us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869443.506532:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 129 00010000:00010000:0.0:1788869443.506557:0:11820:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94c81a582a00/0x3d2d1916761d6cfc lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869443.506579:0:11820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94c81a582a00/0x3d2d1916761d6cfc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 11820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869443.506593:0:11820:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94c81a582a00/0x3d2d1916761d6cfc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 11820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869443.506602:0:11820:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94c81a582a00/0x3d2d1916761d6cfc lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 11820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869443.506609:0:11820:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94c81a582a00/0x3d2d1916761d6cfc lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 11820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869443.506616:0:11820:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94c81a582a00/0x3d2d1916761d6cfc lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 11820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869443.506645:0:11820:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788869443.506705:0:5743:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00100000:0.0:1788869443.506708:0:11820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c818768850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:2125b9b3-626e-4cbe-be83-fb446e976ce2+20:10476:x1875765413076608:12345-192.168.201.39@tcp:35:lhsmtool_posix.0 Request processed in 2245us (2401us total) trans 4294967408 rc 0/0 00010000:00010000:3.0:1788869443.506714:0:5743:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94c81a582a00/0x3d2d1916761d6cfc lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 11820 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788869443.506716:0:11820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 32 00000020:00080000:0.0:1788869443.506720:0:11820:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1788869443.506732:0:5743:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94c81a582a00 already unused, calling callback (ffffffffc1703220) 00010000:00010000:3.0:1788869443.506737:0:5743:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94c81a582a00/0x3d2d1916761d6cfc lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 11820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869443.506767:0:5743:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94c81a582a00/0x3d2d1916761d6cfc lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 11820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869443.506790:0:5743:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff94c803990a00) 00010000:00010000:3.0:1788869443.506793:0:5743:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1788869443.506799:0:5743:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94c81a582a00/0x3d2d1916761d6cfc lrc: 1/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 11820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869443.506805:0:5743:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94c81a582a00/0x3d2d1916761d6cfc lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 11820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869443.506827:0:5743:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788869443.506829:0:5743:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788869443.506830:0:5743:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788869443.532042:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1788869443.532171:0:5757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765413076736 00000100:00100000:1.0:1788869443.532185:0:5757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765413076736 00000100:00100000:1.0:1788869443.532286:0:5757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 130 00000100:00100000:1.0:1788869443.532298:0:5757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c83fae9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2125b9b3-626e-4cbe-be83-fb446e976ce2+20:10479:x1875765413076736:12345-192.168.201.39@tcp:101:lfs.0 00010000:00010000:1.0:1788869443.532330:0:5757:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788869443.532357:0:5757:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94c83fde7200/0x3d2d1916761d6d03 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x375c010249035a07 expref: -99 pid: 5757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869443.532445:0:5757:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff94c83fde7e00/0x3d2d1916761d6d0a lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869443.532463:0:5757:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94c83fde7e00/0x3d2d1916761d6d0a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869443.532491:0:5757:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94c83fde7e00/0x3d2d1916761d6d0a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869443.532508:0:5757:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94c83fde6000/0x3d2d1916761d6d11 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869443.532515:0:5757:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94c83fde6000/0x3d2d1916761d6d11 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869443.532521:0:5757:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94c83fde6000/0x3d2d1916761d6d11 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869443.532883:0:5757:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94c83fde6600/0x3d2d1916761d6d18 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869443.532895:0:5757:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff94c81a583400/0x3d2d1916761d6c23 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0x375c0102490359c8 expref: 21 pid: 5756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869443.532905:0:5757:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff94c83fde6600/0x3d2d1916761d6d18 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869443.532944:0:5757:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff94c81a583400/0x3d2d1916761d6c23 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.39@tcp remote: 0x375c0102490359c8 expref: 21 pid: 5756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869443.532960:0:5757:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff94c81a583400/0x3d2d1916761d6c23 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.39@tcp remote: 0x375c0102490359c8 expref: 21 pid: 5756 timeout: 291 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788869443.532976:0:5757:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94c82ccff480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5757:1875765421465600:192.168.201.39@tcp:104: 00000100:00100000:1.0:1788869443.533076:0:5757:0:(client.c:2702:ptlrpc_set_wait()) set ffff94c8060436c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788869443.537442:0:5757:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94c82ccff480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5757:1875765421465600:192.168.201.39@tcp:104: 00010000:00010000:2.0:1788869443.537484:0:5757:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff94c83fde6600/0x3d2d1916761d6d18 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5757 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788869443.541044:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1788869443.541507:0:5759:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765413076992 00000100:00100000:3.0:1788869443.541522:0:5759:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765413076992 00000100:00100000:0.0:1788869443.541628:0:5758:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 33 00000100:00100000:0.0:1788869443.541646:0:5758:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c83faea680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2125b9b3-626e-4cbe-be83-fb446e976ce2+22:5552:x1875765413076992:12345-192.168.201.39@tcp:35:ldlm_bl.0 00000100:00100000:0.0:1788869443.542085:0:5758:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c83faea680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2125b9b3-626e-4cbe-be83-fb446e976ce2+23:5552:x1875765413076992:12345-192.168.201.39@tcp:35:ldlm_bl.0 Request processed in 445us (1055us total) trans 4294967409 rc 0/0 00000100:00100000:0.0:1788869443.542095:0:5758:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 33 00000100:00100000:1.0:1788869443.545359:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1788869443.545444:0:5740:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765413077120 00000100:00100000:2.0:1788869443.545458:0:5740:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765413077120 00010000:00010000:2.0:1788869443.545514:0:5740:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff94c81a583400/0x3d2d1916761d6c23 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.39@tcp remote: 0x375c0102490359c8 expref: 23 pid: 5756 timeout: 291 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788869443.545562:0:5740:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 62 00000100:00100000:2.0:1788869443.545575:0:5740:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c810ef1050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2125b9b3-626e-4cbe-be83-fb446e976ce2+23:2348:x1875765413077120:12345-192.168.201.39@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788869443.545594:0:5740:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788869443.545603:0:5740:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff94c81a583400/0x3d2d1916761d6c23 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.39@tcp remote: 0x375c0102490359c8 expref: 23 pid: 5756 timeout: 291 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869443.545621:0:5740:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff94c81a583400/0x3d2d1916761d6c23 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.39@tcp remote: 0x375c0102490359c8 expref: 23 pid: 5756 timeout: 291 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869443.545651:0:5740:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94c81a583400/0x3d2d1916761d6c23 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.39@tcp remote: 0x375c0102490359c8 expref: 23 pid: 5756 timeout: 291 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869443.545689:0:5740:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff94c803990500) 00010000:00010000:2.0:1788869443.545696:0:5740:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff94c83fde6600/0x3d2d1916761d6d18 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869443.545707:0:5740:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff94c83fde6600/0x3d2d1916761d6d18 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869443.545716:0:5740:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94c83fde6600/0x3d2d1916761d6d18 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869443.545849:0:5757:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff94c83fde6600/0x3d2d1916761d6d18 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869443.545850:0:5740:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788869443.545919:0:5757:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94c83fde6600/0x3d2d1916761d6d18 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5757 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788869443.545928:0:5740:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c810ef1050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2125b9b3-626e-4cbe-be83-fb446e976ce2+22:2348:x1875765413077120:12345-192.168.201.39@tcp:103:ldlm_bl.0 Request processed in 354us (580us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869443.545938:0:5740:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 62 00000004:00200000:1.0:1788869443.545984:0:5757:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:1.0:1788869443.545991:0:5757:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1788869443.546015:0:5757:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff94c83fde6600/0x3d2d1916761d6d18 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869443.546030:0:5757:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94c83fde6600/0x3d2d1916761d6d18 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869443.546041:0:5757:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff94c83fde7e00/0x3d2d1916761d6d0a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869443.546048:0:5757:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94c83fde7e00/0x3d2d1916761d6d0a lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869443.546055:0:5757:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94c83fde7e00/0x3d2d1916761d6d0a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869443.546062:0:5757:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94c83fde7e00 already unused, calling callback (ffffffffc21124f0) 00010000:00010000:1.0:1788869443.546066:0:5757:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94c83fde7e00/0x3d2d1916761d6d0a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869443.546074:0:5757:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94c83fde7e00/0x3d2d1916761d6d0a lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869443.546084:0:5757:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff94c81a585400) 00010000:00010000:1.0:1788869443.546087:0:5757:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788869443.546100:0:5757:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94c83fde7e00/0x3d2d1916761d6d0a lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869443.547014:0:5757:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94c83fde7e00/0x3d2d1916761d6d0a lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869443.547040:0:5757:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94c83fde6000/0x3d2d1916761d6d11 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869443.547047:0:5757:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94c83fde6000/0x3d2d1916761d6d11 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869443.547053:0:5757:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94c83fde6000/0x3d2d1916761d6d11 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869443.547058:0:5757:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94c83fde6000 already unused, calling callback (ffffffffc21124f0) 00010000:00010000:1.0:1788869443.547061:0:5757:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94c83fde6000/0x3d2d1916761d6d11 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869443.547068:0:5757:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94c83fde6000/0x3d2d1916761d6d11 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869443.547079:0:5757:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff94c81a585c00) 00010000:00010000:1.0:1788869443.547081:0:5757:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788869443.547084:0:5757:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94c83fde6000/0x3d2d1916761d6d11 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869443.547090:0:5757:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94c83fde6000/0x3d2d1916761d6d11 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869443.547136:0:5757:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94c83fde7200/0x3d2d1916761d6d03 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0x375c010249035a07 expref: 22 pid: 5757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869443.547422:0:5757:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94c83fde6600/0x3d2d1916761d6d18 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0x375c010249035a07 expref: 21 pid: 5757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869443.547429:0:5757:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff94c803990500) 00010000:00010000:1.0:1788869443.547432:0:5757:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788869443.547435:0:5757:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94c83fde6600, rc 0) 00000100:00100000:1.0:1788869443.547493:0:5757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c83fae9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2125b9b3-626e-4cbe-be83-fb446e976ce2+21:10479:x1875765413076736:12345-192.168.201.39@tcp:101:lfs.0 Request processed in 15196us (15472us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869443.547503:0:5757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 130 00000100:00100000:2.0:1788869443.677519:0:3284:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788869443.677896:0:3284:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94c83faeaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3284:1875765421465728:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788869443.677988:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869443.679199:0:6548:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765421465728 00000100:00100000:0.0:1788869443.679210:0:6548:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765421465728 00000100:00100000:0.0:1788869443.679294:0:6548:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1788869443.679306:0:6548:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c81f1f0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+9:3284:x1875765421465728:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788869443.679340:0:6548:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 3407872 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788869443.679415:0:6548:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c81f1f0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+9:3284:x1875765421465728:12345-0@lo:13:osp-pre-0-0.0 Request processed in 110us (1425us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869443.679422:0:6548:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1788869443.679479:0:3284:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94c83faeaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3284:1875765421465728:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1788869443.995595:0:5742:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788869444.024622:0:11860:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788869444.024636:0:11860:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788869444.024888:0:11860:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:1.0:1788869444.024894:0:11860:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000040:00080000:2.0:1788869444.509497:0:11485:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788869444.509508:0:11485:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788869444.509556:0:11485:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:2.0:1788869444.509564:0:11485:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1788869444.509739:0:11485:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94c81f1f3b80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11485:1875765421465856:192.168.201.39@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1788869444.509896:0:11485:0:(client.c:2702:ptlrpc_set_wait()) set ffff94c81075aa80 going to sleep for 11 seconds 00000100:00100000:0.0:1788869444.512566:0:11485:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94c81f1f3b80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11485:1875765421465856:192.168.201.39@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1788869444.513132:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1788869444.513192:0:5755:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765413077248 00000100:00100000:0.0:1788869444.513204:0:5755:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765413077248 00000100:00100000:0.0:1788869444.513541:0:5755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 131 00000100:00100000:0.0:1788869444.513554:0:5755:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c81f1f3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2125b9b3-626e-4cbe-be83-fb446e976ce2+21:10491:x1875765413077248:12345-192.168.201.39@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1788869444.513591:0:5755:0:(mdt_handler.c:8041:mdt_fid2path()) path get [0x200000401:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1788869444.513854:0:5755:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c81f1f3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2125b9b3-626e-4cbe-be83-fb446e976ce2+21:10491:x1875765413077248:12345-192.168.201.39@tcp:53:lhsmtool_posix.0 Request processed in 302us (728us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869444.513883:0:5755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 131 00000100:00100000:0.0:1788869444.517434:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1788869444.517495:0:5756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765413077504 00000100:00100000:3.0:1788869444.517506:0:5756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765413077504 00000100:00100000:3.0:1788869444.517576:0:5756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 132 00000100:00100000:3.0:1788869444.517586:0:5756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c83faeaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2125b9b3-626e-4cbe-be83-fb446e976ce2+21:10491:x1875765413077504:12345-192.168.201.39@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788869444.517712:0:5756:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788869444.517746:0:5756:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504c000/0x3d2d1916761d6d1f lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x375c010249035a0e expref: -99 pid: 5756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869444.517913:0:5756:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504c800/0x3d2d1916761d6d26 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869444.517927:0:5756:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504c800/0x3d2d1916761d6d26 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869444.517969:0:5756:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504c800/0x3d2d1916761d6d26 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788869444.517983:0:5756:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:3.0:1788869444.518119:0:5756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504c000/0x3d2d1916761d6d1f lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0x375c010249035a0e expref: 24 pid: 5756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869444.518137:0:5756:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504c800/0x3d2d1916761d6d26 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0x375c010249035a0e expref: 23 pid: 5756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869444.518495:0:5756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff94c803990500) 00010000:00010000:3.0:1788869444.518498:0:5756:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788869444.518501:0:5756:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94c83504c800, rc 0) 00000100:00100000:3.0:1788869444.518572:0:5756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c83faeaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2125b9b3-626e-4cbe-be83-fb446e976ce2+23:10491:x1875765413077504:12345-192.168.201.39@tcp:101:lhsmtool_posix.0 Request processed in 987us (1145us total) trans 4294967410 rc 0/0 00000100:00100000:3.0:1788869444.518580:0:5756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 132 00000100:00100000:1.0:1788869444.525790:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1788869444.525839:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1788869444.526038:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765413077760 00000100:00100000:2.0:1788869444.526055:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765413077760 00000100:00100000:2.0:1788869444.526127:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 133 00000100:00100000:2.0:1788869444.526137:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c82ccfdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2125b9b3-626e-4cbe-be83-fb446e976ce2+23:10491:x1875765413077760:12345-192.168.201.39@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1788869444.526239:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765413077888 00000100:00100000:0.0:1788869444.526244:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765413077888 00000100:00100000:0.0:1788869444.526316:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 7 00000100:00100000:0.0:1788869444.526324:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c82ccfd180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2125b9b3-626e-4cbe-be83-fb446e976ce2+24:2346:x1875765413077888:12345-192.168.201.39@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788869444.526338:0:5788:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788869444.526362:0:5788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504c800/0x3d2d1916761d6d26 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.39@tcp remote: 0x375c010249035a0e expref: 24 pid: 5756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869444.526381:0:5788:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff94c803990500) 00010000:00010000:0.0:1788869444.526386:0:5788:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788869444.526434:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c82ccfd180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2125b9b3-626e-4cbe-be83-fb446e976ce2+23:2346:x1875765413077888:12345-192.168.201.39@tcp:103:ldlm_bl.0 Request processed in 110us (594us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869444.526442:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 7 00010000:00010000:2.0:1788869444.526679:0:5786:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94c805039400/0x3d2d1916761d6d34 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869444.526694:0:5786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94c805039400/0x3d2d1916761d6d34 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869444.526704:0:5786:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94c805039400/0x3d2d1916761d6d34 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869444.526912:0:5786:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94c805039400/0x3d2d1916761d6d34 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869444.526920:0:5786:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94c805039400/0x3d2d1916761d6d34 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869444.526927:0:5786:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94c805039400/0x3d2d1916761d6d34 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869444.526932:0:5786:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94c805039400 already unused, calling callback (ffffffffc21124f0) 00010000:00010000:2.0:1788869444.526937:0:5786:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94c805039400/0x3d2d1916761d6d34 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869444.526943:0:5786:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94c805039400/0x3d2d1916761d6d34 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869444.526951:0:5786:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff94c803990500) 00010000:00010000:2.0:1788869444.526955:0:5786:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1788869444.526958:0:5786:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94c805039400/0x3d2d1916761d6d34 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869444.526963:0:5786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94c805039400/0x3d2d1916761d6d34 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788869444.527086:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c82ccfdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2125b9b3-626e-4cbe-be83-fb446e976ce2+23:10491:x1875765413077760:12345-192.168.201.39@tcp:57:lhsmtool_posix.0 Request processed in 950us (1305us total) trans 4294967411 rc 0/0 00000100:00100000:2.0:1788869444.527093:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 133 00000040:00080000:0.0:1788869444.527464:0:11485:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788869444.527469:0:11485:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788869444.527990:0:11485:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:0.0:1788869444.527999:0:11485:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1788869444.529574:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1788869444.529776:0:11820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765413078144 00000100:00100000:0.0:1788869444.529783:0:11820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765413078144 00000100:00100000:0.0:1788869444.529833:0:11820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 34 00000100:00100000:0.0:1788869444.529842:0:11820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c82ccfea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:2125b9b3-626e-4cbe-be83-fb446e976ce2+23:10491:x1875765413078144:12345-192.168.201.39@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1788869444.530033:0:11820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c82ccfea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:2125b9b3-626e-4cbe-be83-fb446e976ce2+24:10491:x1875765413078144:12345-192.168.201.39@tcp:35:lhsmtool_posix.0 Request processed in 191us (462us total) trans 4294967412 rc 0/0 00000100:00100000:0.0:1788869444.530054:0:11820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 34 00010000:00010000:2.0:1788869445.019420:0:7447:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788869445.458481:0:11911:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788869445.458490:0:11911:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788869445.458540:0:11911:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:1.0:1788869445.458547:0:11911:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1788869445.547455:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1788869445.548243:0:5757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765413078400 00000100:00100000:0.0:1788869445.548279:0:5757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765413078400 00000100:00100000:0.0:1788869445.548380:0:5757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 134 00000100:00100000:0.0:1788869445.548394:0:5757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c835a14000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2125b9b3-626e-4cbe-be83-fb446e976ce2+24:10512:x1875765413078400:12345-192.168.201.39@tcp:101:lfs.0 00010000:00010000:0.0:1788869445.548427:0:5757:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788869445.548457:0:5757:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94c81a582200/0x3d2d1916761d6d3b lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x375c010249035a15 expref: -99 pid: 5757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869445.548589:0:5757:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff94c81a583e00/0x3d2d1916761d6d42 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869445.548607:0:5757:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94c81a583e00/0x3d2d1916761d6d42 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869445.548622:0:5757:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94c81a583e00/0x3d2d1916761d6d42 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5757 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788869445.548637:0:5757:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:0.0:1788869445.548807:0:5757:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94c81a582200/0x3d2d1916761d6d3b lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0x375c010249035a15 expref: 27 pid: 5757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869445.548825:0:5757:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94c81a583e00/0x3d2d1916761d6d42 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0x375c010249035a15 expref: 26 pid: 5757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869445.548835:0:5757:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff94c803990500) 00010000:00010000:0.0:1788869445.548838:0:5757:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:0.0:1788869445.548842:0:5757:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94c81a583e00, rc 0) 00000100:00100000:0.0:1788869445.548918:0:5757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c835a14000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2125b9b3-626e-4cbe-be83-fb446e976ce2+26:10512:x1875765413078400:12345-192.168.201.39@tcp:101:lfs.0 Request processed in 528us (1479us total) trans 4294967413 rc 0/0 00000100:00100000:0.0:1788869445.548926:0:5757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 134 00000100:00080000:1.0:1788869445.549121:0:5751:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788869445.553078:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1788869445.553191:0:5755:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765413078528 00000100:00100000:0.0:1788869445.553204:0:5755:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765413078528 00000100:00100000:0.0:1788869445.553360:0:5755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 135 00000100:00100000:0.0:1788869445.553373:0:5755:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c835a17480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2125b9b3-626e-4cbe-be83-fb446e976ce2+26:10512:x1875765413078528:12345-192.168.201.39@tcp:54:lfs.0 00010000:00010000:0.0:1788869445.553466:0:5755:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94c81a583000/0x3d2d1916761d6d50 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869445.553489:0:5755:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94c81a583000/0x3d2d1916761d6d50 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869445.553504:0:5755:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94c81a583000/0x3d2d1916761d6d50 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869445.553538:0:5755:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94c81a583000/0x3d2d1916761d6d50 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869445.553544:0:5755:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94c81a583000/0x3d2d1916761d6d50 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869445.553551:0:5755:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94c81a583000/0x3d2d1916761d6d50 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869445.553557:0:5755:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94c81a583000 already unused, calling callback (ffffffffc21124f0) 00010000:00010000:0.0:1788869445.553562:0:5755:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94c81a583000/0x3d2d1916761d6d50 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869445.553570:0:5755:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94c81a583000/0x3d2d1916761d6d50 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869445.553593:0:5755:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff94c803990500) 00010000:00010000:0.0:1788869445.553596:0:5755:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788869445.553602:0:5755:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94c81a583000/0x3d2d1916761d6d50 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869445.553609:0:5755:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94c81a583000/0x3d2d1916761d6d50 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788869445.553687:0:5755:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c835a17480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2125b9b3-626e-4cbe-be83-fb446e976ce2+26:10512:x1875765413078528:12345-192.168.201.39@tcp:54:lfs.0 Request processed in 317us (624us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869445.553694:0:5755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 135 00000100:00100000:0.0:1788869445.599828:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1788869445.600299:0:6544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765413078656 00000100:00100000:2.0:1788869445.600314:0:6544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765413078656 00000100:00100000:2.0:1788869445.600411:0:6544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 46 00000100:00100000:2.0:1788869445.600425:0:6544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c83fae8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2125b9b3-626e-4cbe-be83-fb446e976ce2+6:2348:x1875765413078656:12345-192.168.201.39@tcp:101:cat.0 00010000:00010000:2.0:1788869445.600451:0:6544:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788869445.600481:0:6544:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a046f8e3/0x3d2d1916761d6d57 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x375c010249035a1c expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788869445.600517:0:6544:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x4:0x0] initial LVB size: 13, mtime: 0x6a9ffb41, atime: 0x6a9ffb41, ctime: 0x6a9ffb41, blocks: 0xb 00010000:00010000:2.0:1788869445.600542:0:6544:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=193s v=(0 0) 00010000:00010000:2.0:1788869445.600548:0:6544:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788869445.600561:0:6544:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a046f8e3/0x3d2d1916761d6d57 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.39@tcp remote: 0x375c010249035a1c expref: 7 pid: 6544 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869445.600583:0:6544:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000a046f8e3/0x3d2d1916761d6d57 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.39@tcp remote: 0x375c010249035a1c expref: 7 pid: 6544 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869445.600599:0:6544:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94c805039000, rc 0) 00000100:00100000:2.0:1788869445.600673:0:6544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c83fae8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2125b9b3-626e-4cbe-be83-fb446e976ce2+7:2348:x1875765413078656:12345-192.168.201.39@tcp:101:cat.0 Request processed in 252us (857us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869445.600681:0:6544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 46 00000100:00080000:1.0:1788869445.601366:0:5751:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788869445.603482:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1788869445.603675:0:6552:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765413078784 00000100:00100000:1.0:1788869445.603689:0:6552:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765413078784 00002000:00100000:1.0:1788869445.603761:0:6552:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x4:0x0] (0->4095) req@ffff94c835a15c00 x1875765413078784/t0(0) o3->2125b9b3-626e-4cbe-be83-fb446e976ce2@192.168.201.39@tcp:391/0 lens 488/0 e 0 to 0 dl 1788869456 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788869445.603775:0:6552:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff94c835a15c00 with x1875765413078784 ext(0->4095) 00002000:00010000:1.0:1788869445.603907:0:6552:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff94c835a15c00 00000100:00100000:1.0:1788869445.603950:0:6552:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 3 00000100:00100000:1.0:1788869445.603961:0:6552:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c835a15c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:2125b9b3-626e-4cbe-be83-fb446e976ce2+7:2347:x1875765413078784:12345-192.168.201.39@tcp:3:cat.0 00000100:00100000:1.0:1788869445.604749:0:6552:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c835a15c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:2125b9b3-626e-4cbe-be83-fb446e976ce2+7:2347:x1875765413078784:12345-192.168.201.39@tcp:3:cat.0 Request processed in 788us (1273us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1788869445.604758:0:6552:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 3 00002000:00100000:1.0:1788869445.604765:0:6552:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x4:0x0] (0->4095) req@ffff94c835a15c00 x1875765413078784/t0(0) o3->2125b9b3-626e-4cbe-be83-fb446e976ce2@192.168.201.39@tcp:391/0 lens 488/4536 e 0 to 0 dl 1788869456 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788869445.604775:0:6552:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff94c835a15c00 with x1875765413078784 ext(0->4095) 00002000:00010000:1.0:1788869445.604779:0:6552:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff94c835a15c00 00010000:00010000:0.0:1788869446.043887:0:5743:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1788869446.273771:0:6571:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967299 is committed 00000001:00080000:0.0:1788869446.273996:0:6571:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967303 is committed 00000001:00080000:0.0:1788869446.274222:0:6571:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967304 is committed 00000001:00080000:0.0:1788869446.274229:0:6571:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967302 is committed 00000100:00100000:2.0:1788869446.747430:0:3283:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1788869446.747450:0:3283:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94c83faebb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3283:1875765421466496:0@lo:400:kworker.0 00000100:00100000:0.0:1788869446.747453:0:3286:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94c83fae9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3286:1875765421466368:0@lo:400:kworker.0 00000100:00100000:1.0:1788869446.747510:0:3285:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94c83faea300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3285:1875765421466240:0@lo:400:kworker.0 00000100:00100000:3.0:1788869446.747524:0:3284:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94c83fae8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3284:1875765421466624:0@lo:400:kworker.0 00000100:00100000:0.0:1788869446.748343:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869446.748347:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869446.748400:0:3283:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94c82ceda300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3283:1875765421465984:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788869446.748421:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869446.748421:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869446.748443:0:3283:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94c83faeb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:121cd5bc-7f07-4cf7-8e2e-4356c89c0696:3283:1875765421466112:0@lo:400:kworker.0 00000100:00100000:2.0:1788869446.748469:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869446.748504:0:6548:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765421465984 00000100:00100000:2.0:1788869446.748512:0:6548:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765421465984 00000100:00100000:0.0:1788869446.748556:0:5757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765421466368 00000100:00100000:0.0:1788869446.748560:0:5757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765421466368 00000100:00100000:2.0:1788869446.748563:0:6548:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1788869446.748572:0:6548:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c82ced9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3283:x1875765421465984:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788869446.748583:0:5757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765421466240 00000100:00100000:0.0:1788869446.748586:0:5757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765421466240 00000100:00100000:0.0:1788869446.748602:0:5757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00002000:00000024:2.0:1788869446.748605:0:6548:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788869446.748607:0:5757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c83faeb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3286:x1875765421466368:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788869446.748644:0:6548:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c82ced9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3283:x1875765421465984:12345-0@lo:13:osp-pre-1-0.0 Request processed in 73us (221us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869446.748644:0:5757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c83faeb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3286:x1875765421466368:12345-0@lo:400:kworker.0 Request processed in 36us (301us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869446.748652:0:6548:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1788869446.748652:0:5757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:2.0:1788869446.748672:0:5749:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765421466112 00000100:00100000:2.0:1788869446.748675:0:5749:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765421466112 00000100:00100000:0.0:1788869446.748676:0:5757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1788869446.748681:0:5757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c82ccff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3285:x1875765421466240:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788869446.748708:0:5749:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 267 00000100:00100000:2.0:1788869446.748715:0:5749:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c81f149c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:121cd5bc-7f07-4cf7-8e2e-4356c89c0696+19:3283:x1875765421466112:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788869446.748730:0:5757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c82ccff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3285:x1875765421466240:12345-0@lo:400:kworker.0 Request processed in 49us (308us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869446.748736:0:5757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1788869446.748739:0:5749:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c81f149c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:121cd5bc-7f07-4cf7-8e2e-4356c89c0696+19:3283:x1875765421466112:12345-0@lo:400:kworker.0 Request processed in 26us (270us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869446.748744:0:5749:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 267 00000100:00080000:2.0:1788869446.748765:0:5751:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788869446.748770:0:5751:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788869446.748770:0:3286:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94c83fae9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3286:1875765421466368:0@lo:400:kworker.0 00000100:00100000:2.0:1788869446.748793:0:3283:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94c82ceda300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3283:1875765421465984:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788869446.748802:0:3283:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94c83faeb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:121cd5bc-7f07-4cf7-8e2e-4356c89c0696:3283:1875765421466112:0@lo:400:kworker.0 00000100:00100000:0.0:1788869446.748819:0:11822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765421466496 00000100:00100000:0.0:1788869446.748822:0:11822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765421466496 00000100:00080000:2.0:1788869446.748838:0:5751:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788869446.748850:0:11822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1788869446.748856:0:11822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c82ced9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3283:x1875765421466496:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788869446.748892:0:11822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c82ced9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3283:x1875765421466496:12345-0@lo:400:kworker.0 Request processed in 35us (543us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869446.748898:0:11822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1788869446.748918:0:3283:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967304 gen 2 00000004:00080000:2.0:1788869446.748924:0:3283:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967300 committed transno 4294967304 00000004:00080000:2.0:1788869446.748936:0:3283:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94c82cdab800, transno 4294967301 00000004:00080000:2.0:1788869446.748950:0:3283:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967303 committed transno 4294967304 00000100:00100000:1.0:1788869446.748952:0:3285:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94c83faea300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3285:1875765421466240:0@lo:400:kworker.0 00000100:00100000:1.0:1788869446.748958:0:3285:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94c83fae8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3285:1875765421466752:0@lo:400:kworker.0 00000004:00080000:2.0:1788869446.748959:0:3283:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94c83fae9500, transno 4294967304 00000100:00100000:2.0:1788869446.748963:0:3283:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94c83faebb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3283:1875765421466496:0@lo:400:kworker.0 00000100:00100000:1.0:1788869446.748979:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869446.749005:0:6546:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765421466752 00000100:00100000:2.0:1788869446.749009:0:6546:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765421466752 00000100:00100000:2.0:1788869446.749038:0:6546:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1788869446.749045:0:6546:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c82ccff480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3285:x1875765421466752:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788869446.749084:0:6546:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c82ccff480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3285:x1875765421466752:12345-0@lo:400:kworker.0 Request processed in 39us (103us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869446.749090:0:6546:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1788869446.749098:0:3285:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94c83fae8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3285:1875765421466752:0@lo:400:kworker.0 00000100:00100000:3.0:1788869446.749749:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869446.749796:0:5757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765421466624 00000100:00100000:0.0:1788869446.749800:0:5757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765421466624 00000100:00100000:0.0:1788869446.749845:0:5757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:0.0:1788869446.749852:0:5757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c835a16d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3284:x1875765421466624:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788869446.749898:0:5757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c835a16d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3284:x1875765421466624:12345-0@lo:400:kworker.0 Request processed in 46us (150us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869446.749905:0:5757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:3.0:1788869446.750280:0:3284:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94c83fae8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3284:1875765421466624:0@lo:400:kworker.0 00000100:00080000:2.0:1788869446.750744:0:5751:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1788869447.068386:0:5742:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788869448.092209:0:7447:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788869448.110523:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1788869448.110570:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1788869448.110607:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1788869448.110652:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1788869448.110697:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1788869448.110712:0:5756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765413079424 00000100:00100000:0.0:1788869448.110723:0:5756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765413079424 00000100:00100000:3.0:1788869448.110726:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765413079040 00000100:00100000:3.0:1788869448.110732:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765413079040 00000100:00100000:0.0:1788869448.110792:0:5756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 89 00000100:00100000:2.0:1788869448.110801:0:6544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765413079168 00000100:00100000:2.0:1788869448.110808:0:6544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765413079168 00000100:00100000:0.0:1788869448.110808:0:5756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c835a17100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:10cd6f3c-009b-4acc-9ca5-e50cb17e412c+5:2348:x1875765413079424:12345-192.168.201.39@tcp:400:kworker.0 00000100:00100000:1.0:1788869448.110865:0:5748:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765413078912 00000100:00100000:1.0:1788869448.110871:0:5748:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765413078912 00000100:00100000:0.0:1788869448.110886:0:5756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c835a17100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:10cd6f3c-009b-4acc-9ca5-e50cb17e412c+5:2348:x1875765413079424:12345-192.168.201.39@tcp:400:kworker.0 Request processed in 82us (275us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869448.110901:0:5756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 89 00000100:00100000:1.0:1788869448.110910:0:5748:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 268 00000100:00100000:1.0:1788869448.110920:0:5748:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c81f14a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3cca3acf-4935-4d0d-9982-d5d931f1c86b+13:2348:x1875765413078912:12345-192.168.201.39@tcp:400:kworker.0 00000100:00100000:1.0:1788869448.110961:0:5748:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c81f14a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3cca3acf-4935-4d0d-9982-d5d931f1c86b+13:2348:x1875765413078912:12345-192.168.201.39@tcp:400:kworker.0 Request processed in 43us (588us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869448.110972:0:5748:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 268 00000100:00100000:3.0:1788869448.112437:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 90 00000100:00100000:3.0:1788869448.112451:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c835a14700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2125b9b3-626e-4cbe-be83-fb446e976ce2+26:2348:x1875765413079040:12345-192.168.201.39@tcp:400:kworker.0 00000100:00100000:3.0:1788869448.112500:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c835a14700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2125b9b3-626e-4cbe-be83-fb446e976ce2+26:2348:x1875765413079040:12345-192.168.201.39@tcp:400:kworker.0 Request processed in 52us (1848us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869448.112507:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 90 00000100:00100000:3.0:1788869448.112529:0:11822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765413079296 00000100:00100000:3.0:1788869448.112534:0:11822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765413079296 00000100:00080000:0.0:1788869448.112764:0:5751:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788869448.112769:0:5751:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788869448.112772:0:5751:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788869448.113080:0:11822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 43 00000100:00100000:3.0:1788869448.113094:0:11822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c835a15180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:2125b9b3-626e-4cbe-be83-fb446e976ce2+7:2348:x1875765413079296:12345-192.168.201.39@tcp:400:kworker.0 00000100:00100000:3.0:1788869448.113127:0:11822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c835a15180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:2125b9b3-626e-4cbe-be83-fb446e976ce2+7:2348:x1875765413079296:12345-192.168.201.39@tcp:400:kworker.0 Request processed in 36us (2429us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869448.113134:0:11822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 43 00000100:00100000:1.0:1788869448.113603:0:7884:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 44 00000100:00100000:1.0:1788869448.113615:0:7884:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c835a15500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:2125b9b3-626e-4cbe-be83-fb446e976ce2+5:2348:x1875765413079168:12345-192.168.201.39@tcp:400:kworker.0 00000100:00100000:1.0:1788869448.113735:0:7884:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c835a15500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:2125b9b3-626e-4cbe-be83-fb446e976ce2+5:2348:x1875765413079168:12345-192.168.201.39@tcp:400:kworker.0 Request processed in 123us (3164us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869448.113742:0:7884:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 44 00000100:00100000:3.0:1788869448.212736:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1788869448.212951:0:5756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765413079552 00000100:00100000:0.0:1788869448.212960:0:5756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765413079552 00000100:00100000:0.0:1788869448.213073:0:5756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 136 00000100:00100000:0.0:1788869448.213085:0:5756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c835a14e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2125b9b3-626e-4cbe-be83-fb446e976ce2+26:10165:x1875765413079552:12345-192.168.201.39@tcp:60:lhsmtool_posix.0 00000100:00100000:0.0:1788869448.213194:0:5756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c835a14e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2125b9b3-626e-4cbe-be83-fb446e976ce2+26:10165:x1875765413079552:12345-192.168.201.39@tcp:60:lhsmtool_posix.0 Request processed in 112us (467us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869448.213202:0:5756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 136 00000100:00100000:2.0:1788869448.218312:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1788869448.218457:0:5758:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765413079808 00000100:00100000:0.0:1788869448.218467:0:5758:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765413079808 00000100:00100000:0.0:1788869448.218527:0:5758:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 35 00000100:00100000:0.0:1788869448.218537:0:5758:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c82ceda300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2125b9b3-626e-4cbe-be83-fb446e976ce2+26:10165:x1875765413079808:12345-192.168.201.39@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1788869448.218951:0:5758:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c82ceda300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2125b9b3-626e-4cbe-be83-fb446e976ce2+27:10165:x1875765413079808:12345-192.168.201.39@tcp:35:lhsmtool_posix.0 Request processed in 415us (645us total) trans 4294967414 rc 0/0 00000100:00100000:0.0:1788869448.218960:0:5758:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 35 00000100:00100000:3.0:1788869448.300406:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1788869448.300476:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765413079936 00000100:00100000:2.0:1788869448.300486:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765413079936 00000100:00100000:2.0:1788869448.300553:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 137 00000100:00100000:2.0:1788869448.300563:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c835a15f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:10cd6f3c-009b-4acc-9ca5-e50cb17e412c+5:10963:x1875765413079936:12345-192.168.201.39@tcp:101:lsof.0 00010000:00010000:2.0:1788869448.300582:0:5786:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788869448.300602:0:5786:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94c805038000/0x3d2d1916761d6d5e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x375c010249035a23 expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869448.300676:0:5786:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94c805038600/0x3d2d1916761d6d65 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869448.300701:0:5786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94c805038600/0x3d2d1916761d6d65 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869448.300712:0:5786:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94c805038600/0x3d2d1916761d6d65 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788869448.300881:0:5786:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:2.0:1788869448.300885:0:5786:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:2.0:1788869448.300974:0:5786:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff94c805038600/0x3d2d1916761d6d65 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869448.300999:0:5786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94c805038000/0x3d2d1916761d6d5e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0x375c010249035a23 expref: 7 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869448.301016:0:5786:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94c805038600/0x3d2d1916761d6d65 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0x375c010249035a23 expref: 6 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869448.301024:0:5786:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff94c819394300) 00010000:00010000:2.0:1788869448.301027:0:5786:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788869448.301043:0:5786:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94c805038600, rc 0) 00000100:00100000:2.0:1788869448.301098:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c835a15f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:10cd6f3c-009b-4acc-9ca5-e50cb17e412c+6:10963:x1875765413079936:12345-192.168.201.39@tcp:101:lsof.0 Request processed in 537us (703us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869448.301105:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 137 00000100:00100000:3.0:1788869448.795502:0:3285:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788869448.795521:0:3285:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94c83fae9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3285:1875765421466880:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788869448.795588:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869448.795731:0:6548:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765421466880 00000100:00100000:2.0:1788869448.795738:0:6548:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765421466880 00000100:00100000:2.0:1788869448.795793:0:6548:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1788869448.795803:0:6548:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c835a16680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3285:x1875765421466880:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788869448.795836:0:6548:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788869448.795898:0:6548:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c835a16680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3285:x1875765421466880:12345-0@lo:13:osp-pre-0-0.0 Request processed in 98us (309us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869448.795907:0:6548:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1788869448.795964:0:3285:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94c83fae9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3285:1875765421466880:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1788869448.795992:0:5751:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00080000:3.0:1788869448.840769:0:5777:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967414 is committed 00000020:00080000:3.0:1788869448.840825:0:5777:0:(update_trans.c:58:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff94c806043e40 refcount 2 committed 0 result 0 batchid 4 00000020:00080000:3.0:1788869448.840832:0:5777:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff94c836634500 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff94c806043540 00000020:00080000:3.0:1788869448.840836:0:5777:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff94c836634900 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff94c83faef000 00000020:00080000:3.0:1788869448.840862:0:5777:0:(update_trans.c:1348:distribute_txn_batchid_cb()) lustre-MDT0000: 3 batchid updated 00000020:00080000:1.0:1788869448.841107:0:5791:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 4 committed batchid 3 00000020:00080000:1.0:1788869448.841425:0:5791:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 3 00000001:00080000:2.0:1788869448.843537:0:7458:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967312 is committed 00000001:00080000:2.0:1788869448.843557:0:7458:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967311 is committed 00010000:00010000:0.0:1788869449.119976:0:5743:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788869449.628426:0:11485:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788869449.628433:0:11485:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788869449.628514:0:11485:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:0.0:1788869449.628522:0:11485:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000001:02000400:3.0:1788869449.823633:0:12112:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1b: Test manual lfs pcc attach with restore on remote access ========================================================== 08:10:47 (1788869447) 00010000:00010000:0.0:1788869450.139555:0:5742:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788869450.658748:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1788869450.658868:0:5757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765413080192 00000100:00100000:1.0:1788869450.658878:0:5757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765413080192 00000100:00100000:1.0:1788869450.658954:0:5757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 138 00000100:00100000:1.0:1788869450.658964:0:5757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c835a16a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2125b9b3-626e-4cbe-be83-fb446e976ce2+13:11227:x1875765413080192:12345-192.168.201.39@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788869450.658998:0:5757:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00080000:2.0:1788869450.659008:0:5751:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1788869450.659018:0:5757:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94c83fde6a00/0x3d2d1916761d6d6c lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x375c010249035a2a expref: -99 pid: 5757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869450.659103:0:5757:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff94c83fde7400/0x3d2d1916761d6d73 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869450.659117:0:5757:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94c83fde7400/0x3d2d1916761d6d73 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869450.659139:0:5757:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94c83fde7400/0x3d2d1916761d6d73 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869450.659155:0:5757:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94c83fde6200/0x3d2d1916761d6d7a lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869450.659162:0:5757:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94c83fde6200/0x3d2d1916761d6d7a lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869450.659187:0:5757:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94c83fde6200/0x3d2d1916761d6d7a lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869450.659628:0:5757:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94c83fde7000/0x3d2d1916761d6d81 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869450.659638:0:5757:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94c83fde7000/0x3d2d1916761d6d81 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869450.659645:0:5757:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94c83fde7000/0x3d2d1916761d6d81 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5757 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788869450.659655:0:5757:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 6656 00010000:00010000:1.0:1788869450.659838:0:5757:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff94c83fde7400/0x3d2d1916761d6d73 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869450.659846:0:5757:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94c83fde7400/0x3d2d1916761d6d73 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869450.659853:0:5757:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94c83fde7400/0x3d2d1916761d6d73 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869450.659859:0:5757:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94c83fde7400 already unused, calling callback (ffffffffc21124f0) 00010000:00010000:1.0:1788869450.659863:0:5757:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94c83fde7400/0x3d2d1916761d6d73 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869450.659871:0:5757:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94c83fde7400/0x3d2d1916761d6d73 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869450.659883:0:5757:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff94c819394f00) 00010000:00010000:1.0:1788869450.659886:0:5757:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788869450.659896:0:5757:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94c83fde7400/0x3d2d1916761d6d73 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869450.659903:0:5757:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94c83fde7400/0x3d2d1916761d6d73 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869450.659914:0:5757:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94c83fde6200/0x3d2d1916761d6d7a lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869450.659921:0:5757:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94c83fde6200/0x3d2d1916761d6d7a lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869450.659926:0:5757:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94c83fde6200/0x3d2d1916761d6d7a lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869450.659931:0:5757:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94c83fde6200 already unused, calling callback (ffffffffc21124f0) 00010000:00010000:1.0:1788869450.659934:0:5757:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94c83fde6200/0x3d2d1916761d6d7a lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869450.659940:0:5757:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94c83fde6200/0x3d2d1916761d6d7a lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869450.659946:0:5757:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff94c81a585800) 00010000:00010000:1.0:1788869450.659948:0:5757:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788869450.659951:0:5757:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94c83fde6200/0x3d2d1916761d6d7a lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869450.659956:0:5757:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94c83fde6200/0x3d2d1916761d6d7a lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869450.660292:0:5757:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94c83fde6a00/0x3d2d1916761d6d6c lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0x375c010249035a2a expref: 16 pid: 5757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869450.660312:0:5757:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94c83fde7000/0x3d2d1916761d6d81 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0x375c010249035a2a expref: 15 pid: 5757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869450.660317:0:5757:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff94c819394200) 00010000:00010000:1.0:1788869450.660319:0:5757:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788869450.660320:0:5757:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94c83fde7000, rc 0) 00000100:00100000:1.0:1788869450.660372:0:5757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c835a16a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2125b9b3-626e-4cbe-be83-fb446e976ce2+15:11227:x1875765413080192:12345-192.168.201.39@tcp:101:lhsmtool_posix.0 Request processed in 1411us (1634us total) trans 4294967415 rc 0/0 00000100:00100000:1.0:1788869450.660378:0:5757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 138 00000100:00100000:0.0:1788869450.664686:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1788869450.664767:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1788869450.664824:0:5755:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765413080448 00000100:00100000:3.0:1788869450.664832:0:5739:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765413080320 00000100:00100000:1.0:1788869450.664835:0:5755:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765413080448 00000100:00100000:3.0:1788869450.664838:0:5739:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765413080320 00000100:00100000:1.0:1788869450.664899:0:5755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 139 00000100:00100000:1.0:1788869450.664906:0:5755:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c83fae9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2125b9b3-626e-4cbe-be83-fb446e976ce2+16:11227:x1875765413080448:12345-192.168.201.39@tcp:59:lhsmtool_posix.0 00000100:00100000:3.0:1788869450.664932:0:5739:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 8 00000100:00100000:3.0:1788869450.664942:0:5739:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c83fae9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2125b9b3-626e-4cbe-be83-fb446e976ce2+16:2347:x1875765413080320:12345-192.168.201.39@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788869450.664956:0:5739:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788869450.664980:0:5739:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94c83fde7000/0x3d2d1916761d6d81 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.39@tcp remote: 0x375c010249035a2a expref: 16 pid: 5757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788869450.664990:0:5755:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c83fae9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2125b9b3-626e-4cbe-be83-fb446e976ce2+16:11227:x1875765413080448:12345-192.168.201.39@tcp:59:lhsmtool_posix.0 Request processed in 84us (224us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869450.664997:0:5755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 139 00010000:00010000:3.0:1788869450.665001:0:5739:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff94c819394200) 00010000:00010000:3.0:1788869450.665007:0:5739:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788869450.665030:0:5739:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c83fae9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2125b9b3-626e-4cbe-be83-fb446e976ce2+14:2347:x1875765413080320:12345-192.168.201.39@tcp:103:ldlm_bl.0 Request processed in 91us (353us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869450.665037:0:5739:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 8 00010000:00010000:3.0:1788869451.164585:0:7447:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788869451.676614:0:11485:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788869451.676623:0:11485:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788869451.676660:0:11485:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:3.0:1788869451.676666:0:11485:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1788869451.742103:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1788869451.742691:0:5757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765413080576 00000100:00100000:1.0:1788869451.742701:0:5757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765413080576 00000100:00100000:1.0:1788869451.742757:0:5757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 140 00000100:00100000:1.0:1788869451.742768:0:5757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c835a14a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2125b9b3-626e-4cbe-be83-fb446e976ce2+14:11270:x1875765413080576:12345-192.168.201.39@tcp:101:lfs.0 00010000:00010000:1.0:1788869451.742788:0:5757:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788869451.742809:0:5757:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94c83fde7200/0x3d2d1916761d6d8f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x375c010249035a31 expref: -99 pid: 5757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869451.742873:0:5757:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff94c83fde6000/0x3d2d1916761d6d96 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869451.742897:0:5757:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94c83fde6000/0x3d2d1916761d6d96 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869451.742911:0:5757:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94c83fde6000/0x3d2d1916761d6d96 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869451.742926:0:5757:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94c83fde7e00/0x3d2d1916761d6d9d lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869451.742934:0:5757:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94c83fde7e00/0x3d2d1916761d6d9d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869451.742940:0:5757:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94c83fde7e00/0x3d2d1916761d6d9d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869451.743183:0:5757:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff94c83fde6000/0x3d2d1916761d6d96 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869451.743192:0:5757:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94c83fde6000/0x3d2d1916761d6d96 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869451.743199:0:5757:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94c83fde6000/0x3d2d1916761d6d96 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869451.743204:0:5757:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94c83fde6000 already unused, calling callback (ffffffffc21124f0) 00010000:00010000:1.0:1788869451.743209:0:5757:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94c83fde6000/0x3d2d1916761d6d96 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869451.743216:0:5757:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94c83fde6000/0x3d2d1916761d6d96 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869451.743228:0:5757:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff94c819394300) 00010000:00010000:1.0:1788869451.743237:0:5757:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788869451.743242:0:5757:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94c83fde6000/0x3d2d1916761d6d96 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869451.743276:0:5757:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94c83fde6000/0x3d2d1916761d6d96 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869451.743292:0:5757:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94c83fde7e00/0x3d2d1916761d6d9d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869451.743299:0:5757:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94c83fde7e00/0x3d2d1916761d6d9d lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869451.743305:0:5757:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94c83fde7e00/0x3d2d1916761d6d9d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869451.743311:0:5757:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94c83fde7e00 already unused, calling callback (ffffffffc21124f0) 00010000:00010000:1.0:1788869451.743314:0:5757:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94c83fde7e00/0x3d2d1916761d6d9d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869451.743321:0:5757:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94c83fde7e00/0x3d2d1916761d6d9d lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869451.743329:0:5757:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff94c81a585800) 00010000:00010000:1.0:1788869451.743332:0:5757:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788869451.743335:0:5757:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94c83fde7e00/0x3d2d1916761d6d9d lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869451.743340:0:5757:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94c83fde7e00/0x3d2d1916761d6d9d lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869451.743369:0:5757:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94c83fde7200/0x3d2d1916761d6d8f lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0x375c010249035a31 expref: 15 pid: 5757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869451.743391:0:5757:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff94c819394300) 00010000:00010000:1.0:1788869451.743393:0:5757:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788869451.743397:0:5757:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94c83fde7200/0x3d2d1916761d6d8f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.39@tcp remote: 0x375c010249035a31 expref: 15 pid: 5757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869451.743406:0:5757:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94c83fde7200, rc 0) 00000100:00100000:1.0:1788869451.743467:0:5757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c835a14a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2125b9b3-626e-4cbe-be83-fb446e976ce2+14:11270:x1875765413080576:12345-192.168.201.39@tcp:101:lfs.0 Request processed in 701us (1374us total) trans 0 rc 301/301 00000100:00100000:1.0:1788869451.743475:0:5757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 140 00000100:00100000:2.0:1788869451.754276:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1788869451.754339:0:5755:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765413080832 00000100:00100000:3.0:1788869451.754350:0:5755:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765413080832 00000100:00100000:3.0:1788869451.754416:0:5755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 141 00000100:00100000:3.0:1788869451.754483:0:5755:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c810732300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2125b9b3-626e-4cbe-be83-fb446e976ce2+14:11270:x1875765413080832:12345-192.168.201.39@tcp:36:lfs.0 00010000:00010000:3.0:1788869451.754540:0:5755:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788869451.754566:0:5755:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504d200/0x3d2d1916761d66ff lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.39@tcp remote: 0x375c01024903585c expref: 14 pid: 5757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869451.754601:0:5755:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff94c819394300) 00010000:00010000:3.0:1788869451.754607:0:5755:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788869451.754941:0:5755:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504ce00/0x3d2d1916761d6da4 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869451.755015:0:5755:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff94c805038600/0x3d2d1916761d6d65 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0x375c010249035a23 expref: 5 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869451.755025:0:5755:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504ce00/0x3d2d1916761d6da4 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869451.755059:0:5755:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff94c805038600/0x3d2d1916761d6d65 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.39@tcp remote: 0x375c010249035a23 expref: 5 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869451.755072:0:5755:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff94c805038600/0x3d2d1916761d6d65 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.39@tcp remote: 0x375c010249035a23 expref: 5 pid: 5786 timeout: 300 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788869451.755087:0:5755:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94c835a17800 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5755:1875765421467008:192.168.201.39@tcp:104: 00000100:00100000:3.0:1788869451.755222:0:5755:0:(client.c:2702:ptlrpc_set_wait()) set ffff94c8357d5600 going to sleep for 11 seconds 00000100:00100000:0.0:1788869451.758483:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1788869451.758634:0:5740:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765413080960 00000100:00100000:1.0:1788869451.758644:0:5740:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765413080960 00010000:00010000:1.0:1788869451.758698:0:5740:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff94c805038600/0x3d2d1916761d6d65 lrc: 5/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.39@tcp remote: 0x375c010249035a23 expref: 6 pid: 5786 timeout: 300 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788869451.758735:0:5740:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 63 00000100:00100000:1.0:1788869451.758744:0:5740:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c83fae8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:10cd6f3c-009b-4acc-9ca5-e50cb17e412c+6:2347:x1875765413080960:12345-192.168.201.39@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788869451.758758:0:5740:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788869451.758765:0:5740:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff94c805038600/0x3d2d1916761d6d65 lrc: 5/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.39@tcp remote: 0x375c010249035a23 expref: 6 pid: 5786 timeout: 300 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869451.758779:0:5740:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff94c805038600/0x3d2d1916761d6d65 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.39@tcp remote: 0x375c010249035a23 expref: 6 pid: 5786 timeout: 300 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869451.758802:0:5740:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff94c819394300) 00010000:00010000:1.0:1788869451.758808:0:5740:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504ce00/0x3d2d1916761d6da4 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869451.758825:0:5740:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504ce00/0x3d2d1916761d6da4 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869451.758833:0:5740:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504ce00/0x3d2d1916761d6da4 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869451.758854:0:5740:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788869451.758861:0:5755:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94c805038600/0x3d2d1916761d6d65 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.39@tcp remote: 0x375c010249035a23 expref: 6 pid: 5786 timeout: 300 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788869451.758879:0:5755:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94c835a17800 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5755:1875765421467008:192.168.201.39@tcp:104: 00000100:00100000:1.0:1788869451.758910:0:5740:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c83fae8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:10cd6f3c-009b-4acc-9ca5-e50cb17e412c+5:2347:x1875765413080960:12345-192.168.201.39@tcp:103:ldlm_bl.0 Request processed in 166us (435us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869451.758919:0:5740:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 63 00010000:00010000:3.0:1788869451.759079:0:5755:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504ce00/0x3d2d1916761d6da4 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869451.759092:0:5755:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504ce00/0x3d2d1916761d6da4 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869451.759105:0:5755:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504ce00/0x3d2d1916761d6da4 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1788869451.759144:0:5751:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1788869451.759663:0:5755:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504c000/0x3d2d1916761d6dab lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869451.759673:0:5755:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504c000/0x3d2d1916761d6dab lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869451.759682:0:5755:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504c000/0x3d2d1916761d6dab lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788869451.761148:0:5755:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00010000:00010000:3.0:1788869451.761163:0:5755:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504ce00/0x3d2d1916761d6da4 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869451.761172:0:5755:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504ce00/0x3d2d1916761d6da4 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869451.761179:0:5755:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504ce00/0x3d2d1916761d6da4 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869451.761187:0:5755:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94c83504ce00 already unused, calling callback (ffffffffc21124f0) 00010000:00010000:3.0:1788869451.761192:0:5755:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504ce00/0x3d2d1916761d6da4 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869451.761200:0:5755:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504ce00/0x3d2d1916761d6da4 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869451.761214:0:5755:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff94c819394300) 00010000:00010000:3.0:1788869451.761217:0:5755:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788869451.761229:0:5755:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504ce00/0x3d2d1916761d6da4 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869451.761236:0:5755:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504ce00/0x3d2d1916761d6da4 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788869451.761270:0:5755:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000bed3cb33 reply state 00000000bb9f1b9c transno 4294967416 ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504c000/0x3d2d1916761d6dab lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788869451.761280:0:5755:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788869451.761359:0:5755:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c810732300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2125b9b3-626e-4cbe-be83-fb446e976ce2+15:11270:x1875765413080832:12345-192.168.201.39@tcp:36:lfs.0 Request processed in 6931us (7105us total) trans 4294967416 rc 0/0 00000100:00100000:3.0:1788869451.761367:0:5755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 141 00010000:00010000:1.0:1788869451.766126:0:3270:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504c000/0x3d2d1916761d6dab lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869451.766143:0:3270:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504c000/0x3d2d1916761d6dab lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869451.766151:0:3270:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504c000/0x3d2d1916761d6dab lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869451.766158:0:3270:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94c83504c000 already unused, calling callback (ffffffffc21124f0) 00010000:00010000:1.0:1788869451.766163:0:3270:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504c000/0x3d2d1916761d6dab lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869451.766171:0:3270:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504c000/0x3d2d1916761d6dab lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869451.766188:0:3270:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff94c819394600) 00010000:00010000:1.0:1788869451.766192:0:3270:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788869451.766197:0:3270:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504c000/0x3d2d1916761d6dab lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869451.766215:0:3270:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504c000/0x3d2d1916761d6dab lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788869451.826758:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1788869451.826844:0:5756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765413081088 00000100:00100000:3.0:1788869451.826853:0:5756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765413081088 00000100:00100000:3.0:1788869451.826955:0:5756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 142 00000100:00100000:3.0:1788869451.826972:0:5756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c82ccfc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2125b9b3-626e-4cbe-be83-fb446e976ce2+14:11278:x1875765413081088:12345-192.168.201.39@tcp:101:lctl.0 00010000:00010000:3.0:1788869451.826997:0:5756:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788869451.827019:0:5756:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504ce00/0x3d2d1916761d6db2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x375c010249035a38 expref: -99 pid: 5756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869451.827083:0:5756:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504d200/0x3d2d1916761d6db9 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869451.827097:0:5756:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504d200/0x3d2d1916761d6db9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869451.827108:0:5756:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504d200/0x3d2d1916761d6db9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788869451.827167:0:5756:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:3.0:1788869451.827184:0:5756:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 3 stripe count 1 MDT count 1 00000004:00010000:3.0:1788869451.827212:0:5756:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504d200/0x3d2d1916761d6db9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869451.827237:0:5756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504ce00/0x3d2d1916761d6db2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0x375c010249035a38 expref: 16 pid: 5756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869451.827291:0:5756:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504d200/0x3d2d1916761d6db9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0x375c010249035a38 expref: 15 pid: 5756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869451.827301:0:5756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff94c819394300) 00010000:00010000:3.0:1788869451.827304:0:5756:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788869451.827307:0:5756:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94c83504d200, rc 0) 00000100:00100000:3.0:1788869451.827366:0:5756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c82ccfc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2125b9b3-626e-4cbe-be83-fb446e976ce2+15:11278:x1875765413081088:12345-192.168.201.39@tcp:101:lctl.0 Request processed in 396us (616us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869451.827373:0:5756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 142 00000100:00100000:1.0:1788869451.867544:0:3284:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788869451.867567:0:3284:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94c835a3e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3284:1875765421467136:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788869451.867649:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869451.867869:0:3285:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94c835a15880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3285:1875765421467392:0@lo:400:kworker.0 00000100:00100000:3.0:1788869451.867901:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869451.867921:0:3285:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788869451.867926:0:3285:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94c835150380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3285:1875765421467520:0@lo:400:kworker.0 00000100:00100000:3.0:1788869451.867944:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869451.867973:0:5755:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765421467392 00000100:00100000:3.0:1788869451.867980:0:5755:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765421467392 00000100:00100000:3.0:1788869451.868013:0:5755:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765421467520 00000100:00100000:3.0:1788869451.868016:0:5755:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765421467520 00000100:00100000:3.0:1788869451.868039:0:5755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:3.0:1788869451.868047:0:5755:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c835151c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3285:x1875765421467392:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788869451.868098:0:5755:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c835151c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3285:x1875765421467392:12345-0@lo:400:kworker.0 Request processed in 50us (195us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869451.868102:0:6548:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765421467136 00000100:00100000:0.0:1788869451.868109:0:6548:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765421467136 00000100:00100000:3.0:1788869451.868116:0:5755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:3.0:1788869451.868138:0:5755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:3.0:1788869451.868146:0:5755:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c835152d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3285:x1875765421467520:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788869451.868156:0:6548:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1788869451.868167:0:6548:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c82ccfc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3284:x1875765421467136:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788869451.868180:0:5755:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c835152d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3285:x1875765421467520:12345-0@lo:400:kworker.0 Request processed in 34us (233us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869451.868186:0:5755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00002000:00000024:0.0:1788869451.868199:0:6548:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788869451.868222:0:3285:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94c835150380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3285:1875765421467520:0@lo:400:kworker.0 00000100:00100000:3.0:1788869451.868238:0:3285:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94c835a15880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3285:1875765421467392:0@lo:400:kworker.0 00000100:00100000:0.0:1788869451.868247:0:6548:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c82ccfc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3284:x1875765421467136:12345-0@lo:13:osp-pre-1-0.0 Request processed in 80us (595us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869451.868277:0:6548:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1788869451.868302:0:3283:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94c835150000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3283:1875765421467648:0@lo:400:kworker.0 00000100:00080000:3.0:1788869451.868311:0:5751:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788869451.868317:0:5751:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788869451.868347:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869451.868378:0:3283:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1788869451.868386:0:3283:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94c835a17800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:121cd5bc-7f07-4cf7-8e2e-4356c89c0696:3283:1875765421467264:0@lo:400:kworker.0 00000100:00100000:0.0:1788869451.868416:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869451.868450:0:3283:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94c835153480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3283:1875765421467776:0@lo:400:kworker.0 00000100:00100000:1.0:1788869451.868462:0:3284:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967312 gen 2 00000004:00080000:1.0:1788869451.868469:0:3284:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967312 committed transno 4294967312 00000100:00100000:0.0:1788869451.868475:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869451.868493:0:3284:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94c835a3e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3284:1875765421467136:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788869451.868507:0:5755:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765421467776 00000100:00100000:0.0:1788869451.868511:0:5755:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765421467776 00000100:00080000:1.0:1788869451.868535:0:5751:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788869451.868544:0:5755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:0.0:1788869451.868552:0:5755:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c83faea300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3283:x1875765421467776:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788869451.868598:0:5755:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c83faea300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3283:x1875765421467776:12345-0@lo:400:kworker.0 Request processed in 47us (124us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869451.868605:0:5755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:1.0:1788869451.868668:0:3283:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94c835153480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3283:1875765421467776:0@lo:400:kworker.0 00000100:00100000:2.0:1788869451.868733:0:5750:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765421467264 00000100:00100000:2.0:1788869451.868737:0:5750:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765421467264 00000100:00100000:2.0:1788869451.868774:0:5750:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 269 00000100:00100000:2.0:1788869451.868781:0:5750:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c81f148c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:121cd5bc-7f07-4cf7-8e2e-4356c89c0696+19:3283:x1875765421467264:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788869451.868823:0:5750:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c81f148c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:121cd5bc-7f07-4cf7-8e2e-4356c89c0696+19:3283:x1875765421467264:12345-0@lo:400:kworker.0 Request processed in 44us (407us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869451.868830:0:5750:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 269 00000100:00100000:0.0:1788869451.868876:0:3283:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94c835a17800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:121cd5bc-7f07-4cf7-8e2e-4356c89c0696:3283:1875765421467264:0@lo:400:kworker.0 00000100:00100000:3.0:1788869451.869097:0:6546:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765421467648 00000100:00100000:3.0:1788869451.869101:0:6546:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765421467648 00000100:00100000:2.0:1788869451.869213:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1788869451.869313:0:6546:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1788869451.869321:0:6546:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c83fae8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3283:x1875765421467648:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788869451.869358:0:6546:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c83fae8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3283:x1875765421467648:12345-0@lo:400:kworker.0 Request processed in 39us (1012us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869451.869364:0:6546:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1788869451.869406:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765413081216 00000100:00100000:0.0:1788869451.869419:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765413081216 00000100:00100000:2.0:1788869451.869596:0:5757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 143 00000100:00100000:2.0:1788869451.869607:0:5757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c835a3ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2125b9b3-626e-4cbe-be83-fb446e976ce2+15:11284:x1875765413081216:12345-192.168.201.39@tcp:101:bash.0 00010000:00010000:2.0:1788869451.869621:0:5757:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1788869451.869627:0:3283:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94c835150000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3283:1875765421467648:0@lo:400:kworker.0 00010000:00010000:2.0:1788869451.869641:0:5757:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94c805039800/0x3d2d1916761d6dc0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x375c010249035a3f expref: -99 pid: 5757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869451.869714:0:5757:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff94c805039400/0x3d2d1916761d6dc7 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869451.869729:0:5757:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94c805039400/0x3d2d1916761d6dc7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869451.869748:0:5757:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94c805039400/0x3d2d1916761d6dc7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869451.869765:0:5757:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94c805039200/0x3d2d1916761d6dce lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869451.869772:0:5757:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94c805039200/0x3d2d1916761d6dce lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869451.869778:0:5757:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94c805039200/0x3d2d1916761d6dce lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869451.869886:0:5757:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94c805039600/0x3d2d1916761d6dd5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869451.869894:0:5757:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94c805039600/0x3d2d1916761d6dd5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869451.869900:0:5757:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94c805039600/0x3d2d1916761d6dd5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5757 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788869451.869928:0:5757:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00000004:00200000:2.0:1788869451.869931:0:5757:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1788869451.869949:0:5757:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff94c805039600/0x3d2d1916761d6dd5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869451.869961:0:5757:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff94c805039400/0x3d2d1916761d6dc7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869451.869967:0:5757:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94c805039400/0x3d2d1916761d6dc7 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869451.869984:0:5757:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94c805039400/0x3d2d1916761d6dc7 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869451.869989:0:5757:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94c805039400 already unused, calling callback (ffffffffc21124f0) 00010000:00010000:2.0:1788869451.869994:0:5757:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94c805039400/0x3d2d1916761d6dc7 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869451.870001:0:5757:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94c805039400/0x3d2d1916761d6dc7 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869451.870013:0:5757:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff94c819394300) 00010000:00010000:2.0:1788869451.870016:0:5757:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788869451.870020:0:5757:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94c805039400/0x3d2d1916761d6dc7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869451.870026:0:5757:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94c805039400/0x3d2d1916761d6dc7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869451.870038:0:5757:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94c805039200/0x3d2d1916761d6dce lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869451.870044:0:5757:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94c805039200/0x3d2d1916761d6dce lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869451.870049:0:5757:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94c805039200/0x3d2d1916761d6dce lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869451.870054:0:5757:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94c805039200 already unused, calling callback (ffffffffc21124f0) 00010000:00010000:2.0:1788869451.870057:0:5757:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94c805039200/0x3d2d1916761d6dce lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869451.870074:0:5757:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94c805039200/0x3d2d1916761d6dce lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869451.870083:0:5757:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff94c802f3fa00) 00010000:00010000:2.0:1788869451.870085:0:5757:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788869451.870088:0:5757:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94c805039200/0x3d2d1916761d6dce lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869451.870094:0:5757:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94c805039200/0x3d2d1916761d6dce lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869451.870122:0:5757:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94c805039800/0x3d2d1916761d6dc0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0x375c010249035a3f expref: 17 pid: 5757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869451.870136:0:5757:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94c805039600/0x3d2d1916761d6dd5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0x375c010249035a3f expref: 16 pid: 5757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869451.870143:0:5757:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff94c802f3fd00) 00010000:00010000:2.0:1788869451.870146:0:5757:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1788869451.870148:0:5757:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94c805039600, rc 0) 00000100:00100000:2.0:1788869451.870204:0:5757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c835a3ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2125b9b3-626e-4cbe-be83-fb446e976ce2+16:11284:x1875765413081216:12345-192.168.201.39@tcp:101:bash.0 Request processed in 599us (990us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869451.870211:0:5757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 143 00000100:00080000:1.0:1788869451.870599:0:5751:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788869451.874962:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1788869451.875019:0:5755:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765413081472 00000100:00100000:3.0:1788869451.875029:0:5755:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765413081472 00000100:00100000:3.0:1788869451.875083:0:5755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 144 00000100:00100000:3.0:1788869451.875093:0:5755:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c83faebb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2125b9b3-626e-4cbe-be83-fb446e976ce2+16:11284:x1875765413081472:12345-192.168.201.39@tcp:101:bash.0 00010000:00010000:3.0:1788869451.875113:0:5755:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788869451.875132:0:5755:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504ce00/0x3d2d1916761d6ddc lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x375c010249035a46 expref: -99 pid: 5755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869451.875293:0:5755:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504c200/0x3d2d1916761d6de3 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869451.875304:0:5755:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504c200/0x3d2d1916761d6de3 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869451.875312:0:5755:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504c200/0x3d2d1916761d6de3 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869451.875321:0:5755:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504c400/0x3d2d1916761d6dea lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869451.875325:0:5755:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504c400/0x3d2d1916761d6dea lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869451.875329:0:5755:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504c400/0x3d2d1916761d6dea lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1788869451.875731:0:5755:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x4:0x0], index 0: 0 00010000:00010000:3.0:1788869451.875848:0:5755:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504d800/0x3d2d1916761d6df1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869451.875857:0:5755:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504d800/0x3d2d1916761d6df1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869451.875864:0:5755:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504d800/0x3d2d1916761d6df1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869451.875895:0:5755:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504c200/0x3d2d1916761d6de3 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869451.875910:0:5755:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504c200/0x3d2d1916761d6de3 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869451.875914:0:5755:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504c200/0x3d2d1916761d6de3 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869451.875918:0:5755:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94c83504c200 already unused, calling callback (ffffffffc21124f0) 00010000:00010000:3.0:1788869451.875921:0:5755:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504c200/0x3d2d1916761d6de3 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869451.875926:0:5755:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504c200/0x3d2d1916761d6de3 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869451.875934:0:5755:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff94c802f3fd00) 00010000:00010000:3.0:1788869451.875936:0:5755:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788869451.875939:0:5755:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504c200/0x3d2d1916761d6de3 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869451.875943:0:5755:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504c200/0x3d2d1916761d6de3 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788869451.875951:0:5755:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000a839e75c reply state 00000000aa05edf6 transno 4294967417 ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504c400/0x3d2d1916761d6dea lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788869451.875957:0:5755:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1788869451.875978:0:5755:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504ce00/0x3d2d1916761d6ddc lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0x375c010249035a46 expref: 19 pid: 5755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869451.875986:0:5755:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504d800/0x3d2d1916761d6df1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0x375c010249035a46 expref: 18 pid: 5755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869451.875998:0:5755:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff94c819394a00) 00010000:00010000:3.0:1788869451.876000:0:5755:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788869451.876002:0:5755:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94c83504d800, rc 0) 00000100:00100000:3.0:1788869451.876051:0:5755:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c83faebb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2125b9b3-626e-4cbe-be83-fb446e976ce2+19:11284:x1875765413081472:12345-192.168.201.39@tcp:101:bash.0 Request processed in 961us (1101us total) trans 4294967417 rc 0/0 00000100:00100000:3.0:1788869451.876057:0:5755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 144 00010000:00010000:2.0:1788869451.877471:0:3269:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504c400/0x3d2d1916761d6dea lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869451.877484:0:3269:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504c400/0x3d2d1916761d6dea lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869451.877501:0:3269:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504c400/0x3d2d1916761d6dea lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869451.877507:0:3269:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94c83504c400 already unused, calling callback (ffffffffc21124f0) 00010000:00010000:2.0:1788869451.877511:0:3269:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504c400/0x3d2d1916761d6dea lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869451.877518:0:3269:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504c400/0x3d2d1916761d6dea lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869451.877530:0:3269:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff94c819394800) 00010000:00010000:2.0:1788869451.877533:0:3269:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788869451.877536:0:3269:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504c400/0x3d2d1916761d6dea lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869451.877540:0:3269:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504c400/0x3d2d1916761d6dea lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788869451.878690:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1788869451.878742:0:11822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765413081600 00000100:00100000:3.0:1788869451.878752:0:11822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765413081600 00000100:00100000:3.0:1788869451.878860:0:11822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 47 00000100:00100000:3.0:1788869451.878869:0:11822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c83faeb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:2125b9b3-626e-4cbe-be83-fb446e976ce2+5:2347:x1875765413081600:12345-192.168.201.39@tcp:101:bash.0 00010000:00010000:3.0:1788869451.878885:0:11822:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788869451.878901:0:11822:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fb48b48d/0x3d2d1916761d6dff lrc: 2/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x375c010249035a4d expref: -99 pid: 11822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788869451.878924:0:11822:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788869451.878940:0:11822:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=200s v=(0 0) 00010000:00010000:3.0:1788869451.878944:0:11822:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788869451.878953:0:11822:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fb48b48d/0x3d2d1916761d6dff lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.39@tcp remote: 0x375c010249035a4d expref: 6 pid: 11822 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869451.878968:0:11822:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000fb48b48d/0x3d2d1916761d6dff lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.39@tcp remote: 0x375c010249035a4d expref: 6 pid: 11822 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869451.878979:0:11822:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94c83504c000, rc 0) 00000100:00100000:3.0:1788869451.879032:0:11822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c83faeb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:2125b9b3-626e-4cbe-be83-fb446e976ce2+6:2347:x1875765413081600:12345-192.168.201.39@tcp:101:bash.0 Request processed in 164us (348us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869451.879048:0:11822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 47 00000100:00080000:1.0:1788869451.879117:0:5751:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788869451.882679:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1788869451.882869:0:6544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765413081728 00000100:00100000:0.0:1788869451.882879:0:6544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765413081728 00000100:00100000:0.0:1788869451.882973:0:6544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 48 00000100:00100000:0.0:1788869451.882984:0:6544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c835150380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2125b9b3-626e-4cbe-be83-fb446e976ce2+6:11284:x1875765413081728:12345-192.168.201.39@tcp:101:bash.0 00010000:00010000:0.0:1788869451.883002:0:6544:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788869451.883021:0:6544:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000546e452a/0x3d2d1916761d6e06 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x375c010249035a54 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869451.883053:0:6544:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000fb48b48d/0x3d2d1916761d6dff lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.39@tcp remote: 0x375c010249035a4d expref: 7 pid: 11822 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869451.883072:0:6544:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788869451.883077:0:6544:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788869451.883083:0:6544:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000546e452a/0x3d2d1916761d6e06 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.201.39@tcp remote: 0x375c010249035a54 expref: 7 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869451.883118:0:6544:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000fb48b48d/0x3d2d1916761d6dff lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.39@tcp remote: 0x375c010249035a4d expref: 7 pid: 11822 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869451.883132:0:6544:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000fb48b48d/0x3d2d1916761d6dff lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.39@tcp remote: 0x375c010249035a4d expref: 7 pid: 11822 timeout: 300 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788869451.883148:0:6544:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94c83fae9180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6544:1875765421467904:192.168.201.39@tcp:104: 00000100:00100000:0.0:1788869451.883291:0:6544:0:(client.c:2702:ptlrpc_set_wait()) set ffff94c8033c4d80 going to sleep for 11 seconds 00000100:00100000:2.0:1788869451.886653:0:6544:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94c83fae9180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6544:1875765421467904:192.168.201.39@tcp:104: 00000100:00100000:0.0:1788869451.886682:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00010000:00010000:2.0:1788869451.886686:0:6544:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000546e452a/0x3d2d1916761d6e06 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.39@tcp remote: 0x375c010249035a54 expref: 7 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869451.886769:0:6544:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94c81a583000, rc 0) 00000100:00100000:1.0:1788869451.886804:0:7448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765413081856 00000100:00100000:1.0:1788869451.886811:0:7448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765413081856 00000100:00100000:2.0:1788869451.886827:0:6544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c835150380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2125b9b3-626e-4cbe-be83-fb446e976ce2+8:11284:x1875765413081728:12345-192.168.201.39@tcp:101:bash.0 Request processed in 3846us (4156us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869451.886835:0:6544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 48 00010000:00010000:1.0:1788869451.886850:0:7448:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000fb48b48d/0x3d2d1916761d6dff lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.39@tcp remote: 0x375c010249035a4d expref: 8 pid: 11822 timeout: 300 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788869451.886917:0:7448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 64 00000100:00100000:1.0:1788869451.886928:0:7448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c83fae9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:2125b9b3-626e-4cbe-be83-fb446e976ce2+7:2348:x1875765413081856:12345-192.168.201.39@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788869451.886942:0:7448:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788869451.886972:0:7448:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000fb48b48d/0x3d2d1916761d6dff lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.39@tcp remote: 0x375c010249035a4d expref: 7 pid: 11822 timeout: 300 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869451.887002:0:7448:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000fb48b48d/0x3d2d1916761d6dff lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.39@tcp remote: 0x375c010249035a4d expref: 7 pid: 11822 timeout: 300 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869451.887024:0:7448:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fb48b48d/0x3d2d1916761d6dff lrc: 0/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.39@tcp remote: 0x375c010249035a4d expref: 7 pid: 11822 timeout: 300 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869451.887037:0:7448:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788869451.887041:0:7448:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788869451.887049:0:7448:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000546e452a/0x3d2d1916761d6e06 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.39@tcp remote: 0x375c010249035a54 expref: 6 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869451.887060:0:7448:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000546e452a/0x3d2d1916761d6e06 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.39@tcp remote: 0x375c010249035a54 expref: 6 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869451.887090:0:7448:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000546e452a/0x3d2d1916761d6e06 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.39@tcp remote: 0x375c010249035a54 expref: 6 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788869451.887105:0:7448:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94c82ccfe300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:7448:1875765421468032:192.168.201.39@tcp:105: 00000100:00100000:1.0:1788869451.887166:0:7448:0:(client.c:2702:ptlrpc_set_wait()) set ffff94c810e32d80 going to sleep for 11 seconds 00000100:00100000:1.0:1788869451.889495:0:7448:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94c82ccfe300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:7448:1875765421468032:192.168.201.39@tcp:105: 00010000:00010000:1.0:1788869451.889514:0:7448:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788869451.889556:0:7448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c83fae9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:2125b9b3-626e-4cbe-be83-fb446e976ce2+6:2348:x1875765413081856:12345-192.168.201.39@tcp:103:ldlm_bl.0 Request processed in 2632us (2874us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869451.889564:0:7448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 64 00000100:00100000:2.0:1788869451.892369:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1788869451.892634:0:11820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765413082112 00000100:00100000:0.0:1788869451.892644:0:11820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765413082112 00000100:00100000:0.0:1788869451.892700:0:11820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 36 00000100:00100000:0.0:1788869451.892710:0:11820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c835a3ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:2125b9b3-626e-4cbe-be83-fb446e976ce2+18:11284:x1875765413082112:12345-192.168.201.39@tcp:35:bash.0 00000100:00100000:0.0:1788869451.893012:0:11820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c835a3ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:2125b9b3-626e-4cbe-be83-fb446e976ce2+19:11284:x1875765413082112:12345-192.168.201.39@tcp:35:bash.0 Request processed in 303us (649us total) trans 4294967418 rc 0/0 00000100:00100000:0.0:1788869451.893020:0:11820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 36 00000100:00100000:3.0:1788869451.953071:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1788869451.953183:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765413082368 00000100:00100000:0.0:1788869451.953192:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765413082368 00000100:00100000:0.0:1788869451.953244:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 145 00000100:00100000:0.0:1788869451.953282:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c835151500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2125b9b3-626e-4cbe-be83-fb446e976ce2+19:11294:x1875765413082368:12345-192.168.201.39@tcp:101:lfs.0 00010000:00010000:0.0:1788869451.953302:0:5786:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788869451.953318:0:5786:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94c81a582200/0x3d2d1916761d6e0d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x375c010249035a5b expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788869451.953408:0:5786:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00010000:00010000:0.0:1788869451.953505:0:5786:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94c81a582200/0x3d2d1916761d6e0d lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0x375c010249035a5b expref: 21 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869451.953516:0:5786:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff94c819394300) 00010000:00010000:0.0:1788869451.953517:0:5786:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788869451.953521:0:5786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94c81a582200/0x3d2d1916761d6e0d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.39@tcp remote: 0x375c010249035a5b expref: 21 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869451.953531:0:5786:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94c81a582200, rc 0) 00000100:00100000:0.0:1788869451.953600:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c835151500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2125b9b3-626e-4cbe-be83-fb446e976ce2+20:11294:x1875765413082368:12345-192.168.201.39@tcp:101:lfs.0 Request processed in 319us (540us total) trans 4294967419 rc 301/301 00000100:00100000:0.0:1788869451.953611:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 145 00000100:00100000:2.0:1788869451.955912:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1788869451.956104:0:5758:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765413082624 00000100:00100000:0.0:1788869451.956113:0:5758:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765413082624 00000100:00100000:0.0:1788869451.956162:0:5758:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 37 00000100:00100000:0.0:1788869451.956171:0:5758:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c835a3f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2125b9b3-626e-4cbe-be83-fb446e976ce2+20:11294:x1875765413082624:12345-192.168.201.39@tcp:35:lfs.0 00000100:00100000:0.0:1788869451.956411:0:5758:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c835a3f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2125b9b3-626e-4cbe-be83-fb446e976ce2+21:11294:x1875765413082624:12345-192.168.201.39@tcp:35:lfs.0 Request processed in 240us (504us total) trans 4294967420 rc 0/0 00000100:00100000:0.0:1788869451.956427:0:5758:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 37 00000100:00100000:1.0:1788869452.015518:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1788869452.016982:0:5756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765413082752 00000100:00100000:0.0:1788869452.016995:0:5756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765413082752 00000100:00100000:2.0:1788869452.017210:0:5756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 146 00000100:00100000:2.0:1788869452.017222:0:5756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c82ccfe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2125b9b3-626e-4cbe-be83-fb446e976ce2+21:11300:x1875765413082752:12345-192.168.201.39@tcp:101:lfs.0 00010000:00010000:2.0:1788869452.017246:0:5756:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788869452.017286:0:5756:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94c805038000/0x3d2d1916761d6e1b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x375c010249035a62 expref: -99 pid: 5756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869452.017351:0:5756:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94c805039400/0x3d2d1916761d6e22 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869452.017365:0:5756:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94c805039400/0x3d2d1916761d6e22 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869452.017377:0:5756:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94c805039400/0x3d2d1916761d6e22 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788869452.017445:0:5756:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00000004:00200000:2.0:1788869452.017449:0:5756:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:2.0:1788869452.017470:0:5756:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff94c805039400/0x3d2d1916761d6e22 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869452.017495:0:5756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94c805038000/0x3d2d1916761d6e1b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0x375c010249035a62 expref: 23 pid: 5756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869452.017515:0:5756:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94c805039400/0x3d2d1916761d6e22 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0x375c010249035a62 expref: 22 pid: 5756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869452.017523:0:5756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff94c802f3fd00) 00010000:00010000:2.0:1788869452.017526:0:5756:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788869452.017529:0:5756:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94c805039400, rc 0) 00000100:00100000:2.0:1788869452.017758:0:5756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c82ccfe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2125b9b3-626e-4cbe-be83-fb446e976ce2+22:11300:x1875765413082752:12345-192.168.201.39@tcp:101:lfs.0 Request processed in 537us (2249us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869452.017777:0:5756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 146 00000100:00080000:1.0:1788869452.019626:0:5751:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788869452.023735:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1788869452.023837:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765413083008 00000100:00100000:0.0:1788869452.023846:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765413083008 00000100:00100000:0.0:1788869452.023927:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 147 00000100:00100000:0.0:1788869452.023936:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c82ccfd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2125b9b3-626e-4cbe-be83-fb446e976ce2+22:11300:x1875765413083008:12345-192.168.201.39@tcp:101:lfs.0 00010000:00010000:0.0:1788869452.023964:0:5786:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788869452.023983:0:5786:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94c81a583400/0x3d2d1916761d6e29 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x375c010249035a69 expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869452.024082:0:5786:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94c81a582a00/0x3d2d1916761d6e30 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869452.024096:0:5786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94c81a582a00/0x3d2d1916761d6e30 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869452.024107:0:5786:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94c81a582a00/0x3d2d1916761d6e30 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788869452.024137:0:5786:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:0.0:1788869452.024346:0:5786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94c81a583400/0x3d2d1916761d6e29 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0x375c010249035a69 expref: 25 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869452.024363:0:5786:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94c81a582a00/0x3d2d1916761d6e30 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0x375c010249035a69 expref: 24 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869452.024371:0:5786:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff94c819394a00) 00010000:00010000:0.0:1788869452.024374:0:5786:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788869452.024377:0:5786:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94c81a582a00, rc 0) 00000100:00100000:0.0:1788869452.024531:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c82ccfd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2125b9b3-626e-4cbe-be83-fb446e976ce2+24:11300:x1875765413083008:12345-192.168.201.39@tcp:101:lfs.0 Request processed in 595us (854us total) trans 4294967421 rc 0/0 00000100:00100000:0.0:1788869452.024538:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 147 00000100:00100000:0.0:1788869452.029064:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1788869452.029146:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1788869452.029159:0:5739:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765413083136 00000100:00100000:3.0:1788869452.029168:0:5739:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765413083136 00000100:00100000:1.0:1788869452.029216:0:5755:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765413083392 00000100:00100000:1.0:1788869452.029220:0:5755:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765413083392 00000100:00100000:3.0:1788869452.029238:0:5739:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 9 00000100:00100000:3.0:1788869452.029264:0:5739:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c82cdab800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2125b9b3-626e-4cbe-be83-fb446e976ce2+25:2346:x1875765413083136:12345-192.168.201.39@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1788869452.029271:0:5755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 148 00000100:00100000:1.0:1788869452.029277:0:5755:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c82cda8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2125b9b3-626e-4cbe-be83-fb446e976ce2+25:11300:x1875765413083392:12345-192.168.201.39@tcp:101:lfs.0 00010000:00010000:3.0:1788869452.029280:0:5739:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788869452.029295:0:5755:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788869452.029303:0:5739:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94c81a582a00/0x3d2d1916761d6e30 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.39@tcp remote: 0x375c010249035a69 expref: 25 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869452.029309:0:5755:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94c83fde7200/0x3d2d1916761d6e3e lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x375c010249035a70 expref: -99 pid: 5755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869452.029320:0:5739:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff94c819394a00) 00010000:00010000:3.0:1788869452.029324:0:5739:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788869452.029369:0:5739:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c82cdab800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2125b9b3-626e-4cbe-be83-fb446e976ce2+25:2346:x1875765413083136:12345-192.168.201.39@tcp:103:ldlm_bl.0 Request processed in 123us (312us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869452.029376:0:5739:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 9 00010000:00010000:1.0:1788869452.029389:0:5755:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94c83fde6c00/0x3d2d1916761d6e45 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869452.029401:0:5755:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94c83fde6c00/0x3d2d1916761d6e45 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869452.029411:0:5755:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94c83fde6c00/0x3d2d1916761d6e45 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788869452.029423:0:5755:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:1.0:1788869452.029536:0:5755:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94c83fde7200/0x3d2d1916761d6e3e lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0x375c010249035a70 expref: 26 pid: 5755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869452.029550:0:5755:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94c83fde6c00/0x3d2d1916761d6e45 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0x375c010249035a70 expref: 25 pid: 5755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869452.029557:0:5755:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff94c819394a00) 00010000:00010000:1.0:1788869452.029560:0:5755:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1788869452.029587:0:5755:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94c83fde6c00, rc 0) 00000100:00100000:1.0:1788869452.029619:0:5755:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c82cda8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2125b9b3-626e-4cbe-be83-fb446e976ce2+25:11300:x1875765413083392:12345-192.168.201.39@tcp:101:lfs.0 Request processed in 342us (473us total) trans 4294967422 rc 0/0 00000100:00100000:1.0:1788869452.029626:0:5755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 148 00000100:00100000:0.0:1788869452.035354:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1788869452.035501:0:6547:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765413083520 00000100:00100000:2.0:1788869452.035512:0:6547:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765413083520 00000100:00100000:2.0:1788869452.035587:0:6547:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 49 00000100:00100000:2.0:1788869452.035598:0:6547:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c82cda9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2125b9b3-626e-4cbe-be83-fb446e976ce2+6:2348:x1875765413083520:12345-192.168.201.39@tcp:1:lfs.0 00010000:00010000:2.0:1788869452.035642:0:6547:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001638e2b2/0x3d2d1916761d6e53 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869452.035662:0:6547:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000546e452a/0x3d2d1916761d6e06 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.39@tcp remote: 0x375c010249035a54 expref: 6 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869452.035672:0:6547:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788869452.035677:0:6547:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788869452.035682:0:6547:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001638e2b2/0x3d2d1916761d6e53 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869452.035717:0:6547:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000546e452a/0x3d2d1916761d6e06 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.201.39@tcp remote: 0x375c010249035a54 expref: 6 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869452.035732:0:6547:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000546e452a/0x3d2d1916761d6e06 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.201.39@tcp remote: 0x375c010249035a54 expref: 6 pid: 6544 timeout: 300 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788869452.035747:0:6547:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94c835a3e300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6547:1875765421468160:192.168.201.39@tcp:104: 00000100:00100000:2.0:1788869452.035845:0:6547:0:(client.c:2702:ptlrpc_set_wait()) set ffff94c805068b40 going to sleep for 11 seconds 00000100:00100000:2.0:1788869452.037480:0:6547:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94c835a3e300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6547:1875765421468160:192.168.201.39@tcp:104: 00010000:00010000:2.0:1788869452.037523:0:6547:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000001638e2b2/0x3d2d1916761d6e53 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788869452.038490:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1788869452.038556:0:11821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765413083648 00000100:00100000:1.0:1788869452.038562:0:11821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765413083648 00002000:00100000:1.0:1788869452.038618:0:11821:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x4:0x0] (0->12) req@ffff94c83513f480 x1875765413083648/t0(0) o4->2125b9b3-626e-4cbe-be83-fb446e976ce2@192.168.201.39@tcp:398/0 lens 504/0 e 0 to 0 dl 1788869463 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788869452.038628:0:11821:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff94c83513f480 with x1875765413083648 ext(0->12) 00010000:00010000:1.0:1788869452.038636:0:11821:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000546e452a/0x3d2d1916761d6e06 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.39@tcp remote: 0x375c010249035a54 expref: 7 pid: 6544 timeout: 300 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869452.038651:0:11821:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000546e452a/0x3d2d1916761d6e06 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.39@tcp remote: 0x375c010249035a54 expref: 7 pid: 6544 timeout: 300 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788869452.038659:0:11821:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff94c83513f480 00000100:00100000:1.0:1788869452.038736:0:11821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 2 00000100:00100000:1.0:1788869452.038745:0:11821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c83513f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:2125b9b3-626e-4cbe-be83-fb446e976ce2+7:2347:x1875765413083648:12345-192.168.201.39@tcp:4:lfs.0 00000100:00100000:1.0:1788869452.039226:0:11821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c83513f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:2125b9b3-626e-4cbe-be83-fb446e976ce2+9:2347:x1875765413083648:12345-192.168.201.39@tcp:4:lfs.0 Request processed in 481us (737us total) trans 4294967305 rc 0/0 00000100:00100000:1.0:1788869452.039234:0:11821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 2 00002000:00100000:1.0:1788869452.039241:0:11821:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x4:0x0] (0->12) req@ffff94c83513f480 x1875765413083648/t4294967305(0) o4->2125b9b3-626e-4cbe-be83-fb446e976ce2@192.168.201.39@tcp:398/0 lens 504/448 e 0 to 0 dl 1788869463 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788869452.039276:0:11821:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff94c83513f480 with x1875765413083648 ext(0->12) 00010000:00010000:1.0:1788869452.039283:0:11821:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000546e452a/0x3d2d1916761d6e06 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.39@tcp remote: 0x375c010249035a54 expref: 9 pid: 6544 timeout: 300 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869452.039300:0:11821:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000546e452a/0x3d2d1916761d6e06 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.39@tcp remote: 0x375c010249035a54 expref: 9 pid: 6544 timeout: 300 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788869452.039308:0:11821:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff94c83513f480 00000100:00100000:3.0:1788869452.046062:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1788869452.046858:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765413083776 00000100:00100000:0.0:1788869452.046868:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765413083776 00010000:00010000:0.0:1788869452.046913:0:5788:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000546e452a/0x3d2d1916761d6e06 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.39@tcp remote: 0x375c010249035a54 expref: 9 pid: 6544 timeout: 300 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788869452.047116:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 65 00000100:00100000:0.0:1788869452.047126:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c835153100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2125b9b3-626e-4cbe-be83-fb446e976ce2+9:2345:x1875765413083776:12345-192.168.201.39@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788869452.047142:0:5788:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:0.0:1788869452.047161:0:5788:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:0.0:1788869452.047176:0:5788:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb mtime from disk: 0 -> 1788869450 00002000:00010000:0.0:1788869452.047179:0:5788:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb atime from disk: 0 -> 1788869450 00002000:00010000:0.0:1788869452.047181:0:5788:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb ctime from disk: 0 -> 1788869450 00010000:00010000:0.0:1788869452.047188:0:5788:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000546e452a/0x3d2d1916761d6e06 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.39@tcp remote: 0x375c010249035a54 expref: 9 pid: 6544 timeout: 300 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869452.047202:0:5788:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000546e452a/0x3d2d1916761d6e06 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.201.39@tcp remote: 0x375c010249035a54 expref: 9 pid: 6544 timeout: 300 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869452.047225:0:5788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000546e452a/0x3d2d1916761d6e06 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.201.39@tcp remote: 0x375c010249035a54 expref: 9 pid: 6544 timeout: 300 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869452.047242:0:5788:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788869452.047246:0:5788:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788869452.047301:0:5788:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000001638e2b2/0x3d2d1916761d6e53 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869452.047313:0:5788:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001638e2b2/0x3d2d1916761d6e53 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869452.047459:0:5788:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788869452.047518:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c835153100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2125b9b3-626e-4cbe-be83-fb446e976ce2+8:2345:x1875765413083776:12345-192.168.201.39@tcp:103:ldlm_bl.0 Request processed in 391us (1465us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869452.047527:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 65 00010000:00010000:2.0:1788869452.047584:0:6547:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000001638e2b2/0x3d2d1916761d6e53 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869452.047595:0:6547:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001638e2b2/0x3d2d1916761d6e53 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869452.047619:0:6547:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001638e2b2/0x3d2d1916761d6e53 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869452.047627:0:6547:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001638e2b2/0x3d2d1916761d6e53 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869452.047634:0:6547:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001638e2b2/0x3d2d1916761d6e53 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869452.047641:0:6547:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94c805038000 already unused, calling callback (ffffffffc1703220) 00010000:00010000:2.0:1788869452.047645:0:6547:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001638e2b2/0x3d2d1916761d6e53 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869452.047653:0:6547:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001638e2b2/0x3d2d1916761d6e53 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869452.047665:0:6547:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001638e2b2/0x3d2d1916761d6e53 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869452.047679:0:6547:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001638e2b2/0x3d2d1916761d6e53 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788869452.047736:0:6547:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c82cda9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2125b9b3-626e-4cbe-be83-fb446e976ce2+7:2348:x1875765413083520:12345-192.168.201.39@tcp:1:lfs.0 Request processed in 12140us (12392us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869452.047745:0:6547:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 49 00000100:00100000:2.0:1788869452.054312:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1788869452.054468:0:11820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765413084032 00000100:00100000:0.0:1788869452.054479:0:11820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765413084032 00000100:00100000:0.0:1788869452.054544:0:11820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 38 00000100:00100000:0.0:1788869452.054554:0:11820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c818769850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:2125b9b3-626e-4cbe-be83-fb446e976ce2+25:11300:x1875765413084032:12345-192.168.201.39@tcp:35:lfs.0 00000004:00010000:0.0:1788869452.054631:0:11820:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0xb:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff94c83fde6c00/0x3d2d1916761d6e45 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0x375c010249035a70 expref: 25 pid: 5755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788869452.054921:0:11820:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967423 00000001:00080000:0.0:1788869452.054955:0:11820:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967424 00000001:00080000:1.0:1788869452.056934:0:11820:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967425 00010000:00010000:1.0:1788869452.057019:0:11820:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94c83fde7200/0x3d2d1916761d6e5a lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869452.057038:0:11820:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504d800/0x3d2d1916761d6df1 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0x375c010249035a46 expref: 29 pid: 5755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869452.057047:0:11820:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff94c83fde7200/0x3d2d1916761d6e5a lrc: 4/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869452.057094:0:11820:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504d800/0x3d2d1916761d6df1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.39@tcp remote: 0x375c010249035a46 expref: 29 pid: 5755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869452.057107:0:11820:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504d800/0x3d2d1916761d6df1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.39@tcp remote: 0x375c010249035a46 expref: 29 pid: 5755 timeout: 300 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788869452.057121:0:11820:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94c82ccfed80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000_UUID:11820:1875765421468288:192.168.201.39@tcp:104: 00000100:00100000:1.0:1788869452.057212:0:11820:0:(client.c:2702:ptlrpc_set_wait()) set ffff94c810e32300 going to sleep for 11 seconds 00000100:00100000:0.0:1788869452.068103:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1788869452.068206:0:7448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765413084160 00000100:00100000:2.0:1788869452.068216:0:7448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765413084160 00010000:00010000:2.0:1788869452.068283:0:7448:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504d800/0x3d2d1916761d6df1 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.39@tcp remote: 0x375c010249035a46 expref: 30 pid: 5755 timeout: 300 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788869452.068324:0:7448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 66 00000100:00100000:2.0:1788869452.068333:0:7448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c810ef0450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:2125b9b3-626e-4cbe-be83-fb446e976ce2+30:2348:x1875765413084160:12345-192.168.201.39@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788869452.068348:0:7448:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788869452.068355:0:7448:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504d800/0x3d2d1916761d6df1 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.39@tcp remote: 0x375c010249035a46 expref: 30 pid: 5755 timeout: 300 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869452.068368:0:7448:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504d800/0x3d2d1916761d6df1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.39@tcp remote: 0x375c010249035a46 expref: 30 pid: 5755 timeout: 300 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869452.068390:0:7448:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff94c819394a00) 00010000:00010000:2.0:1788869452.068396:0:7448:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff94c83fde7200/0x3d2d1916761d6e5a lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869452.068406:0:7448:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff94c83fde7200/0x3d2d1916761d6e5a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 11820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869452.068427:0:7448:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94c83fde7200/0x3d2d1916761d6e5a lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 11820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869452.068446:0:7448:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788869452.068503:0:7448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c810ef0450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:2125b9b3-626e-4cbe-be83-fb446e976ce2+30:2348:x1875765413084160:12345-192.168.201.39@tcp:103:ldlm_bl.0 Request processed in 170us (412us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869452.068510:0:7448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 66 00010000:00010000:1.0:1788869452.068812:0:11820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504d800/0x3d2d1916761d6df1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.39@tcp remote: 0x375c010249035a46 expref: 29 pid: 5755 timeout: 300 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788869452.068828:0:11820:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94c82ccfed80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000_UUID:11820:1875765421468288:192.168.201.39@tcp:104: 00010000:00010000:1.0:1788869452.068849:0:11820:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff94c83fde7200/0x3d2d1916761d6e5a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869452.068857:0:11820:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff94c83fde7200/0x3d2d1916761d6e5a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869452.068863:0:11820:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94c83fde7200/0x3d2d1916761d6e5a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11820 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788869452.068987:0:11820:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967426 00000001:00080000:1.0:1788869452.069170:0:11820:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967427 00000100:00100000:1.0:1788869452.069423:0:11820:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94c82ccfed80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000-mdtlov_UUID:11820:1875765421468416:0@lo:1000:mdt_rdpg00_002.0 00000100:00100000:1.0:1788869452.069463:0:11820:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869452.069529:0:11820:0:(client.c:2702:ptlrpc_set_wait()) set ffff94c810e32600 going to sleep for 11 seconds 00000100:00100000:0.0:1788869452.069674:0:5760:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765421468416 00000100:00100000:0.0:1788869452.069680:0:5760:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765421468416 00000100:00100000:0.0:1788869452.069758:0:5760:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788869452.069768:0:5760:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c82ccfd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:11820:x1875765421468416:12345-0@lo:1000:mdt_rdpg00_002.0 00000100:00100000:0.0:1788869452.069874:0:5760:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c82ccfd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:11820:x1875765421468416:12345-0@lo:1000:mdt_rdpg00_002.0 Request processed in 108us (409us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869452.069881:0:5760:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788869452.069951:0:11820:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94c82ccfed80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000-mdtlov_UUID:11820:1875765421468416:0@lo:1000:mdt_rdpg00_002.0 00000001:00080000:1.0:1788869452.070388:0:11820:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967428 00000100:00100000:1.0:1788869452.070439:0:11820:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94c82ccfed80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000-mdtlov_UUID:11820:1875765421468544:0@lo:1000:mdt_rdpg00_002.0 00000100:00100000:1.0:1788869452.070467:0:11820:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869452.070621:0:11820:0:(client.c:2702:ptlrpc_set_wait()) set ffff94c810e32300 going to sleep for 11 seconds 00000100:00100000:0.0:1788869452.070667:0:5760:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765421468544 00000100:00100000:0.0:1788869452.070672:0:5760:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765421468544 00000100:00100000:0.0:1788869452.070692:0:5760:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788869452.070698:0:5760:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c82d043800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:11820:x1875765421468544:12345-0@lo:1000:mdt_rdpg00_002.0 00000100:00100000:0.0:1788869452.070840:0:5760:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c82d043800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:11820:x1875765421468544:12345-0@lo:1000:mdt_rdpg00_002.0 Request processed in 140us (371us total) trans 4294967306 rc 0/0 00000100:00100000:0.0:1788869452.070847:0:5760:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788869452.070913:0:11820:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94c82ccfed80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000-mdtlov_UUID:11820:1875765421468544:0@lo:1000:mdt_rdpg00_002.0 00000001:00080000:1.0:1788869452.070944:0:11820:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967429 00010000:00010000:1.0:1788869452.070973:0:11820:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94c83fde7200/0x3d2d1916761d6e5a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869452.070991:0:11820:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94c83fde7200/0x3d2d1916761d6e5a lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 11820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869452.071111:0:11820:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94c83fde7200/0x3d2d1916761d6e5a lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869452.071117:0:11820:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94c83fde7200 already unused, calling callback (ffffffffc21124f0) 00010000:00010000:1.0:1788869452.071121:0:11820:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94c83fde7200/0x3d2d1916761d6e5a lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869452.071129:0:11820:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94c83fde7200/0x3d2d1916761d6e5a lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 11820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869452.071143:0:11820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff94c819394a00) 00010000:00010000:1.0:1788869452.071146:0:11820:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:1.0:1788869452.071151:0:11820:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94c83fde7200/0x3d2d1916761d6e5a lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869452.071157:0:11820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94c83fde7200/0x3d2d1916761d6e5a lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11820 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1788869452.071380:0:11820:0:(mdd_object.c:4016:mdd_close()) Object [0x200000401:0xc:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:1.0:1788869452.071503:0:11820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].4, 64 off8448 00000004:00080000:1.0:1788869452.071514:0:11820:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 200363263933ns, next at 201363261157ns, rc = 0 00000001:00080000:1.0:1788869452.071522:0:11820:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967430 00010000:00010000:1.0:1788869452.071550:0:11820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff94c819394a00) 00010000:00010000:1.0:1788869452.071553:0:11820:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1788869452.071559:0:11820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94c83fde6c00/0x3d2d1916761d6e45 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.39@tcp remote: 0x375c010249035a70 expref: 33 pid: 5755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788869452.071746:0:11820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c818769850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:2125b9b3-626e-4cbe-be83-fb446e976ce2+32:11300:x1875765413084032:12345-192.168.201.39@tcp:35:lfs.0 Request processed in 17192us (17441us total) trans 4294967431 rc 0/0 00000100:00100000:1.0:1788869452.071754:0:11820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 38 00000020:00080000:1.0:1788869452.071758:0:11820:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:0.0:1788869452.074002:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1788869452.075907:0:5757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765413084288 00000100:00100000:2.0:1788869452.075919:0:5757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765413084288 00000100:00100000:2.0:1788869452.075978:0:5757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 149 00000100:00100000:2.0:1788869452.075989:0:5757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c83513ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2125b9b3-626e-4cbe-be83-fb446e976ce2+32:11300:x1875765413084288:12345-192.168.201.39@tcp:101:lfs.0 00010000:00010000:2.0:1788869452.076012:0:5757:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788869452.076035:0:5757:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94c805038000/0x3d2d1916761d6e61 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x375c010249035a77 expref: -99 pid: 5757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869452.076088:0:5757:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94c805038000/0x3d2d1916761d6e61 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.39@tcp remote: 0x375c010249035a77 expref: 33 pid: 5757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869452.076102:0:5757:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94c805038000/0x3d2d1916761d6e61 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.39@tcp remote: 0x375c010249035a77 expref: 33 pid: 5757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869452.076120:0:5757:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff94c802f3fa00) 00010000:00010000:2.0:1788869452.076123:0:5757:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788869452.076135:0:5757:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94c805038000, rc 0) 00000100:00100000:2.0:1788869452.076192:0:5757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c83513ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2125b9b3-626e-4cbe-be83-fb446e976ce2+33:11300:x1875765413084288:12345-192.168.201.39@tcp:101:lfs.0 Request processed in 205us (2196us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869452.076200:0:5757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 149 00000100:00100000:3.0:1788869452.080082:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1788869452.080465:0:5759:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765413084544 00000100:00100000:0.0:1788869452.080476:0:5759:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765413084544 00000100:00100000:0.0:1788869452.080537:0:5759:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 39 00000100:00100000:0.0:1788869452.080548:0:5759:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c835150700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2125b9b3-626e-4cbe-be83-fb446e976ce2+33:11300:x1875765413084544:12345-192.168.201.39@tcp:35:lfs.0 00000100:00100000:0.0:1788869452.080809:0:5759:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c835150700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2125b9b3-626e-4cbe-be83-fb446e976ce2+34:11300:x1875765413084544:12345-192.168.201.39@tcp:35:lfs.0 Request processed in 262us (748us total) trans 4294967432 rc 0/0 00000100:00100000:0.0:1788869452.080817:0:5759:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 39 00000100:00100000:0.0:1788869452.141118:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1788869452.141225:0:5755:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765413084800 00000100:00100000:1.0:1788869452.141235:0:5755:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765413084800 00000100:00100000:1.0:1788869452.141339:0:5755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 150 00000100:00100000:1.0:1788869452.141350:0:5755:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c83513d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2125b9b3-626e-4cbe-be83-fb446e976ce2+34:11310:x1875765413084800:12345-192.168.201.39@tcp:101:lfs.0 00010000:00010000:1.0:1788869452.141374:0:5755:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788869452.141394:0:5755:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94c83fde6c00/0x3d2d1916761d6e68 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x375c010249035a7e expref: -99 pid: 5755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788869452.141518:0:5755:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00010000:00010000:1.0:1788869452.141642:0:5755:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94c83fde6c00/0x3d2d1916761d6e68 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0x375c010249035a7e expref: 36 pid: 5755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869452.141658:0:5755:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff94c819394300) 00010000:00010000:1.0:1788869452.141661:0:5755:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788869452.141666:0:5755:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94c83fde6c00/0x3d2d1916761d6e68 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.39@tcp remote: 0x375c010249035a7e expref: 36 pid: 5755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869452.141680:0:5755:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94c83fde6c00, rc 0) 00000100:00100000:1.0:1788869452.141954:0:5755:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c83513d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2125b9b3-626e-4cbe-be83-fb446e976ce2+35:11310:x1875765413084800:12345-192.168.201.39@tcp:101:lfs.0 Request processed in 605us (845us total) trans 4294967433 rc 301/301 00000100:00100000:1.0:1788869452.141961:0:5755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 150 00000100:00100000:3.0:1788869452.144660:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1788869452.144784:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765413084928 00000100:00100000:0.0:1788869452.144795:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765413084928 00000100:00100000:0.0:1788869452.144893:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 151 00000100:00100000:0.0:1788869452.144903:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c835151180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2125b9b3-626e-4cbe-be83-fb446e976ce2+35:11310:x1875765413084928:12345-192.168.201.39@tcp:34:lfs.0 00010000:00010000:0.0:1788869452.144972:0:5786:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff94c81a582200/0x3d2d1916761d6e76 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869452.144989:0:5786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94c81a582200/0x3d2d1916761d6e76 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869452.145000:0:5786:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94c81a582200/0x3d2d1916761d6e76 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869452.145015:0:5786:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94c81a582e00/0x3d2d1916761d6e7d lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869452.145023:0:5786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94c81a582e00/0x3d2d1916761d6e7d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869452.145030:0:5786:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94c81a582e00/0x3d2d1916761d6e7d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869452.145139:0:5786:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94c81a583400/0x3d2d1916761d6e84 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869452.145147:0:5786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94c81a583400/0x3d2d1916761d6e84 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869452.145155:0:5786:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94c81a583400/0x3d2d1916761d6e84 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788869452.145205:0:5786:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff94c81a583400/0x3d2d1916761d6e84 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869452.145219:0:5786:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff94c81a582200/0x3d2d1916761d6e76 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869452.145224:0:5786:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94c81a582200/0x3d2d1916761d6e76 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869452.145232:0:5786:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94c81a582200/0x3d2d1916761d6e76 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869452.145237:0:5786:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94c81a582200 already unused, calling callback (ffffffffc21124f0) 00010000:00010000:0.0:1788869452.145241:0:5786:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94c81a582200/0x3d2d1916761d6e76 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869452.145245:0:5786:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94c81a582200/0x3d2d1916761d6e76 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869452.145286:0:5786:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff94c802f3fd00) 00010000:00010000:0.0:1788869452.145288:0:5786:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788869452.145291:0:5786:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94c81a582200/0x3d2d1916761d6e76 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869452.145296:0:5786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94c81a582200/0x3d2d1916761d6e76 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869452.145306:0:5786:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94c81a582e00/0x3d2d1916761d6e7d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869452.145309:0:5786:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94c81a582e00/0x3d2d1916761d6e7d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869452.145318:0:5786:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94c81a582e00/0x3d2d1916761d6e7d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869452.145321:0:5786:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94c81a582e00 already unused, calling callback (ffffffffc21124f0) 00010000:00010000:0.0:1788869452.145323:0:5786:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94c81a582e00/0x3d2d1916761d6e7d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869452.145326:0:5786:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94c81a582e00/0x3d2d1916761d6e7d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869452.145331:0:5786:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff94c803990f00) 00010000:00010000:0.0:1788869452.145332:0:5786:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788869452.145334:0:5786:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94c81a582e00/0x3d2d1916761d6e7d lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869452.145337:0:5786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94c81a582e00/0x3d2d1916761d6e7d lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869452.145345:0:5786:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94c81a583400/0x3d2d1916761d6e84 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869452.145349:0:5786:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94c81a583400/0x3d2d1916761d6e84 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869452.145352:0:5786:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94c81a583400/0x3d2d1916761d6e84 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869452.145355:0:5786:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94c81a583400 already unused, calling callback (ffffffffc21124f0) 00010000:00010000:0.0:1788869452.145356:0:5786:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94c81a583400/0x3d2d1916761d6e84 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869452.145366:0:5786:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94c81a583400/0x3d2d1916761d6e84 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869452.145370:0:5786:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff94c802f3fa00) 00010000:00010000:0.0:1788869452.145371:0:5786:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788869452.145373:0:5786:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94c81a583400/0x3d2d1916761d6e84 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869452.145376:0:5786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94c81a583400/0x3d2d1916761d6e84 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788869452.145440:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c835151180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2125b9b3-626e-4cbe-be83-fb446e976ce2+35:11310:x1875765413084928:12345-192.168.201.39@tcp:34:lfs.0 Request processed in 540us (789us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869452.145445:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 151 00000100:00100000:3.0:1788869452.149217:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1788869452.149637:0:11820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765413085184 00000100:00100000:1.0:1788869452.149659:0:11820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765413085184 00000100:00100000:1.0:1788869452.149701:0:11820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 40 00000100:00100000:1.0:1788869452.149708:0:11820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c835150e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:2125b9b3-626e-4cbe-be83-fb446e976ce2+35:11310:x1875765413085184:12345-192.168.201.39@tcp:35:lfs.0 00000100:00100000:1.0:1788869452.149939:0:11820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c835150e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:2125b9b3-626e-4cbe-be83-fb446e976ce2+36:11310:x1875765413085184:12345-192.168.201.39@tcp:35:lfs.0 Request processed in 230us (732us total) trans 4294967434 rc 0/0 00000100:00100000:1.0:1788869452.149947:0:11820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 40 00000100:00100000:1.0:1788869452.176500:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1788869452.176681:0:5755:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765413085440 00000100:00100000:3.0:1788869452.176690:0:5755:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765413085440 00000100:00100000:3.0:1788869452.176790:0:5755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 152 00000100:00100000:3.0:1788869452.176801:0:5755:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c82ccfea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2125b9b3-626e-4cbe-be83-fb446e976ce2+36:11313:x1875765413085440:12345-192.168.201.39@tcp:101:lfs.0 00010000:00010000:3.0:1788869452.176821:0:5755:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788869452.176837:0:5755:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504c200/0x3d2d1916761d6e8b lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x375c010249035a85 expref: -99 pid: 5755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869452.176919:0:5755:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504ce00/0x3d2d1916761d6e92 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869452.176934:0:5755:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504ce00/0x3d2d1916761d6e92 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869452.176945:0:5755:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504ce00/0x3d2d1916761d6e92 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869452.176957:0:5755:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504c800/0x3d2d1916761d6e99 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869452.176964:0:5755:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504c800/0x3d2d1916761d6e99 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869452.176970:0:5755:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504c800/0x3d2d1916761d6e99 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869452.177089:0:5755:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504d400/0x3d2d1916761d6ea0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869452.177099:0:5755:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504d400/0x3d2d1916761d6ea0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869452.177106:0:5755:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504d400/0x3d2d1916761d6ea0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788869452.177117:0:5755:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:3.0:1788869452.177206:0:5755:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504ce00/0x3d2d1916761d6e92 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869452.177213:0:5755:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504ce00/0x3d2d1916761d6e92 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869452.177226:0:5755:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504ce00/0x3d2d1916761d6e92 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869452.177232:0:5755:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94c83504ce00 already unused, calling callback (ffffffffc21124f0) 00010000:00010000:3.0:1788869452.177237:0:5755:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504ce00/0x3d2d1916761d6e92 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869452.177244:0:5755:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504ce00/0x3d2d1916761d6e92 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869452.177276:0:5755:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff94c802f3fd00) 00010000:00010000:3.0:1788869452.177280:0:5755:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788869452.177284:0:5755:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504ce00/0x3d2d1916761d6e92 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869452.177290:0:5755:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504ce00/0x3d2d1916761d6e92 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869452.177301:0:5755:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504c800/0x3d2d1916761d6e99 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869452.177307:0:5755:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504c800/0x3d2d1916761d6e99 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869452.177314:0:5755:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504c800/0x3d2d1916761d6e99 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869452.177319:0:5755:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94c83504c800 already unused, calling callback (ffffffffc21124f0) 00010000:00010000:3.0:1788869452.177322:0:5755:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504c800/0x3d2d1916761d6e99 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869452.177337:0:5755:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504c800/0x3d2d1916761d6e99 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869452.177345:0:5755:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff94c819394b00) 00010000:00010000:3.0:1788869452.177347:0:5755:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788869452.177350:0:5755:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504c800/0x3d2d1916761d6e99 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869452.177355:0:5755:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504c800/0x3d2d1916761d6e99 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869452.177407:0:5755:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504c200/0x3d2d1916761d6e8b lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0x375c010249035a85 expref: 39 pid: 5755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869452.177419:0:5755:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504d400/0x3d2d1916761d6ea0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0x375c010249035a85 expref: 38 pid: 5755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869452.177427:0:5755:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff94c802f3fa00) 00010000:00010000:3.0:1788869452.177429:0:5755:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788869452.177431:0:5755:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94c83504d400, rc 0) 00000100:00100000:3.0:1788869452.177539:0:5755:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c82ccfea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2125b9b3-626e-4cbe-be83-fb446e976ce2+38:11313:x1875765413085440:12345-192.168.201.39@tcp:101:lfs.0 Request processed in 740us (1050us total) trans 4294967435 rc 0/0 00000100:00100000:3.0:1788869452.177546:0:5755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 152 00000100:00100000:3.0:1788869452.182511:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1788869452.182613:0:5757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765413085568 00000100:00100000:2.0:1788869452.182623:0:5757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765413085568 00000100:00100000:2.0:1788869452.182687:0:5757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 153 00000100:00100000:2.0:1788869452.182697:0:5757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c835151f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2125b9b3-626e-4cbe-be83-fb446e976ce2+38:11313:x1875765413085568:12345-192.168.201.39@tcp:54:lfs.0 00010000:00010000:2.0:1788869452.182771:0:5757:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94c805038600/0x3d2d1916761d6eae lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869452.182788:0:5757:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94c805038600/0x3d2d1916761d6eae lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869452.182799:0:5757:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94c805038600/0x3d2d1916761d6eae lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869452.182826:0:5757:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94c805038600/0x3d2d1916761d6eae lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869452.182833:0:5757:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94c805038600/0x3d2d1916761d6eae lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869452.182840:0:5757:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94c805038600/0x3d2d1916761d6eae lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869452.182846:0:5757:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94c805038600 already unused, calling callback (ffffffffc21124f0) 00010000:00010000:2.0:1788869452.182850:0:5757:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94c805038600/0x3d2d1916761d6eae lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869452.182858:0:5757:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94c805038600/0x3d2d1916761d6eae lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869452.182869:0:5757:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff94c802f3fa00) 00010000:00010000:2.0:1788869452.182872:0:5757:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788869452.182877:0:5757:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94c805038600/0x3d2d1916761d6eae lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869452.182897:0:5757:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94c805038600/0x3d2d1916761d6eae lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5757 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788869452.182982:0:5757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c835151f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2125b9b3-626e-4cbe-be83-fb446e976ce2+38:11313:x1875765413085568:12345-192.168.201.39@tcp:54:lfs.0 Request processed in 285us (480us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869452.182990:0:5757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 153 00000100:00100000:1.0:1788869452.185654:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1788869452.185849:0:5758:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765413085824 00000100:00100000:2.0:1788869452.185859:0:5758:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765413085824 00000100:00100000:2.0:1788869452.185919:0:5758:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 41 00000100:00100000:2.0:1788869452.185930:0:5758:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c82ceda300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2125b9b3-626e-4cbe-be83-fb446e976ce2+38:11313:x1875765413085824:12345-192.168.201.39@tcp:35:lfs.0 00000100:00100000:2.0:1788869452.186193:0:5758:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c82ceda300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2125b9b3-626e-4cbe-be83-fb446e976ce2+39:11313:x1875765413085824:12345-192.168.201.39@tcp:35:lfs.0 Request processed in 264us (547us total) trans 4294967436 rc 0/0 00000100:00100000:2.0:1788869452.186201:0:5758:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 41 00010000:00010000:0.0:1788869452.187420:0:5743:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788869452.347119:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1788869452.347240:0:5756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765413086080 00000100:00100000:0.0:1788869452.347279:0:5756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765413086080 00000100:00100000:0.0:1788869452.347387:0:5756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 154 00000100:00100000:0.0:1788869452.347397:0:5756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c835156300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2125b9b3-626e-4cbe-be83-fb446e976ce2+39:11344:x1875765413086080:12345-192.168.201.39@tcp:101:cat.0 00010000:00010000:0.0:1788869452.347521:0:5756:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788869452.347544:0:5756:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94c81a583400/0x3d2d1916761d6eb5 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x375c010249035a8c expref: -99 pid: 5756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869452.347649:0:5756:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94c81a582e00/0x3d2d1916761d6ebc lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869452.347664:0:5756:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94c81a582e00/0x3d2d1916761d6ebc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869452.347686:0:5756:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94c81a582e00/0x3d2d1916761d6ebc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788869452.347699:0:5756:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:0.0:1788869452.347821:0:5756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94c81a583400/0x3d2d1916761d6eb5 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0x375c010249035a8c expref: 42 pid: 5756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869452.347840:0:5756:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94c81a582e00/0x3d2d1916761d6ebc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0x375c010249035a8c expref: 41 pid: 5756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869452.347849:0:5756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff94c802f3fa00) 00010000:00010000:0.0:1788869452.347852:0:5756:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788869452.347855:0:5756:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94c81a582e00, rc 0) 00000100:00100000:0.0:1788869452.347919:0:5756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c835156300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2125b9b3-626e-4cbe-be83-fb446e976ce2+41:11344:x1875765413086080:12345-192.168.201.39@tcp:101:cat.0 Request processed in 523us (808us total) trans 4294967437 rc 0/0 00000100:00100000:0.0:1788869452.347928:0:5756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 154 00000100:00100000:3.0:1788869452.351204:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1788869452.351245:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1788869452.351353:0:5759:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765413086336 00000100:00100000:2.0:1788869452.351354:0:5740:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765413086464 00000100:00100000:2.0:1788869452.351362:0:5740:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765413086464 00000100:00100000:0.0:1788869452.351363:0:5759:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765413086336 00000100:00100000:0.0:1788869452.351432:0:5759:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 42 00000100:00100000:0.0:1788869452.351441:0:5759:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c835152680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2125b9b3-626e-4cbe-be83-fb446e976ce2+42:11344:x1875765413086336:12345-192.168.201.39@tcp:35:cat.0 00000100:00100000:2.0:1788869452.351450:0:5740:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 10 00000100:00100000:2.0:1788869452.351467:0:5740:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c835152a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2125b9b3-626e-4cbe-be83-fb446e976ce2+42:2346:x1875765413086464:12345-192.168.201.39@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788869452.351480:0:5740:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788869452.351509:0:5740:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94c81a582e00/0x3d2d1916761d6ebc lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.39@tcp remote: 0x375c010249035a8c expref: 42 pid: 5756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869452.351533:0:5740:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff94c802f3fa00) 00010000:00010000:2.0:1788869452.351537:0:5740:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788869452.351608:0:5740:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c835152a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2125b9b3-626e-4cbe-be83-fb446e976ce2+42:2346:x1875765413086464:12345-192.168.201.39@tcp:103:ldlm_bl.0 Request processed in 150us (362us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869452.351633:0:5740:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 10 00000100:00100000:0.0:1788869452.351655:0:5759:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c835152680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2125b9b3-626e-4cbe-be83-fb446e976ce2+41:11344:x1875765413086336:12345-192.168.201.39@tcp:35:cat.0 Request processed in 212us (456us total) trans 4294967438 rc 0/0 00000100:00100000:0.0:1788869452.351662:0:5759:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 42 00000100:00100000:1.0:1788869452.401241:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1788869452.401307:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765413086720 00000100:00100000:0.0:1788869452.401315:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765413086720 00000100:00100000:0.0:1788869452.401373:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 155 00000100:00100000:0.0:1788869452.401383:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c835155880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2125b9b3-626e-4cbe-be83-fb446e976ce2+41:11350:x1875765413086720:12345-192.168.201.39@tcp:101:dd.0 00010000:00010000:0.0:1788869452.401467:0:5786:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788869452.401471:0:5786:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1788869452.401494:0:5786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94c805039400/0x3d2d1916761d6e22 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.39@tcp remote: 0x375c010249035a62 expref: 41 pid: 5756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869452.401509:0:5786:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff94c802f3fd00) 00010000:00010000:0.0:1788869452.401512:0:5786:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788869452.401523:0:5786:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94c81a583400/0x3d2d1916761d6eca lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x375c010249035a93 expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869452.401621:0:5786:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94c81a582200/0x3d2d1916761d6ed1 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869452.401632:0:5786:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504d400/0x3d2d1916761d6ea0 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0x375c010249035a85 expref: 41 pid: 5755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869452.401638:0:5786:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff94c81a582200/0x3d2d1916761d6ed1 lrc: 4/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869452.401675:0:5786:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504d400/0x3d2d1916761d6ea0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.39@tcp remote: 0x375c010249035a85 expref: 41 pid: 5755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869452.401684:0:5786:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504d400/0x3d2d1916761d6ea0 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.39@tcp remote: 0x375c010249035a85 expref: 41 pid: 5755 timeout: 300 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788869452.401694:0:5786:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94c8354d1180 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:5786:1875765421468672:192.168.201.39@tcp:104: 00000100:00100000:0.0:1788869452.402033:0:5786:0:(client.c:2702:ptlrpc_set_wait()) set ffff94c8033c43c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788869452.405521:0:5786:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94c8354d1180 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:5786:1875765421468672:192.168.201.39@tcp:104: 00010000:00010000:0.0:1788869452.405585:0:5786:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff94c81a582200/0x3d2d1916761d6ed1 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788869452.407422:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1788869452.407629:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765413086848 00000100:00100000:0.0:1788869452.407639:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765413086848 00010000:00010000:0.0:1788869452.407685:0:5788:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504d400/0x3d2d1916761d6ea0 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.39@tcp remote: 0x375c010249035a85 expref: 42 pid: 5755 timeout: 300 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788869452.407727:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 67 00000100:00100000:0.0:1788869452.407736:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c835157b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2125b9b3-626e-4cbe-be83-fb446e976ce2+42:2348:x1875765413086848:12345-192.168.201.39@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788869452.407750:0:5788:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788869452.407757:0:5788:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504d400/0x3d2d1916761d6ea0 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.39@tcp remote: 0x375c010249035a85 expref: 42 pid: 5755 timeout: 300 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869452.407768:0:5788:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504d400/0x3d2d1916761d6ea0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.39@tcp remote: 0x375c010249035a85 expref: 42 pid: 5755 timeout: 300 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869452.407791:0:5788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504d400/0x3d2d1916761d6ea0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.39@tcp remote: 0x375c010249035a85 expref: 42 pid: 5755 timeout: 300 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869452.407806:0:5788:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff94c802f3fa00) 00010000:00010000:0.0:1788869452.407810:0:5788:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff94c81a582200/0x3d2d1916761d6ed1 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869452.407819:0:5788:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff94c81a582200/0x3d2d1916761d6ed1 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869452.407825:0:5788:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94c81a582200/0x3d2d1916761d6ed1 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869452.407865:0:5788:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788869452.407935:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c835157b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2125b9b3-626e-4cbe-be83-fb446e976ce2+41:2348:x1875765413086848:12345-192.168.201.39@tcp:103:ldlm_bl.0 Request processed in 199us (521us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869452.407944:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 67 00010000:00010000:3.0:1788869452.407954:0:5786:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff94c81a582200/0x3d2d1916761d6ed1 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869452.407975:0:5786:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94c81a582200/0x3d2d1916761d6ed1 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788869452.408001:0:5786:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:3.0:1788869452.408266:0:5786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94c81a583400/0x3d2d1916761d6eca lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0x375c010249035a93 expref: 42 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869452.408288:0:5786:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94c81a582200/0x3d2d1916761d6ed1 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0x375c010249035a93 expref: 41 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869452.408296:0:5786:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff94c802f3fa00) 00010000:00010000:3.0:1788869452.408299:0:5786:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1788869452.408302:0:5786:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94c81a582200, rc 0) 00000100:00100000:3.0:1788869452.408330:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c835155880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2125b9b3-626e-4cbe-be83-fb446e976ce2+41:11350:x1875765413086720:12345-192.168.201.39@tcp:101:dd.0 Request processed in 6949us (7099us total) trans 4294967439 rc 0/0 00000100:00100000:3.0:1788869452.408339:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 155 00000100:00100000:2.0:1788869452.412230:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1788869452.412496:0:5755:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765413087104 00000100:00100000:3.0:1788869452.412506:0:5755:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765413087104 00000100:00100000:3.0:1788869452.412611:0:5755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 156 00000100:00100000:3.0:1788869452.412625:0:5755:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c835a3e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2125b9b3-626e-4cbe-be83-fb446e976ce2+41:11350:x1875765413087104:12345-192.168.201.39@tcp:36:dd.0 00010000:00010000:3.0:1788869452.412967:0:5755:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504c200/0x3d2d1916761d6edf lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869452.412984:0:5755:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504c200/0x3d2d1916761d6edf lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869452.412994:0:5755:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504c200/0x3d2d1916761d6edf lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788869452.413058:0:5755:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967440 00000004:00010000:3.0:1788869452.413079:0:5755:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000c68eec2c reply state 00000000e1daa353 transno 4294967441 ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504c200/0x3d2d1916761d6edf lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788869452.413087:0:5755:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788869452.413191:0:5755:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c835a3e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2125b9b3-626e-4cbe-be83-fb446e976ce2+44:11350:x1875765413087104:12345-192.168.201.39@tcp:36:dd.0 Request processed in 570us (974us total) trans 4294967441 rc 0/0 00000100:00100000:3.0:1788869452.413196:0:5755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 156 00000020:00080000:3.0:1788869452.413201:0:5755:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1788869452.414716:0:3270:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504c200/0x3d2d1916761d6edf lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869452.414736:0:3270:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504c200/0x3d2d1916761d6edf lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869452.414745:0:3270:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504c200/0x3d2d1916761d6edf lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869452.414752:0:3270:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94c83504c200 already unused, calling callback (ffffffffc21124f0) 00010000:00010000:2.0:1788869452.414758:0:3270:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504c200/0x3d2d1916761d6edf lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869452.414768:0:3270:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504c200/0x3d2d1916761d6edf lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869452.414788:0:3270:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff94c802f3fa00) 00010000:00010000:2.0:1788869452.414792:0:3270:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788869452.414798:0:3270:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504c200/0x3d2d1916761d6edf lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869452.414804:0:3270:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504c200/0x3d2d1916761d6edf lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788869452.609488:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1788869452.609766:0:5757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765413087232 00000100:00100000:1.0:1788869452.609780:0:5757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765413087232 00000100:00100000:1.0:1788869452.609890:0:5757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 157 00000100:00100000:1.0:1788869452.609904:0:5757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c835a3d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2125b9b3-626e-4cbe-be83-fb446e976ce2+43:11364:x1875765413087232:12345-192.168.201.39@tcp:101:stat.0 00010000:00010000:1.0:1788869452.609934:0:5757:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788869452.609965:0:5757:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94c83fde6e00/0x3d2d1916761d6ee6 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x375c010249035a9a expref: -99 pid: 5757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869452.610060:0:5757:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff94c83fde7400/0x3d2d1916761d6eed lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869452.610077:0:5757:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94c83fde7400/0x3d2d1916761d6eed lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869452.610090:0:5757:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94c83fde7400/0x3d2d1916761d6eed lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869452.610105:0:5757:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94c83fde6200/0x3d2d1916761d6ef4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869452.610131:0:5757:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94c83fde6200/0x3d2d1916761d6ef4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869452.610138:0:5757:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94c83fde6200/0x3d2d1916761d6ef4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869452.610270:0:5757:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94c83fde6a00/0x3d2d1916761d6efb lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869452.610279:0:5757:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff94c81a582200/0x3d2d1916761d6ed1 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0x375c010249035a93 expref: 44 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869452.610286:0:5757:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff94c83fde6a00/0x3d2d1916761d6efb lrc: 4/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869452.610322:0:5757:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff94c81a582200/0x3d2d1916761d6ed1 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.39@tcp remote: 0x375c010249035a93 expref: 44 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869452.610333:0:5757:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff94c81a582200/0x3d2d1916761d6ed1 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.39@tcp remote: 0x375c010249035a93 expref: 44 pid: 5786 timeout: 300 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788869452.610345:0:5757:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94c835154380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5757:1875765421468800:192.168.201.39@tcp:104: 00000100:00100000:1.0:1788869452.610585:0:5757:0:(client.c:2702:ptlrpc_set_wait()) set ffff94c810e32480 going to sleep for 11 seconds 00000100:00100000:2.0:1788869452.612633:0:5757:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94c835154380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5757:1875765421468800:192.168.201.39@tcp:104: 00010000:00010000:2.0:1788869452.612677:0:5757:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff94c83fde6a00/0x3d2d1916761d6efb lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5757 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788869452.613143:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1788869452.613354:0:11820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765413087488 00000100:00100000:1.0:1788869452.613363:0:11820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765413087488 00000100:00100000:1.0:1788869452.613487:0:11820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 43 00000100:00100000:1.0:1788869452.613499:0:11820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c835a3fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:2125b9b3-626e-4cbe-be83-fb446e976ce2+45:5553:x1875765413087488:12345-192.168.201.39@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1788869452.613910:0:11820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c835a3fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:2125b9b3-626e-4cbe-be83-fb446e976ce2+46:5553:x1875765413087488:12345-192.168.201.39@tcp:35:ldlm_bl.0 Request processed in 413us (765us total) trans 4294967442 rc 0/0 00000100:00100000:1.0:1788869452.613928:0:11820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 43 00000100:00100000:1.0:1788869452.615885:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1788869452.616050:0:5739:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765413087616 00000100:00100000:3.0:1788869452.616062:0:5739:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765413087616 00010000:00010000:3.0:1788869452.616109:0:5739:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff94c81a582200/0x3d2d1916761d6ed1 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.39@tcp remote: 0x375c010249035a93 expref: 46 pid: 5786 timeout: 300 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788869452.616183:0:5739:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 68 00000100:00100000:3.0:1788869452.616191:0:5739:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c835154000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2125b9b3-626e-4cbe-be83-fb446e976ce2+46:2347:x1875765413087616:12345-192.168.201.39@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788869452.616206:0:5739:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788869452.616212:0:5739:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff94c81a582200/0x3d2d1916761d6ed1 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.39@tcp remote: 0x375c010249035a93 expref: 46 pid: 5786 timeout: 300 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869452.616235:0:5739:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff94c81a582200/0x3d2d1916761d6ed1 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.39@tcp remote: 0x375c010249035a93 expref: 46 pid: 5786 timeout: 300 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869452.616292:0:5739:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94c81a582200/0x3d2d1916761d6ed1 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.39@tcp remote: 0x375c010249035a93 expref: 46 pid: 5786 timeout: 300 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869452.616313:0:5739:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff94c802f3fa00) 00010000:00010000:3.0:1788869452.616336:0:5739:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff94c83fde6a00/0x3d2d1916761d6efb lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869452.616347:0:5739:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff94c83fde6a00/0x3d2d1916761d6efb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869452.616356:0:5739:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94c83fde6a00/0x3d2d1916761d6efb lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869452.616397:0:5739:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788869452.616475:0:5739:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c835154000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2125b9b3-626e-4cbe-be83-fb446e976ce2+45:2347:x1875765413087616:12345-192.168.201.39@tcp:103:ldlm_bl.0 Request processed in 284us (600us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869452.616484:0:5739:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 68 00010000:00010000:1.0:1788869452.616816:0:5757:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff94c83fde6a00/0x3d2d1916761d6efb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869452.616827:0:5757:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94c83fde6a00/0x3d2d1916761d6efb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5757 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788869452.616882:0:5757:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:1.0:1788869452.616887:0:5757:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1788869452.616918:0:5757:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff94c83fde6a00/0x3d2d1916761d6efb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869452.616933:0:5757:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94c83fde6a00/0x3d2d1916761d6efb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869452.616944:0:5757:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff94c83fde7400/0x3d2d1916761d6eed lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869452.616951:0:5757:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94c83fde7400/0x3d2d1916761d6eed lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869452.616958:0:5757:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94c83fde7400/0x3d2d1916761d6eed lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869452.616965:0:5757:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94c83fde7400 already unused, calling callback (ffffffffc21124f0) 00010000:00010000:1.0:1788869452.616969:0:5757:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94c83fde7400/0x3d2d1916761d6eed lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869452.616978:0:5757:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94c83fde7400/0x3d2d1916761d6eed lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869452.616999:0:5757:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff94c802f3fd00) 00010000:00010000:1.0:1788869452.617002:0:5757:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788869452.617005:0:5757:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94c83fde7400/0x3d2d1916761d6eed lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869452.617010:0:5757:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94c83fde7400/0x3d2d1916761d6eed lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869452.617018:0:5757:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94c83fde6200/0x3d2d1916761d6ef4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869452.617022:0:5757:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94c83fde6200/0x3d2d1916761d6ef4 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869452.617026:0:5757:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94c83fde6200/0x3d2d1916761d6ef4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869452.617029:0:5757:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94c83fde6200 already unused, calling callback (ffffffffc21124f0) 00010000:00010000:1.0:1788869452.617030:0:5757:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94c83fde6200/0x3d2d1916761d6ef4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869452.617033:0:5757:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94c83fde6200/0x3d2d1916761d6ef4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869452.617038:0:5757:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff94c81a585800) 00010000:00010000:1.0:1788869452.617040:0:5757:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788869452.617042:0:5757:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94c83fde6200/0x3d2d1916761d6ef4 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869452.617047:0:5757:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94c83fde6200/0x3d2d1916761d6ef4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869452.617102:0:5757:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94c83fde6e00/0x3d2d1916761d6ee6 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0x375c010249035a9a expref: 45 pid: 5757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869452.617118:0:5757:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94c83fde6a00/0x3d2d1916761d6efb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0x375c010249035a9a expref: 44 pid: 5757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869452.617126:0:5757:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff94c802f3fa00) 00010000:00010000:1.0:1788869452.617128:0:5757:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788869452.617130:0:5757:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94c83fde6a00, rc 0) 00000100:00100000:1.0:1788869452.617178:0:5757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c835a3d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2125b9b3-626e-4cbe-be83-fb446e976ce2+44:11364:x1875765413087232:12345-192.168.201.39@tcp:101:stat.0 Request processed in 7278us (7753us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869452.617186:0:5757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 157 00000100:00100000:1.0:1788869452.652015:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1788869452.653765:0:5756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765413087872 00000100:00100000:0.0:1788869452.653784:0:5756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765413087872 00000100:00100000:0.0:1788869452.653908:0:5756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 158 00000100:00100000:0.0:1788869452.653923:0:5756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c835157480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2125b9b3-626e-4cbe-be83-fb446e976ce2+44:11370:x1875765413087872:12345-192.168.201.39@tcp:36:truncate.0 00010000:00010000:0.0:1788869452.653997:0:5756:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788869452.654034:0:5756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94c83fde6a00/0x3d2d1916761d6efb lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.39@tcp remote: 0x375c010249035a9a expref: 44 pid: 5757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869452.654059:0:5756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff94c802f3fa00) 00010000:00010000:0.0:1788869452.654065:0:5756:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788869452.655677:0:5756:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94c81a582200/0x3d2d1916761d6f02 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869452.655704:0:5756:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94c81a582200/0x3d2d1916761d6f02 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869452.655718:0:5756:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94c81a582200/0x3d2d1916761d6f02 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788869452.655839:0:5756:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967443 00000004:00010000:0.0:1788869452.655885:0:5756:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000076c06389 reply state 0000000030d43873 transno 4294967444 ns: mdt-lustre-MDT0000_UUID lock: ffff94c81a582200/0x3d2d1916761d6f02 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788869452.655897:0:5756:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788869452.656728:0:5756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c835157480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2125b9b3-626e-4cbe-be83-fb446e976ce2+46:11370:x1875765413087872:12345-192.168.201.39@tcp:36:truncate.0 Request processed in 2800us (4722us total) trans 4294967444 rc 0/0 00000100:00100000:0.0:1788869452.656741:0:5756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 158 00000020:00080000:0.0:1788869452.656748:0:5756:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1788869452.664305:0:3269:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94c81a582200/0x3d2d1916761d6f02 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869452.664330:0:3269:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94c81a582200/0x3d2d1916761d6f02 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869452.664339:0:3269:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94c81a582200/0x3d2d1916761d6f02 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869452.664347:0:3269:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94c81a582200 already unused, calling callback (ffffffffc21124f0) 00010000:00010000:2.0:1788869452.664352:0:3269:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94c81a582200/0x3d2d1916761d6f02 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869452.664361:0:3269:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94c81a582200/0x3d2d1916761d6f02 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869452.664382:0:3269:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff94c802f3fa00) 00010000:00010000:2.0:1788869452.664385:0:3269:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788869452.664391:0:3269:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94c81a582200/0x3d2d1916761d6f02 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869452.664399:0:3269:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94c81a582200/0x3d2d1916761d6f02 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788869452.774019:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1788869452.774101:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765413088000 00000100:00100000:3.0:1788869452.774115:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765413088000 00000100:00100000:3.0:1788869452.774193:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 159 00000100:00100000:3.0:1788869452.774206:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c835155c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2125b9b3-626e-4cbe-be83-fb446e976ce2+45:11384:x1875765413088000:12345-192.168.201.39@tcp:101:stat.0 00010000:00010000:3.0:1788869452.774239:0:5786:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788869452.774311:0:5786:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504c800/0x3d2d1916761d6f09 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x375c010249035aa1 expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869452.774432:0:5786:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504ce00/0x3d2d1916761d6f10 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869452.774450:0:5786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504ce00/0x3d2d1916761d6f10 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869452.774475:0:5786:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504ce00/0x3d2d1916761d6f10 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869452.774502:0:5786:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504d600/0x3d2d1916761d6f17 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869452.774515:0:5786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504d600/0x3d2d1916761d6f17 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869452.774522:0:5786:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504d600/0x3d2d1916761d6f17 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869452.774653:0:5786:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504c600/0x3d2d1916761d6f1e lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869452.774662:0:5786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504c600/0x3d2d1916761d6f1e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869452.774668:0:5786:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504c600/0x3d2d1916761d6f1e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788869452.774710:0:5786:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 1234567 00000004:00200000:3.0:1788869452.774715:0:5786:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1788869452.774740:0:5786:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504c600/0x3d2d1916761d6f1e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869452.774753:0:5786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504c600/0x3d2d1916761d6f1e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869452.774761:0:5786:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504ce00/0x3d2d1916761d6f10 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869452.774767:0:5786:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504ce00/0x3d2d1916761d6f10 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869452.774774:0:5786:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504ce00/0x3d2d1916761d6f10 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869452.774790:0:5786:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94c83504ce00 already unused, calling callback (ffffffffc21124f0) 00010000:00010000:3.0:1788869452.774795:0:5786:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504ce00/0x3d2d1916761d6f10 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869452.774803:0:5786:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504ce00/0x3d2d1916761d6f10 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869452.774816:0:5786:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff94c802f3fd00) 00010000:00010000:3.0:1788869452.774819:0:5786:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788869452.774823:0:5786:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504ce00/0x3d2d1916761d6f10 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869452.774829:0:5786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504ce00/0x3d2d1916761d6f10 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869452.774844:0:5786:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504d600/0x3d2d1916761d6f17 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869452.774849:0:5786:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504d600/0x3d2d1916761d6f17 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869452.774855:0:5786:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504d600/0x3d2d1916761d6f17 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869452.774859:0:5786:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94c83504d600 already unused, calling callback (ffffffffc21124f0) 00010000:00010000:3.0:1788869452.774862:0:5786:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504d600/0x3d2d1916761d6f17 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869452.774866:0:5786:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504d600/0x3d2d1916761d6f17 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869452.774879:0:5786:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff94c819394b00) 00010000:00010000:3.0:1788869452.774882:0:5786:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788869452.774884:0:5786:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504d600/0x3d2d1916761d6f17 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869452.774889:0:5786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504d600/0x3d2d1916761d6f17 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869452.774929:0:5786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504c800/0x3d2d1916761d6f09 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0x375c010249035aa1 expref: 47 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869452.774943:0:5786:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504c600/0x3d2d1916761d6f1e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0x375c010249035aa1 expref: 46 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869452.774951:0:5786:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff94c802f3fa00) 00010000:00010000:3.0:1788869452.774952:0:5786:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788869452.774954:0:5786:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94c83504c600, rc 0) 00000100:00100000:3.0:1788869452.775026:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c835155c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2125b9b3-626e-4cbe-be83-fb446e976ce2+46:11384:x1875765413088000:12345-192.168.201.39@tcp:101:stat.0 Request processed in 824us (1022us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869452.775032:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 159 00000100:00100000:0.0:1788869452.838072:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1788869452.838173:0:5755:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765413088256 00000100:00100000:3.0:1788869452.838187:0:5755:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765413088256 00000100:00100000:3.0:1788869452.838297:0:5755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 160 00000100:00100000:3.0:1788869452.838311:0:5755:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c8354d1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2125b9b3-626e-4cbe-be83-fb446e976ce2+46:11394:x1875765413088256:12345-192.168.201.39@tcp:101:lfs.0 00010000:00010000:3.0:1788869452.838340:0:5755:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788869452.838368:0:5755:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504c800/0x3d2d1916761d6f25 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x375c010249035aa8 expref: -99 pid: 5755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788869452.841733:0:5755:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00010000:00010000:3.0:1788869452.841997:0:5755:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504c800/0x3d2d1916761d6f25 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0x375c010249035aa8 expref: 48 pid: 5755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869452.842018:0:5755:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff94c819394300) 00010000:00010000:3.0:1788869452.842022:0:5755:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788869452.842028:0:5755:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504c800/0x3d2d1916761d6f25 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.39@tcp remote: 0x375c010249035aa8 expref: 48 pid: 5755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869452.842045:0:5755:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94c83504c800, rc 0) 00000100:00100000:3.0:1788869452.842147:0:5755:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c8354d1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2125b9b3-626e-4cbe-be83-fb446e976ce2+47:11394:x1875765413088256:12345-192.168.201.39@tcp:101:lfs.0 Request processed in 3839us (4090us total) trans 4294967445 rc 301/301 00000100:00100000:3.0:1788869452.842157:0:5755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 160 00000100:00100000:2.0:1788869452.845341:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1788869452.845446:0:5758:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765413088512 00000100:00100000:3.0:1788869452.845459:0:5758:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765413088512 00000100:00100000:3.0:1788869452.845535:0:5758:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 44 00000100:00100000:3.0:1788869452.845548:0:5758:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c81876a050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2125b9b3-626e-4cbe-be83-fb446e976ce2+47:11394:x1875765413088512:12345-192.168.201.39@tcp:35:lfs.0 00000100:00100000:3.0:1788869452.845908:0:5758:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c81876a050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2125b9b3-626e-4cbe-be83-fb446e976ce2+48:11394:x1875765413088512:12345-192.168.201.39@tcp:35:lfs.0 Request processed in 361us (575us total) trans 4294967446 rc 0/0 00000100:00100000:3.0:1788869452.845917:0:5758:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 44 00000100:00100000:1.0:1788869452.888942:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1788869452.889131:0:5757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765413088768 00000100:00100000:2.0:1788869452.889146:0:5757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765413088768 00000100:00100000:2.0:1788869452.889220:0:5757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 161 00000100:00100000:2.0:1788869452.889236:0:5757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c835156d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2125b9b3-626e-4cbe-be83-fb446e976ce2+48:11400:x1875765413088768:12345-192.168.201.39@tcp:101:bash.0 00010000:00010000:2.0:1788869452.889333:0:5757:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788869452.889363:0:5757:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94c805039e00/0x3d2d1916761d6f33 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x375c010249035aaf expref: -99 pid: 5757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869452.889497:0:5757:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94c805038800/0x3d2d1916761d6f3a lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869452.889517:0:5757:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504c600/0x3d2d1916761d6f1e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0x375c010249035aa1 expref: 49 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869452.889527:0:5757:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff94c805038800/0x3d2d1916761d6f3a lrc: 4/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869452.889594:0:5757:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504c600/0x3d2d1916761d6f1e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.39@tcp remote: 0x375c010249035aa1 expref: 49 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869452.889612:0:5757:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504c600/0x3d2d1916761d6f1e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.39@tcp remote: 0x375c010249035aa1 expref: 49 pid: 5786 timeout: 301 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788869452.889629:0:5757:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94c835a3c380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5757:1875765421468928:192.168.201.39@tcp:104: 00000100:00100000:2.0:1788869452.889757:0:5757:0:(client.c:2702:ptlrpc_set_wait()) set ffff94c805068240 going to sleep for 11 seconds 00000100:00100000:2.0:1788869452.900453:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1788869452.900780:0:5741:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765413088896 00000100:00100000:3.0:1788869452.900792:0:5741:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765413088896 00010000:00010000:3.0:1788869452.900842:0:5741:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504c600/0x3d2d1916761d6f1e lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.39@tcp remote: 0x375c010249035aa1 expref: 50 pid: 5786 timeout: 301 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788869452.900890:0:5741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 69 00000100:00100000:3.0:1788869452.900916:0:5741:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c835a3c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2125b9b3-626e-4cbe-be83-fb446e976ce2+50:2348:x1875765413088896:12345-192.168.201.39@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788869452.900935:0:5741:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788869452.900943:0:5741:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504c600/0x3d2d1916761d6f1e lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.39@tcp remote: 0x375c010249035aa1 expref: 50 pid: 5786 timeout: 301 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869452.900958:0:5741:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504c600/0x3d2d1916761d6f1e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.39@tcp remote: 0x375c010249035aa1 expref: 50 pid: 5786 timeout: 301 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869452.900986:0:5741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff94c802f3fa00) 00010000:00010000:3.0:1788869452.900992:0:5741:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff94c805038800/0x3d2d1916761d6f3a lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869452.901004:0:5741:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff94c805038800/0x3d2d1916761d6f3a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869452.901013:0:5741:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94c805038800/0x3d2d1916761d6f3a lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869452.901035:0:5741:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788869452.901099:0:5741:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c835a3c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2125b9b3-626e-4cbe-be83-fb446e976ce2+50:2348:x1875765413088896:12345-192.168.201.39@tcp:103:ldlm_bl.0 Request processed in 184us (660us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869452.901107:0:5741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 69 00010000:00010000:1.0:1788869452.902118:0:5757:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504c600/0x3d2d1916761d6f1e lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.39@tcp remote: 0x375c010249035aa1 expref: 49 pid: 5786 timeout: 301 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788869452.902142:0:5757:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94c835a3c380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5757:1875765421468928:192.168.201.39@tcp:104: 00010000:00010000:1.0:1788869452.902169:0:5757:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff94c805038800/0x3d2d1916761d6f3a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869452.902178:0:5757:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff94c805038800/0x3d2d1916761d6f3a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869452.902185:0:5757:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94c805038800/0x3d2d1916761d6f3a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5757 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788869452.902225:0:5757:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 1234567 00010000:00010000:1.0:1788869452.902702:0:5757:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94c805039e00/0x3d2d1916761d6f33 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0x375c010249035aaf expref: 50 pid: 5757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869452.902721:0:5757:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94c805038800/0x3d2d1916761d6f3a lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0x375c010249035aaf expref: 49 pid: 5757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869452.902730:0:5757:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff94c802f3fa00) 00010000:00010000:1.0:1788869452.902733:0:5757:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1788869452.902736:0:5757:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94c805038800, rc 0) 00000100:00100000:1.0:1788869452.902837:0:5757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c835156d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2125b9b3-626e-4cbe-be83-fb446e976ce2+49:11400:x1875765413088768:12345-192.168.201.39@tcp:101:bash.0 Request processed in 13605us (13917us total) trans 4294967447 rc 0/0 00000100:00100000:1.0:1788869452.902846:0:5757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 161 00000100:00100000:2.0:1788869452.905046:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1788869452.905170:0:5756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765413089152 00000100:00100000:0.0:1788869452.905183:0:5756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765413089152 00000100:00100000:0.0:1788869452.905424:0:5756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 162 00000100:00100000:0.0:1788869452.905437:0:5756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c835a3f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2125b9b3-626e-4cbe-be83-fb446e976ce2+49:11400:x1875765413089152:12345-192.168.201.39@tcp:36:bash.0 00010000:00010000:0.0:1788869452.905807:0:5756:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94c81a583400/0x3d2d1916761d6f48 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869452.905829:0:5756:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94c81a583400/0x3d2d1916761d6f48 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869452.905843:0:5756:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94c81a583400/0x3d2d1916761d6f48 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788869452.905907:0:5756:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967448 00000004:00010000:0.0:1788869452.905932:0:5756:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000ff0146cd reply state 0000000038066389 transno 4294967449 ns: mdt-lustre-MDT0000_UUID lock: ffff94c81a583400/0x3d2d1916761d6f48 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788869452.905942:0:5756:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788869452.906108:0:5756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c835a3f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2125b9b3-626e-4cbe-be83-fb446e976ce2+52:11400:x1875765413089152:12345-192.168.201.39@tcp:36:bash.0 Request processed in 672us (1072us total) trans 4294967449 rc 0/0 00000100:00100000:0.0:1788869452.906117:0:5756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 162 00000020:00080000:0.0:1788869452.906122:0:5756:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1788869452.908495:0:3270:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94c81a583400/0x3d2d1916761d6f48 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869452.908517:0:3270:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94c81a583400/0x3d2d1916761d6f48 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869452.908567:0:3270:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94c81a583400/0x3d2d1916761d6f48 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869452.908575:0:3270:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94c81a583400 already unused, calling callback (ffffffffc21124f0) 00010000:00010000:2.0:1788869452.908581:0:3270:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94c81a583400/0x3d2d1916761d6f48 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869452.908590:0:3270:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94c81a583400/0x3d2d1916761d6f48 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869452.908610:0:3270:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff94c802f3fa00) 00010000:00010000:2.0:1788869452.908614:0:3270:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788869452.908619:0:3270:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94c81a583400/0x3d2d1916761d6f48 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869452.908626:0:3270:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94c81a583400/0x3d2d1916761d6f48 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788869452.915297:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1788869452.915655:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765413089280 00000100:00100000:3.0:1788869452.915670:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765413089280 00000100:00100000:3.0:1788869452.915750:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 163 00000100:00100000:3.0:1788869452.915761:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c835a3dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2125b9b3-626e-4cbe-be83-fb446e976ce2+51:11400:x1875765413089280:12345-192.168.201.39@tcp:101:bash.0 00010000:00010000:3.0:1788869452.915792:0:5786:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788869452.915818:0:5786:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504c800/0x3d2d1916761d6f4f lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x375c010249035ab6 expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869452.916057:0:5786:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504d600/0x3d2d1916761d6f56 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869452.916076:0:5786:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff94c805038800/0x3d2d1916761d6f3a lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0x375c010249035aaf expref: 52 pid: 5757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869452.916085:0:5786:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504d600/0x3d2d1916761d6f56 lrc: 4/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869452.916129:0:5786:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff94c805038800/0x3d2d1916761d6f3a lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.39@tcp remote: 0x375c010249035aaf expref: 52 pid: 5757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869452.916145:0:5786:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff94c805038800/0x3d2d1916761d6f3a lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.39@tcp remote: 0x375c010249035aaf expref: 52 pid: 5757 timeout: 301 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788869452.916161:0:5786:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94c835150700 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:5786:1875765421469056:192.168.201.39@tcp:104: 00000100:00100000:3.0:1788869452.916346:0:5786:0:(client.c:2702:ptlrpc_set_wait()) set ffff94c81075a600 going to sleep for 11 seconds 00000100:00100000:3.0:1788869452.917898:0:5786:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94c835150700 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:5786:1875765421469056:192.168.201.39@tcp:104: 00010000:00010000:3.0:1788869452.917930:0:5786:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504d600/0x3d2d1916761d6f56 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788869452.918497:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1788869452.918598:0:7448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765413089408 00000100:00100000:1.0:1788869452.918607:0:7448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765413089408 00010000:00010000:1.0:1788869452.918651:0:7448:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff94c805038800/0x3d2d1916761d6f3a lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.39@tcp remote: 0x375c010249035aaf expref: 53 pid: 5757 timeout: 301 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788869452.918733:0:7448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 70 00000100:00100000:1.0:1788869452.918743:0:7448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c835a3ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:2125b9b3-626e-4cbe-be83-fb446e976ce2+53:2348:x1875765413089408:12345-192.168.201.39@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788869452.918760:0:7448:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788869452.918767:0:7448:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff94c805038800/0x3d2d1916761d6f3a lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.39@tcp remote: 0x375c010249035aaf expref: 53 pid: 5757 timeout: 301 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869452.918780:0:7448:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff94c805038800/0x3d2d1916761d6f3a lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.39@tcp remote: 0x375c010249035aaf expref: 53 pid: 5757 timeout: 301 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869452.918830:0:7448:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94c805038800/0x3d2d1916761d6f3a lrc: 0/0,0 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.39@tcp remote: 0x375c010249035aaf expref: 53 pid: 5757 timeout: 301 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869452.918850:0:7448:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff94c802f3fa00) 00010000:00010000:1.0:1788869452.918856:0:7448:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504d600/0x3d2d1916761d6f56 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869452.918867:0:7448:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504d600/0x3d2d1916761d6f56 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869452.918876:0:7448:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504d600/0x3d2d1916761d6f56 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869452.918901:0:7448:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788869452.918970:0:7448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c835a3ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:2125b9b3-626e-4cbe-be83-fb446e976ce2+52:2348:x1875765413089408:12345-192.168.201.39@tcp:103:ldlm_bl.0 Request processed in 227us (474us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869452.918979:0:7448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 70 00010000:00010000:3.0:1788869452.919035:0:5786:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504d600/0x3d2d1916761d6f56 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869452.919043:0:5786:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504d600/0x3d2d1916761d6f56 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788869452.919100:0:5786:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:3.0:1788869452.919113:0:5786:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1788869452.919142:0:5786:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504d600/0x3d2d1916761d6f56 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869452.919177:0:5786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504c800/0x3d2d1916761d6f4f lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0x375c010249035ab6 expref: 52 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869452.919193:0:5786:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504d600/0x3d2d1916761d6f56 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0x375c010249035ab6 expref: 51 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869452.919201:0:5786:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff94c802f3fa00) 00010000:00010000:3.0:1788869452.919204:0:5786:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788869452.919206:0:5786:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94c83504d600, rc 0) 00000100:00100000:3.0:1788869452.919236:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c835a3dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2125b9b3-626e-4cbe-be83-fb446e976ce2+51:11400:x1875765413089280:12345-192.168.201.39@tcp:101:bash.0 Request processed in 3477us (3956us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869452.919243:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 163 00000100:00100000:0.0:1788869452.923111:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1788869452.923220:0:11820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765413089664 00000100:00100000:1.0:1788869452.923235:0:11820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765413089664 00000100:00100000:1.0:1788869452.923327:0:11820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 45 00000100:00100000:1.0:1788869452.923337:0:11820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c8354d0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:2125b9b3-626e-4cbe-be83-fb446e976ce2+51:11400:x1875765413089664:12345-192.168.201.39@tcp:35:bash.0 00000100:00100000:1.0:1788869452.923645:0:11820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c8354d0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:2125b9b3-626e-4cbe-be83-fb446e976ce2+52:11400:x1875765413089664:12345-192.168.201.39@tcp:35:bash.0 Request processed in 308us (547us total) trans 4294967450 rc 0/0 00000100:00100000:1.0:1788869452.923653:0:11820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 45 00000100:00100000:0.0:1788869452.974156:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1788869452.974279:0:5755:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765413089920 00000100:00100000:3.0:1788869452.974293:0:5755:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765413089920 00000100:00100000:3.0:1788869452.974368:0:5755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 164 00000100:00100000:3.0:1788869452.974380:0:5755:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c8354d1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2125b9b3-626e-4cbe-be83-fb446e976ce2+52:11410:x1875765413089920:12345-192.168.201.39@tcp:101:lfs.0 00010000:00010000:3.0:1788869452.974413:0:5755:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788869452.974441:0:5755:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504c800/0x3d2d1916761d6f5d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x375c010249035abd expref: -99 pid: 5755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788869452.974600:0:5755:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00010000:00010000:3.0:1788869452.974757:0:5755:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504c800/0x3d2d1916761d6f5d lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0x375c010249035abd expref: 54 pid: 5755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869452.974774:0:5755:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff94c819394300) 00010000:00010000:3.0:1788869452.974793:0:5755:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788869452.974799:0:5755:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504c800/0x3d2d1916761d6f5d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.39@tcp remote: 0x375c010249035abd expref: 54 pid: 5755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869452.974815:0:5755:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94c83504c800, rc 0) 00000100:00100000:3.0:1788869452.974896:0:5755:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c8354d1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2125b9b3-626e-4cbe-be83-fb446e976ce2+53:11410:x1875765413089920:12345-192.168.201.39@tcp:101:lfs.0 Request processed in 519us (758us total) trans 4294967451 rc 301/301 00000100:00100000:3.0:1788869452.974960:0:5755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 164 00000100:00100000:2.0:1788869452.986446:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1788869452.986534:0:5757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765413090048 00000100:00100000:1.0:1788869452.986547:0:5757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765413090048 00000100:00100000:1.0:1788869452.986632:0:5757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 165 00000100:00100000:1.0:1788869452.986657:0:5757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c835a3d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2125b9b3-626e-4cbe-be83-fb446e976ce2+53:11410:x1875765413090048:12345-192.168.201.39@tcp:34:lfs.0 00010000:00010000:1.0:1788869452.986763:0:5757:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff94c83fde6200/0x3d2d1916761d6f6b lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869452.986784:0:5757:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94c83fde6200/0x3d2d1916761d6f6b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869452.986797:0:5757:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94c83fde6200/0x3d2d1916761d6f6b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869452.986812:0:5757:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94c83fde7400/0x3d2d1916761d6f72 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869452.986819:0:5757:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94c83fde7400/0x3d2d1916761d6f72 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869452.986825:0:5757:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94c83fde7400/0x3d2d1916761d6f72 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869452.987072:0:5757:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94c83fde7000/0x3d2d1916761d6f79 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869452.987083:0:5757:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94c83fde7000/0x3d2d1916761d6f79 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869452.987091:0:5757:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94c83fde7000/0x3d2d1916761d6f79 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5757 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788869452.987142:0:5757:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff94c83fde7000/0x3d2d1916761d6f79 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869452.987158:0:5757:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff94c83fde6200/0x3d2d1916761d6f6b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869452.987171:0:5757:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94c83fde6200/0x3d2d1916761d6f6b lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869452.987179:0:5757:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94c83fde6200/0x3d2d1916761d6f6b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869452.987185:0:5757:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94c83fde6200 already unused, calling callback (ffffffffc21124f0) 00010000:00010000:1.0:1788869452.987191:0:5757:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94c83fde6200/0x3d2d1916761d6f6b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869452.987199:0:5757:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94c83fde6200/0x3d2d1916761d6f6b lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869452.987213:0:5757:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff94c802f3fd00) 00010000:00010000:1.0:1788869452.987216:0:5757:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788869452.987221:0:5757:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94c83fde6200/0x3d2d1916761d6f6b lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869452.987228:0:5757:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94c83fde6200/0x3d2d1916761d6f6b lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869452.987243:0:5757:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94c83fde7400/0x3d2d1916761d6f72 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869452.987307:0:5757:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94c83fde7400/0x3d2d1916761d6f72 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869452.987314:0:5757:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94c83fde7400/0x3d2d1916761d6f72 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869452.987318:0:5757:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94c83fde7400 already unused, calling callback (ffffffffc21124f0) 00010000:00010000:1.0:1788869452.987328:0:5757:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94c83fde7400/0x3d2d1916761d6f72 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869452.987334:0:5757:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94c83fde7400/0x3d2d1916761d6f72 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869452.987342:0:5757:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff94c81a585800) 00010000:00010000:1.0:1788869452.987345:0:5757:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788869452.987348:0:5757:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94c83fde7400/0x3d2d1916761d6f72 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869452.987354:0:5757:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94c83fde7400/0x3d2d1916761d6f72 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869452.987369:0:5757:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94c83fde7000/0x3d2d1916761d6f79 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869452.987374:0:5757:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94c83fde7000/0x3d2d1916761d6f79 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869452.987380:0:5757:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94c83fde7000/0x3d2d1916761d6f79 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869452.987385:0:5757:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94c83fde7000 already unused, calling callback (ffffffffc21124f0) 00010000:00010000:1.0:1788869452.987388:0:5757:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94c83fde7000/0x3d2d1916761d6f79 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869452.987393:0:5757:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94c83fde7000/0x3d2d1916761d6f79 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869452.987400:0:5757:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff94c802f3fa00) 00010000:00010000:1.0:1788869452.987402:0:5757:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788869452.987411:0:5757:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94c83fde7000/0x3d2d1916761d6f79 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869452.987417:0:5757:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94c83fde7000/0x3d2d1916761d6f79 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5757 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788869452.987506:0:5757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c835a3d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2125b9b3-626e-4cbe-be83-fb446e976ce2+53:11410:x1875765413090048:12345-192.168.201.39@tcp:34:lfs.0 Request processed in 849us (1072us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869452.987515:0:5757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 165 00000100:00100000:2.0:1788869452.990374:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1788869452.990476:0:5758:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765413090304 00000100:00100000:3.0:1788869452.990488:0:5758:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765413090304 00000100:00100000:3.0:1788869452.990565:0:5758:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 46 00000100:00100000:3.0:1788869452.990577:0:5758:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c835a3f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2125b9b3-626e-4cbe-be83-fb446e976ce2+53:11410:x1875765413090304:12345-192.168.201.39@tcp:35:lfs.0 00000100:00100000:3.0:1788869452.990909:0:5758:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c835a3f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2125b9b3-626e-4cbe-be83-fb446e976ce2+54:11410:x1875765413090304:12345-192.168.201.39@tcp:35:lfs.0 Request processed in 323us (537us total) trans 4294967452 rc 0/0 00000100:00100000:3.0:1788869452.990918:0:5758:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 46 00000100:00100000:0.0:1788869453.021201:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1788869453.022915:0:5755:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765413090560 00000100:00100000:3.0:1788869453.022934:0:5755:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765413090560 00000100:00100000:3.0:1788869453.023081:0:5755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 166 00000100:00100000:3.0:1788869453.023096:0:5755:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c8354d2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2125b9b3-626e-4cbe-be83-fb446e976ce2+54:11413:x1875765413090560:12345-192.168.201.39@tcp:101:lfs.0 00010000:00010000:3.0:1788869453.023132:0:5755:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788869453.023163:0:5755:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504c800/0x3d2d1916761d6f80 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x375c010249035ac4 expref: -99 pid: 5755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869453.023295:0:5755:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504ce00/0x3d2d1916761d6f87 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869453.023314:0:5755:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504ce00/0x3d2d1916761d6f87 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869453.023347:0:5755:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504ce00/0x3d2d1916761d6f87 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869453.023365:0:5755:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504ca00/0x3d2d1916761d6f8e lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869453.023374:0:5755:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504ca00/0x3d2d1916761d6f8e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869453.023381:0:5755:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504ca00/0x3d2d1916761d6f8e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869453.023575:0:5755:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504c600/0x3d2d1916761d6f95 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869453.023585:0:5755:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504c600/0x3d2d1916761d6f95 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869453.023593:0:5755:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504c600/0x3d2d1916761d6f95 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788869453.023606:0:5755:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:3.0:1788869453.023735:0:5755:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504ce00/0x3d2d1916761d6f87 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869453.023743:0:5755:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504ce00/0x3d2d1916761d6f87 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869453.023750:0:5755:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504ce00/0x3d2d1916761d6f87 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869453.023758:0:5755:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94c83504ce00 already unused, calling callback (ffffffffc21124f0) 00010000:00010000:3.0:1788869453.023769:0:5755:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504ce00/0x3d2d1916761d6f87 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869453.023778:0:5755:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504ce00/0x3d2d1916761d6f87 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869453.023792:0:5755:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff94c802f3fd00) 00010000:00010000:3.0:1788869453.023797:0:5755:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788869453.023802:0:5755:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504ce00/0x3d2d1916761d6f87 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869453.023810:0:5755:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504ce00/0x3d2d1916761d6f87 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869453.023826:0:5755:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504ca00/0x3d2d1916761d6f8e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869453.023833:0:5755:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504ca00/0x3d2d1916761d6f8e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869453.023839:0:5755:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504ca00/0x3d2d1916761d6f8e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869453.023845:0:5755:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94c83504ca00 already unused, calling callback (ffffffffc21124f0) 00010000:00010000:3.0:1788869453.023848:0:5755:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504ca00/0x3d2d1916761d6f8e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869453.023855:0:5755:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504ca00/0x3d2d1916761d6f8e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869453.023863:0:5755:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff94c819394b00) 00010000:00010000:3.0:1788869453.023865:0:5755:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788869453.023874:0:5755:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504ca00/0x3d2d1916761d6f8e lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869453.023881:0:5755:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504ca00/0x3d2d1916761d6f8e lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869453.023934:0:5755:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504c800/0x3d2d1916761d6f80 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0x375c010249035ac4 expref: 57 pid: 5755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869453.023950:0:5755:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504c600/0x3d2d1916761d6f95 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0x375c010249035ac4 expref: 56 pid: 5755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869453.023958:0:5755:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff94c802f3fa00) 00010000:00010000:3.0:1788869453.023960:0:5755:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788869453.023962:0:5755:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94c83504c600, rc 0) 00000100:00100000:3.0:1788869453.024054:0:5755:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c8354d2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2125b9b3-626e-4cbe-be83-fb446e976ce2+56:11413:x1875765413090560:12345-192.168.201.39@tcp:101:lfs.0 Request processed in 962us (2869us total) trans 4294967453 rc 0/0 00000100:00100000:3.0:1788869453.024064:0:5755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 166 00000100:00100000:0.0:1788869453.034218:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1788869453.034294:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1788869453.034328:0:5739:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765413090816 00000100:00100000:0.0:1788869453.034340:0:5739:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765413090816 00000100:00100000:0.0:1788869453.034432:0:5739:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 11 00000100:00100000:0.0:1788869453.034445:0:5739:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c8354d0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2125b9b3-626e-4cbe-be83-fb446e976ce2+56:2348:x1875765413090816:12345-192.168.201.39@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788869453.034468:0:5739:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788869453.034505:0:5739:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504c600/0x3d2d1916761d6f95 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.39@tcp remote: 0x375c010249035ac4 expref: 56 pid: 5755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869453.034533:0:5739:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff94c802f3fa00) 00010000:00010000:0.0:1788869453.034539:0:5739:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788869453.034621:0:5739:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c8354d0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2125b9b3-626e-4cbe-be83-fb446e976ce2+55:2348:x1875765413090816:12345-192.168.201.39@tcp:103:ldlm_bl.0 Request processed in 178us (325us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869453.034629:0:5739:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 11 00000100:00100000:3.0:1788869453.035465:0:5757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765413090688 00000100:00100000:3.0:1788869453.035473:0:5757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765413090688 00000100:00100000:3.0:1788869453.035519:0:5757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 167 00000100:00100000:3.0:1788869453.035528:0:5757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c8354d2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2125b9b3-626e-4cbe-be83-fb446e976ce2+55:11413:x1875765413090688:12345-192.168.201.39@tcp:54:lfs.0 00010000:00010000:3.0:1788869453.035614:0:5757:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504c200/0x3d2d1916761d6fa3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869453.035632:0:5757:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504c200/0x3d2d1916761d6fa3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869453.035646:0:5757:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504c200/0x3d2d1916761d6fa3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869453.035709:0:5757:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504c200/0x3d2d1916761d6fa3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869453.035716:0:5757:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504c200/0x3d2d1916761d6fa3 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869453.035722:0:5757:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504c200/0x3d2d1916761d6fa3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869453.035729:0:5757:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94c83504c200 already unused, calling callback (ffffffffc21124f0) 00010000:00010000:3.0:1788869453.035734:0:5757:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504c200/0x3d2d1916761d6fa3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869453.035742:0:5757:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504c200/0x3d2d1916761d6fa3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869453.035752:0:5757:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff94c802f3fa00) 00010000:00010000:3.0:1788869453.035755:0:5757:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788869453.035759:0:5757:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504c200/0x3d2d1916761d6fa3 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869453.035766:0:5757:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504c200/0x3d2d1916761d6fa3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5757 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788869453.035818:0:5757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c8354d2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2125b9b3-626e-4cbe-be83-fb446e976ce2+55:11413:x1875765413090688:12345-192.168.201.39@tcp:54:lfs.0 Request processed in 290us (1619us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869453.035825:0:5757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 167 00000100:00100000:0.0:1788869453.040198:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1788869453.040347:0:5759:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765413091072 00000100:00100000:3.0:1788869453.040360:0:5759:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765413091072 00000100:00100000:3.0:1788869453.040434:0:5759:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 47 00000100:00100000:3.0:1788869453.040465:0:5759:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c8354d3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2125b9b3-626e-4cbe-be83-fb446e976ce2+55:11413:x1875765413091072:12345-192.168.201.39@tcp:35:lfs.0 00000100:00100000:3.0:1788869453.040794:0:5759:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c8354d3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2125b9b3-626e-4cbe-be83-fb446e976ce2+56:11413:x1875765413091072:12345-192.168.201.39@tcp:35:lfs.0 Request processed in 331us (610us total) trans 4294967454 rc 0/0 00000100:00100000:3.0:1788869453.040807:0:5759:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 47 00000100:00100000:2.0:1788869453.150828:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1788869453.151030:0:5756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765413091328 00000100:00100000:0.0:1788869453.151041:0:5756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765413091328 00000100:00100000:0.0:1788869453.151186:0:5756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 168 00000100:00100000:0.0:1788869453.151199:0:5756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c835a3c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2125b9b3-626e-4cbe-be83-fb446e976ce2+56:11431:x1875765413091328:12345-192.168.201.39@tcp:101:cat.0 00010000:00010000:0.0:1788869453.151233:0:5756:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788869453.151296:0:5756:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94c81a582a00/0x3d2d1916761d6faa lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x375c010249035acb expref: -99 pid: 5756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869453.151422:0:5756:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff94c81a582200/0x3d2d1916761d6fb1 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869453.151441:0:5756:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94c81a582200/0x3d2d1916761d6fb1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869453.151471:0:5756:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94c81a582200/0x3d2d1916761d6fb1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788869453.151486:0:5756:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:0.0:1788869453.151657:0:5756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94c81a582a00/0x3d2d1916761d6faa lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0x375c010249035acb expref: 59 pid: 5756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869453.151679:0:5756:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94c81a582200/0x3d2d1916761d6fb1 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0x375c010249035acb expref: 58 pid: 5756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869453.151689:0:5756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff94c802f3fa00) 00010000:00010000:0.0:1788869453.151692:0:5756:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:0.0:1788869453.151696:0:5756:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94c81a582200, rc 0) 00000100:00100000:0.0:1788869453.151777:0:5756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c835a3c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2125b9b3-626e-4cbe-be83-fb446e976ce2+58:11431:x1875765413091328:12345-192.168.201.39@tcp:101:cat.0 Request processed in 580us (960us total) trans 4294967455 rc 0/0 00000100:00100000:0.0:1788869453.151785:0:5756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 168 00000100:00100000:0.0:1788869453.168872:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1788869453.169286:0:5757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765413091456 00000100:00100000:3.0:1788869453.169301:0:5757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765413091456 00000100:00100000:3.0:1788869453.169421:0:5757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 169 00000100:00100000:3.0:1788869453.169435:0:5757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c8354d2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2125b9b3-626e-4cbe-be83-fb446e976ce2+58:11432:x1875765413091456:12345-192.168.201.39@tcp:101:lfs.0 00010000:00010000:3.0:1788869453.169469:0:5757:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788869453.169495:0:5757:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504c200/0x3d2d1916761d6fbf lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x375c010249035ad2 expref: -99 pid: 5757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869453.169616:0:5757:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504c800/0x3d2d1916761d6fc6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869453.169635:0:5757:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504c800/0x3d2d1916761d6fc6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869453.169648:0:5757:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504c800/0x3d2d1916761d6fc6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5757 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788869453.169724:0:5757:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00000004:00200000:3.0:1788869453.169729:0:5757:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:3.0:1788869453.169753:0:5757:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504c800/0x3d2d1916761d6fc6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869453.169782:0:5757:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504c200/0x3d2d1916761d6fbf lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0x375c010249035ad2 expref: 60 pid: 5757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869453.169824:0:5757:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504c800/0x3d2d1916761d6fc6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0x375c010249035ad2 expref: 59 pid: 5757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869453.169845:0:5757:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff94c802f3fd00) 00010000:00010000:3.0:1788869453.169848:0:5757:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788869453.169852:0:5757:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94c83504c800, rc 0) 00000100:00100000:3.0:1788869453.169933:0:5757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c8354d2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2125b9b3-626e-4cbe-be83-fb446e976ce2+59:11432:x1875765413091456:12345-192.168.201.39@tcp:101:lfs.0 Request processed in 501us (1076us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869453.169941:0:5757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 169 00000100:00100000:1.0:1788869453.177770:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1788869453.177830:0:11820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765413091840 00000100:00100000:2.0:1788869453.177884:0:11820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765413091840 00000100:00100000:2.0:1788869453.177988:0:11820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 48 00000100:00100000:2.0:1788869453.177998:0:11820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c835155500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:2125b9b3-626e-4cbe-be83-fb446e976ce2+59:11432:x1875765413091840:12345-192.168.201.39@tcp:35:lfs.0 00000100:00100000:2.0:1788869453.178461:0:11820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c835155500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:2125b9b3-626e-4cbe-be83-fb446e976ce2+60:11432:x1875765413091840:12345-192.168.201.39@tcp:35:lfs.0 Request processed in 463us (705us total) trans 4294967456 rc 0/0 00000100:00100000:2.0:1788869453.178489:0:11820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 48 00000100:00100000:2.0:1788869453.182155:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1788869453.182334:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765413091968 00000100:00100000:0.0:1788869453.182358:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765413091968 00000100:00100000:0.0:1788869453.182446:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 12 00000100:00100000:0.0:1788869453.182458:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c810ef1450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2125b9b3-626e-4cbe-be83-fb446e976ce2+60:11432:x1875765413091968:12345-192.168.201.39@tcp:103:lfs.0 00010000:00010000:0.0:1788869453.182480:0:5788:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:0.0:1788869453.182514:0:5788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504d600/0x3d2d1916761d6f56 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.39@tcp remote: 0x375c010249035ab6 expref: 60 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869453.183920:0:5788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94c81a582200/0x3d2d1916761d6fb1 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.39@tcp remote: 0x375c010249035acb expref: 59 pid: 5756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869453.183970:0:5788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94c805038000/0x3d2d1916761d6e61 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.39@tcp remote: 0x375c010249035a77 expref: 58 pid: 5757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869453.183984:0:5788:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff94c802f3fa00) 00010000:00010000:0.0:1788869453.183997:0:5788:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788869453.184097:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c810ef1450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2125b9b3-626e-4cbe-be83-fb446e976ce2+57:11432:x1875765413091968:12345-192.168.201.39@tcp:103:lfs.0 Request processed in 1639us (1954us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869453.184109:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 12 00000100:00100000:0.0:1788869453.191660:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1788869453.191766:0:5755:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765413092096 00000100:00100000:3.0:1788869453.191779:0:5755:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765413092096 00000100:00100000:3.0:1788869453.191889:0:5755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 170 00000100:00100000:3.0:1788869453.191903:0:5755:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c8354d0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2125b9b3-626e-4cbe-be83-fb446e976ce2+57:11432:x1875765413092096:12345-192.168.201.39@tcp:58:lfs.0 00010000:00010000:3.0:1788869453.192048:0:5755:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504c200/0x3d2d1916761d6fcd lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869453.192068:0:5755:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504c200/0x3d2d1916761d6fcd lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869453.192093:0:5755:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504c200/0x3d2d1916761d6fcd lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788869453.192451:0:5755:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].4, 136 off8736 00000100:00100000:3.0:1788869453.192568:0:5755:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c8354d0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2125b9b3-626e-4cbe-be83-fb446e976ce2+57:11432:x1875765413092096:12345-192.168.201.39@tcp:58:lfs.0 Request processed in 667us (920us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869453.192575:0:5755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 170 00000100:00100000:1.0:1788869453.206460:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1788869453.206591:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765413092224 00000100:00100000:0.0:1788869453.206605:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765413092224 00000100:00100000:0.0:1788869453.206677:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 171 00000100:00100000:0.0:1788869453.206690:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c835157100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2125b9b3-626e-4cbe-be83-fb446e976ce2+57:11434:x1875765413092224:12345-192.168.201.39@tcp:101:lfs.0 00010000:00010000:0.0:1788869453.206727:0:5786:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788869453.206760:0:5786:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94c81a582200/0x3d2d1916761d6fd4 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x375c010249035ad9 expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869453.206883:0:5786:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff94c81a582a00/0x3d2d1916761d6fdb lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869453.206900:0:5786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94c81a582a00/0x3d2d1916761d6fdb lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869453.206915:0:5786:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94c81a582a00/0x3d2d1916761d6fdb lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869453.206932:0:5786:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94c81a583000/0x3d2d1916761d6fe2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869453.206946:0:5786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94c81a583000/0x3d2d1916761d6fe2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869453.206953:0:5786:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94c81a583000/0x3d2d1916761d6fe2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869453.207097:0:5786:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94c81a583400/0x3d2d1916761d6fe9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869453.207107:0:5786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94c81a583400/0x3d2d1916761d6fe9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869453.207115:0:5786:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94c81a583400/0x3d2d1916761d6fe9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788869453.207159:0:5786:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:0.0:1788869453.207165:0:5786:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1788869453.207186:0:5786:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff94c81a583400/0x3d2d1916761d6fe9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869453.207198:0:5786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94c81a583400/0x3d2d1916761d6fe9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869453.207207:0:5786:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff94c81a582a00/0x3d2d1916761d6fdb lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869453.207213:0:5786:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94c81a582a00/0x3d2d1916761d6fdb lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869453.207220:0:5786:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94c81a582a00/0x3d2d1916761d6fdb lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869453.207240:0:5786:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94c81a582a00 already unused, calling callback (ffffffffc21124f0) 00010000:00010000:0.0:1788869453.207246:0:5786:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94c81a582a00/0x3d2d1916761d6fdb lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869453.207291:0:5786:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94c81a582a00/0x3d2d1916761d6fdb lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869453.207306:0:5786:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff94c802f3fd00) 00010000:00010000:0.0:1788869453.207309:0:5786:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788869453.207315:0:5786:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94c81a582a00/0x3d2d1916761d6fdb lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869453.207322:0:5786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94c81a582a00/0x3d2d1916761d6fdb lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869453.207337:0:5786:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94c81a583000/0x3d2d1916761d6fe2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869453.207343:0:5786:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94c81a583000/0x3d2d1916761d6fe2 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869453.207349:0:5786:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94c81a583000/0x3d2d1916761d6fe2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869453.207354:0:5786:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94c81a583000 already unused, calling callback (ffffffffc21124f0) 00010000:00010000:0.0:1788869453.207357:0:5786:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94c81a583000/0x3d2d1916761d6fe2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869453.207363:0:5786:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94c81a583000/0x3d2d1916761d6fe2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869453.207382:0:5786:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff94c803990f00) 00010000:00010000:0.0:1788869453.207384:0:5786:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788869453.207387:0:5786:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94c81a583000/0x3d2d1916761d6fe2 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869453.207392:0:5786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94c81a583000/0x3d2d1916761d6fe2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869453.207426:0:5786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94c81a582200/0x3d2d1916761d6fd4 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0x375c010249035ad9 expref: 59 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869453.207441:0:5786:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94c81a583400/0x3d2d1916761d6fe9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0x375c010249035ad9 expref: 58 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869453.207449:0:5786:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff94c819394b00) 00010000:00010000:0.0:1788869453.207451:0:5786:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788869453.207454:0:5786:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94c81a583400, rc 0) 00000100:00100000:0.0:1788869453.207527:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c835157100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2125b9b3-626e-4cbe-be83-fb446e976ce2+58:11434:x1875765413092224:12345-192.168.201.39@tcp:101:lfs.0 Request processed in 840us (1093us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869453.207536:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 171 00010000:00010000:0.0:1788869453.211446:0:5742:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788869453.230866:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1788869453.230901:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1788869453.230934:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1788869453.230947:0:5749:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765413092352 00000100:00100000:1.0:1788869453.230961:0:5749:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765413092352 00000100:00100000:2.0:1788869453.230966:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1788869453.231037:0:7884:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765413092480 00000100:00100000:1.0:1788869453.231037:0:5749:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 270 00000100:00100000:2.0:1788869453.231044:0:6546:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765413092608 00000100:00100000:0.0:1788869453.231047:0:5756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765413092736 00000100:00100000:2.0:1788869453.231048:0:6546:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765413092608 00000100:00100000:1.0:1788869453.231053:0:5749:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c81f14b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3cca3acf-4935-4d0d-9982-d5d931f1c86b+13:2346:x1875765413092352:12345-192.168.201.39@tcp:400:kworker.0 00000100:00100000:0.0:1788869453.231055:0:5756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765413092736 00000100:00100000:3.0:1788869453.231059:0:7884:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765413092480 00000100:00100000:0.0:1788869453.231123:0:5756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 94 00000100:00100000:0.0:1788869453.231133:0:5756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c835a3d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:10cd6f3c-009b-4acc-9ca5-e50cb17e412c+5:2345:x1875765413092736:12345-192.168.201.39@tcp:400:kworker.0 00000100:00100000:1.0:1788869453.231156:0:5749:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c81f14b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3cca3acf-4935-4d0d-9982-d5d931f1c86b+13:2346:x1875765413092352:12345-192.168.201.39@tcp:400:kworker.0 Request processed in 107us (301us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869453.231167:0:5749:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 270 00000100:00100000:0.0:1788869453.231175:0:5756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c835a3d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:10cd6f3c-009b-4acc-9ca5-e50cb17e412c+5:2345:x1875765413092736:12345-192.168.201.39@tcp:400:kworker.0 Request processed in 44us (238us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869453.231206:0:5756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 94 00000100:00080000:1.0:1788869453.231284:0:5751:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788869453.231291:0:5751:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788869453.231295:0:5751:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788869453.231319:0:6546:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 46 00000100:00100000:3.0:1788869453.231329:0:7884:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 47 00000100:00100000:2.0:1788869453.231335:0:6546:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c835a3ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2125b9b3-626e-4cbe-be83-fb446e976ce2+6:2345:x1875765413092608:12345-192.168.201.39@tcp:400:kworker.0 00000100:00100000:3.0:1788869453.231344:0:7884:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c83500d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:2125b9b3-626e-4cbe-be83-fb446e976ce2+7:2345:x1875765413092480:12345-192.168.201.39@tcp:400:kworker.0 00000100:00100000:2.0:1788869453.231376:0:6546:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c835a3ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2125b9b3-626e-4cbe-be83-fb446e976ce2+6:2345:x1875765413092608:12345-192.168.201.39@tcp:400:kworker.0 Request processed in 47us (410us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869453.231387:0:7884:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c83500d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:2125b9b3-626e-4cbe-be83-fb446e976ce2+7:2345:x1875765413092480:12345-192.168.201.39@tcp:400:kworker.0 Request processed in 46us (481us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869453.231387:0:6546:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 46 00000100:00100000:3.0:1788869453.232238:0:7884:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 47 00000040:00080000:2.0:1788869453.728404:0:11485:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788869453.728418:0:11485:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788869453.728470:0:11485:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 5 00000040:00080000:2.0:1788869453.728478:0:11485:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1788869453.728661:0:11485:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94c835a3df80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11485:1875765421469184:192.168.201.39@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1788869453.728946:0:11485:0:(client.c:2702:ptlrpc_set_wait()) set ffff94c8050683c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788869453.732487:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1788869453.732762:0:11485:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94c835a3df80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11485:1875765421469184:192.168.201.39@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1788869453.733116:0:5757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765413092864 00000100:00100000:0.0:1788869453.733128:0:5757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765413092864 00000100:00100000:0.0:1788869453.733204:0:5757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 172 00000100:00100000:0.0:1788869453.733215:0:5757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c835a3c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2125b9b3-626e-4cbe-be83-fb446e976ce2+58:11445:x1875765413092864:12345-192.168.201.39@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1788869453.733363:0:5757:0:(mdt_handler.c:8041:mdt_fid2path()) path get [0x200000401:0xb:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1788869453.733519:0:5757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c835a3c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2125b9b3-626e-4cbe-be83-fb446e976ce2+58:11445:x1875765413092864:12345-192.168.201.39@tcp:53:lhsmtool_posix.0 Request processed in 307us (1272us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869453.733527:0:5757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 172 00000100:00100000:2.0:1788869453.739528:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1788869453.739622:0:5756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765413092992 00000100:00100000:3.0:1788869453.739634:0:5756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765413092992 00000100:00100000:3.0:1788869453.739712:0:5756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 173 00000100:00100000:3.0:1788869453.739724:0:5756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c835a3ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2125b9b3-626e-4cbe-be83-fb446e976ce2+58:11445:x1875765413092992:12345-192.168.201.39@tcp:34:lhsmtool_posix.0 00010000:00010000:3.0:1788869453.739821:0:5756:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504ca00/0x3d2d1916761d6ff0 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869453.739842:0:5756:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504ca00/0x3d2d1916761d6ff0 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869453.739859:0:5756:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504ca00/0x3d2d1916761d6ff0 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869453.739879:0:5756:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504ce00/0x3d2d1916761d6ff7 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869453.739899:0:5756:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504ce00/0x3d2d1916761d6ff7 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869453.739906:0:5756:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504ce00/0x3d2d1916761d6ff7 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869453.739952:0:5756:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504d400/0x3d2d1916761d6ffe lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869453.739961:0:5756:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504d400/0x3d2d1916761d6ffe lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869453.739968:0:5756:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504d400/0x3d2d1916761d6ffe lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788869453.740014:0:5756:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:3.0:1788869453.740019:0:5756:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1788869453.740034:0:5756:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504d400/0x3d2d1916761d6ffe lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869453.740047:0:5756:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504ca00/0x3d2d1916761d6ff0 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869453.740053:0:5756:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504ca00/0x3d2d1916761d6ff0 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869453.740060:0:5756:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504ca00/0x3d2d1916761d6ff0 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869453.740068:0:5756:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94c83504ca00 already unused, calling callback (ffffffffc21124f0) 00010000:00010000:3.0:1788869453.740072:0:5756:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504ca00/0x3d2d1916761d6ff0 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869453.740081:0:5756:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504ca00/0x3d2d1916761d6ff0 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869453.740095:0:5756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff94c819394200) 00010000:00010000:3.0:1788869453.740104:0:5756:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788869453.740110:0:5756:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504ca00/0x3d2d1916761d6ff0 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869453.740117:0:5756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504ca00/0x3d2d1916761d6ff0 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869453.740129:0:5756:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504ce00/0x3d2d1916761d6ff7 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869453.740134:0:5756:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504ce00/0x3d2d1916761d6ff7 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869453.740140:0:5756:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504ce00/0x3d2d1916761d6ff7 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869453.740145:0:5756:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94c83504ce00 already unused, calling callback (ffffffffc21124f0) 00010000:00010000:3.0:1788869453.740148:0:5756:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504ce00/0x3d2d1916761d6ff7 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869453.740154:0:5756:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504ce00/0x3d2d1916761d6ff7 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869453.740161:0:5756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x19697575 (ffff94c819394400) 00010000:00010000:3.0:1788869453.740164:0:5756:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788869453.740167:0:5756:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504ce00/0x3d2d1916761d6ff7 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869453.740172:0:5756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504ce00/0x3d2d1916761d6ff7 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869453.740187:0:5756:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504d400/0x3d2d1916761d6ffe lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869453.740202:0:5756:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504d400/0x3d2d1916761d6ffe lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869453.740209:0:5756:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504d400/0x3d2d1916761d6ffe lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869453.740215:0:5756:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94c83504d400 already unused, calling callback (ffffffffc21124f0) 00010000:00010000:3.0:1788869453.740219:0:5756:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504d400/0x3d2d1916761d6ffe lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869453.740225:0:5756:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504d400/0x3d2d1916761d6ffe lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869453.740234:0:5756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff94c819394b00) 00010000:00010000:3.0:1788869453.740236:0:5756:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788869453.740239:0:5756:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504d400/0x3d2d1916761d6ffe lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869453.740244:0:5756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504d400/0x3d2d1916761d6ffe lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788869453.742724:0:5756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c835a3ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2125b9b3-626e-4cbe-be83-fb446e976ce2+58:11445:x1875765413092992:12345-192.168.201.39@tcp:34:lhsmtool_posix.0 Request processed in 2650us (2855us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869453.742743:0:5756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 173 00000100:00100000:2.0:1788869453.748000:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1788869453.748167:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765413093248 00000100:00100000:3.0:1788869453.748182:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765413093248 00000100:00100000:3.0:1788869453.748464:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 174 00000100:00100000:3.0:1788869453.748478:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c835a3c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2125b9b3-626e-4cbe-be83-fb446e976ce2+58:11445:x1875765413093248:12345-192.168.201.39@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788869453.748506:0:5786:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788869453.748534:0:5786:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504d400/0x3d2d1916761d7005 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x375c010249035ae0 expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869453.748680:0:5786:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504ce00/0x3d2d1916761d700c lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869453.748705:0:5786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504ce00/0x3d2d1916761d700c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869453.748719:0:5786:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504ce00/0x3d2d1916761d700c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788869453.748734:0:5786:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:3.0:1788869453.748859:0:5786:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504ce00/0x3d2d1916761d700c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869453.748867:0:5786:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504ce00/0x3d2d1916761d700c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869453.748874:0:5786:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504ce00/0x3d2d1916761d700c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869453.748881:0:5786:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94c83504ce00 already unused, calling callback (ffffffffc21124f0) 00010000:00010000:3.0:1788869453.749352:0:5786:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504ce00/0x3d2d1916761d700c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869453.749363:0:5786:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504ce00/0x3d2d1916761d700c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869453.749438:0:5786:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff94c819394b00) 00010000:00010000:3.0:1788869453.749443:0:5786:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788869453.749450:0:5786:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504ce00/0x3d2d1916761d700c lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869453.749459:0:5786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504ce00/0x3d2d1916761d700c lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869453.749515:0:5786:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504d400/0x3d2d1916761d7005 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0x375c010249035ae0 expref: 60 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869453.749548:0:5786:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff94c819394200) 00010000:00010000:3.0:1788869453.749551:0:5786:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788869453.749556:0:5786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504d400/0x3d2d1916761d7005 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.39@tcp remote: 0x375c010249035ae0 expref: 60 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869453.749568:0:5786:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94c83504d400, rc 0) 00000100:00100000:3.0:1788869453.750091:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c835a3c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2125b9b3-626e-4cbe-be83-fb446e976ce2+59:11445:x1875765413093248:12345-192.168.201.39@tcp:101:lhsmtool_posix.0 Request processed in 1613us (2104us total) trans 4294967457 rc 301/301 00000100:00100000:3.0:1788869453.750101:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 174 00000100:00100000:0.0:1788869453.755554:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1788869453.758168:0:5755:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765413093376 00000100:00100000:1.0:1788869453.758188:0:5755:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765413093376 00000100:00100000:1.0:1788869453.758355:0:5755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 175 00000100:00100000:1.0:1788869453.758368:0:5755:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c8354d1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2125b9b3-626e-4cbe-be83-fb446e976ce2+59:11445:x1875765413093376:12345-192.168.201.39@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1788869453.758425:0:5755:0:(mdt_handler.c:8041:mdt_fid2path()) path get [0x200000401:0xb:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1788869453.758573:0:5755:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c8354d1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2125b9b3-626e-4cbe-be83-fb446e976ce2+59:11445:x1875765413093376:12345-192.168.201.39@tcp:53:lhsmtool_posix.0 Request processed in 208us (3044us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869453.758593:0:5755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 175 00000100:00100000:1.0:1788869453.765922:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1788869453.766065:0:5757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765413093632 00000100:00100000:3.0:1788869453.767578:0:5757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765413093632 00000100:00100000:3.0:1788869453.767671:0:5757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 176 00000100:00100000:3.0:1788869453.767683:0:5757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c835154700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2125b9b3-626e-4cbe-be83-fb446e976ce2+59:11445:x1875765413093632:12345-192.168.201.39@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788869453.767712:0:5757:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788869453.767716:0:5757:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1788869453.767753:0:5757:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504c800/0x3d2d1916761d6fc6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.39@tcp remote: 0x375c010249035ad2 expref: 59 pid: 5757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869453.767772:0:5757:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff94c802f3fd00) 00010000:00010000:3.0:1788869453.767779:0:5757:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788869453.767796:0:5757:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504d400/0x3d2d1916761d701a lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x375c010249035ae7 expref: -99 pid: 5757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1788869453.768715:0:5757:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x5:0x0], index 1: 0 00000040:00080000:2.0:1788869453.768720:0:12259:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788869453.768728:0:12259:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788869453.768796:0:12259:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 5 00000040:00080000:2.0:1788869453.768804:0:12259:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:3.0:1788869453.769060:0:5757:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504ce00/0x3d2d1916761d7021 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869453.769084:0:5757:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504ce00/0x3d2d1916761d7021 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869453.769097:0:5757:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504ce00/0x3d2d1916761d7021 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869453.769169:0:5757:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504d400/0x3d2d1916761d701a lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0x375c010249035ae7 expref: 61 pid: 5757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869453.769187:0:5757:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504ce00/0x3d2d1916761d7021 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0x375c010249035ae7 expref: 60 pid: 5757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869453.769195:0:5757:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff94c819394400) 00010000:00010000:3.0:1788869453.769198:0:5757:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788869453.769202:0:5757:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94c83504ce00, rc 0) 00000100:00100000:3.0:1788869453.769324:0:5757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c835154700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2125b9b3-626e-4cbe-be83-fb446e976ce2+60:11445:x1875765413093632:12345-192.168.201.39@tcp:101:lhsmtool_posix.0 Request processed in 1642us (3425us total) trans 4294967458 rc 0/0 00000100:00100000:3.0:1788869453.769335:0:5757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 176 00000100:00100000:3.0:1788869453.774551:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1788869453.774741:0:5756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765413093888 00000100:00100000:2.0:1788869453.774756:0:5756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765413093888 00000100:00100000:2.0:1788869453.774839:0:5756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 177 00000100:00100000:2.0:1788869453.774852:0:5756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c835150380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2125b9b3-626e-4cbe-be83-fb446e976ce2+60:11445:x1875765413093888:12345-192.168.201.39@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1788869453.775056:0:5756:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788869453.775093:0:5756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504ce00/0x3d2d1916761d7021 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.39@tcp remote: 0x375c010249035ae7 expref: 60 pid: 5757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869453.775308:0:5756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff94c819394400) 00010000:00010000:2.0:1788869453.775324:0:5756:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788869453.775358:0:5756:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94c805039e00/0x3d2d1916761d702f lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869453.775376:0:5756:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94c805039e00/0x3d2d1916761d702f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869453.775387:0:5756:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94c805039e00/0x3d2d1916761d702f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869453.775404:0:5756:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94c805038c00/0x3d2d1916761d7036 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0xb8a8d184 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869453.775411:0:5756:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94c805038c00/0x3d2d1916761d7036 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0xb8a8d184 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869453.775418:0:5756:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94c805038c00/0x3d2d1916761d7036 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0xb8a8d184 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869453.775555:0:5756:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94c805039e00/0x3d2d1916761d702f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869453.775563:0:5756:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94c805039e00/0x3d2d1916761d702f lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869453.775570:0:5756:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94c805039e00/0x3d2d1916761d702f lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869453.775578:0:5756:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94c805039e00 already unused, calling callback (ffffffffc21124f0) 00010000:00010000:2.0:1788869453.775582:0:5756:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94c805039e00/0x3d2d1916761d702f lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869453.775591:0:5756:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94c805039e00/0x3d2d1916761d702f lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869453.775600:0:5756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff94c802f3fd00) 00010000:00010000:2.0:1788869453.775604:0:5756:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788869453.775608:0:5756:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94c805039e00/0x3d2d1916761d702f lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869453.775614:0:5756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94c805039e00/0x3d2d1916761d702f lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869453.775631:0:5756:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94c805038c00/0x3d2d1916761d7036 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0xb8a8d184 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869453.775636:0:5756:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94c805038c00/0x3d2d1916761d7036 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xb8a8d184 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869453.775642:0:5756:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94c805038c00/0x3d2d1916761d7036 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xb8a8d184 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869453.775655:0:5756:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94c805038c00 already unused, calling callback (ffffffffc21124f0) 00010000:00010000:2.0:1788869453.775658:0:5756:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94c805038c00/0x3d2d1916761d7036 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xb8a8d184 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869453.775665:0:5756:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94c805038c00/0x3d2d1916761d7036 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xb8a8d184 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869453.775674:0:5756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0xb8a8d184 (ffff94c802f3f500) 00010000:00010000:2.0:1788869453.775676:0:5756:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788869453.775679:0:5756:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94c805038c00/0x3d2d1916761d7036 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0xb8a8d184 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869453.775685:0:5756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94c805038c00/0x3d2d1916761d7036 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0xb8a8d184 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788869453.775812:0:5756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c835150380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2125b9b3-626e-4cbe-be83-fb446e976ce2+59:11445:x1875765413093888:12345-192.168.201.39@tcp:36:lhsmtool_posix.0 Request processed in 962us (1282us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788869453.775822:0:5756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 177 00000100:00100000:3.0:1788869453.781957:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1788869453.782055:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765413094016 00000100:00100000:0.0:1788869453.782071:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765413094016 00000100:00100000:0.0:1788869453.782142:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 178 00000100:00100000:0.0:1788869453.782154:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c835150700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2125b9b3-626e-4cbe-be83-fb446e976ce2+59:11445:x1875765413094016:12345-192.168.201.39@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788869453.782181:0:5786:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788869453.782212:0:5786:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94c81a582e00/0x3d2d1916761d703d lrc: 2/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x375c010249035aee expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869453.782289:0:5786:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94c81a582a00/0x3d2d1916761d7044 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869453.782304:0:5786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94c81a582a00/0x3d2d1916761d7044 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869453.782318:0:5786:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94c81a582a00/0x3d2d1916761d7044 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869453.782458:0:5786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94c81a582e00/0x3d2d1916761d703d lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0x375c010249035aee expref: 61 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869453.782480:0:5786:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94c81a582a00/0x3d2d1916761d7044 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0x375c010249035aee expref: 60 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869453.782487:0:5786:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff94c803990f00) 00010000:00010000:0.0:1788869453.782490:0:5786:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1788869453.782493:0:5786:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94c81a582a00, rc 0) 00000100:00100000:0.0:1788869453.782565:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c835150700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2125b9b3-626e-4cbe-be83-fb446e976ce2+60:11445:x1875765413094016:12345-192.168.201.39@tcp:101:lhsmtool_posix.0 Request processed in 414us (622us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869453.782570:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 178 00000100:00100000:0.0:1788869453.788351:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1788869453.788452:0:5755:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765413094272 00000100:00100000:2.0:1788869453.788466:0:5755:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765413094272 00000100:00100000:2.0:1788869453.788550:0:5755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 179 00000100:00100000:2.0:1788869453.788562:0:5755:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c8354d3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2125b9b3-626e-4cbe-be83-fb446e976ce2+60:11445:x1875765413094272:12345-192.168.201.39@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1788869453.788674:0:5755:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94c805038c00/0x3d2d1916761d704b lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869453.788695:0:5755:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94c805038c00/0x3d2d1916761d704b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869453.788710:0:5755:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94c805038c00/0x3d2d1916761d704b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788869453.789076:0:5755:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].6, 88 off8648 00000004:00080000:2.0:1788869453.789088:0:5755:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 202080837579ns, next at 203080834165ns, rc = 0 00000004:00010000:2.0:1788869453.789198:0:5755:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000ad4bfab7 reply state 00000000c46f63b1 transno 4294967459 ns: mdt-lustre-MDT0000_UUID lock: ffff94c805038c00/0x3d2d1916761d704b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788869453.789210:0:5755:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788869453.789356:0:5755:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c8354d3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2125b9b3-626e-4cbe-be83-fb446e976ce2+62:11445:x1875765413094272:12345-192.168.201.39@tcp:36:lhsmtool_posix.0 Request processed in 795us (1017us total) trans 4294967459 rc 0/0 00000100:00100000:2.0:1788869453.789365:0:5755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 179 00010000:00010000:2.0:1788869453.790505:0:3269:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94c805038c00/0x3d2d1916761d704b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869453.790519:0:3269:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94c805038c00/0x3d2d1916761d704b lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869453.790528:0:3269:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94c805038c00/0x3d2d1916761d704b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869453.790534:0:3269:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94c805038c00 already unused, calling callback (ffffffffc21124f0) 00010000:00010000:2.0:1788869453.790551:0:3269:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94c805038c00/0x3d2d1916761d704b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869453.790560:0:3269:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94c805038c00/0x3d2d1916761d704b lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869453.790581:0:3269:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff94c803990f00) 00010000:00010000:2.0:1788869453.790584:0:3269:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1788869453.790590:0:3269:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94c805038c00/0x3d2d1916761d704b lrc: 2/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869453.790612:0:3269:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94c805038c00/0x3d2d1916761d704b lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788869453.792754:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1788869453.792951:0:5757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765413094400 00000100:00100000:3.0:1788869453.792963:0:5757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765413094400 00000100:00100000:3.0:1788869453.793063:0:5757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 180 00000100:00100000:3.0:1788869453.793076:0:5757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c8354d0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2125b9b3-626e-4cbe-be83-fb446e976ce2+61:11445:x1875765413094400:12345-192.168.201.39@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788869453.793109:0:5757:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788869453.793134:0:5757:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504ca00/0x3d2d1916761d7052 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x375c010249035af5 expref: -99 pid: 5757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869453.793234:0:5757:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504ca00/0x3d2d1916761d7052 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.39@tcp remote: 0x375c010249035af5 expref: 62 pid: 5757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869453.793405:0:5757:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504ca00/0x3d2d1916761d7052 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.39@tcp remote: 0x375c010249035af5 expref: 62 pid: 5757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869453.793444:0:5757:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff94c803990f00) 00010000:00010000:3.0:1788869453.793447:0:5757:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788869453.793452:0:5757:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94c83504ca00, rc 0) 00000100:00100000:3.0:1788869453.793529:0:5757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c8354d0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2125b9b3-626e-4cbe-be83-fb446e976ce2+62:11445:x1875765413094400:12345-192.168.201.39@tcp:101:lhsmtool_posix.0 Request processed in 455us (787us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869453.793549:0:5757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 180 00000100:00100000:3.0:1788869453.795819:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1788869453.796004:0:6547:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765413094528 00000100:00100000:0.0:1788869453.796018:0:6547:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765413094528 00000100:00100000:0.0:1788869453.796093:0:6547:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 50 00000100:00100000:0.0:1788869453.796105:0:6547:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c835150e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2125b9b3-626e-4cbe-be83-fb446e976ce2+6:2346:x1875765413094528:12345-192.168.201.39@tcp:2:lhsmtool_posix.0 00000100:00100000:0.0:1788869453.796945:0:6547:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c835150e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2125b9b3-626e-4cbe-be83-fb446e976ce2+7:2346:x1875765413094528:12345-192.168.201.39@tcp:2:lhsmtool_posix.0 Request processed in 838us (1134us total) trans 4294967313 rc 0/0 00000100:00100000:0.0:1788869453.796957:0:6547:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 50 00000100:00100000:3.0:1788869453.805677:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1788869453.806020:0:5758:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765413094784 00000100:00100000:0.0:1788869453.806035:0:5758:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765413094784 00000100:00100000:0.0:1788869453.806109:0:5758:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 49 00000100:00100000:0.0:1788869453.806120:0:5758:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c835152680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2125b9b3-626e-4cbe-be83-fb446e976ce2+62:11445:x1875765413094784:12345-192.168.201.39@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1788869453.806842:0:5758:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c835152680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2125b9b3-626e-4cbe-be83-fb446e976ce2+63:11445:x1875765413094784:12345-192.168.201.39@tcp:35:lhsmtool_posix.0 Request processed in 720us (1176us total) trans 4294967460 rc 0/0 00000100:00100000:0.0:1788869453.806854:0:5758:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 49 00000100:00100000:0.0:1788869453.813375:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1788869453.813444:0:5755:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765413095040 00000100:00100000:3.0:1788869453.813458:0:5755:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765413095040 00000100:00100000:3.0:1788869453.813549:0:5755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 181 00000100:00100000:3.0:1788869453.813563:0:5755:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c8354d0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2125b9b3-626e-4cbe-be83-fb446e976ce2+63:11445:x1875765413095040:12345-192.168.201.39@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1788869453.813714:0:5755:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c8354d0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2125b9b3-626e-4cbe-be83-fb446e976ce2+63:11445:x1875765413095040:12345-192.168.201.39@tcp:57:lhsmtool_posix.0 Request processed in 154us (353us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869453.813724:0:5755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 181 00000100:00100000:3.0:1788869453.816374:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1788869453.816456:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765413095168 00000100:00100000:0.0:1788869453.816469:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765413095168 00000100:00100000:0.0:1788869453.816532:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 182 00000100:00100000:0.0:1788869453.816557:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c835150a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2125b9b3-626e-4cbe-be83-fb446e976ce2+63:11445:x1875765413095168:12345-192.168.201.39@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788869453.816584:0:5786:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788869453.816609:0:5786:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94c81a582200/0x3d2d1916761d7059 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x375c010249035afc expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869453.816701:0:5786:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94c81a583000/0x3d2d1916761d7060 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869453.816720:0:5786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94c81a583000/0x3d2d1916761d7060 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869453.816733:0:5786:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94c81a583000/0x3d2d1916761d7060 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788869453.816775:0:5786:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1788869453.816794:0:5786:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff94c81a583000/0x3d2d1916761d7060 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869453.816822:0:5786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94c81a582200/0x3d2d1916761d7059 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0x375c010249035afc expref: 65 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869453.816840:0:5786:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94c81a583000/0x3d2d1916761d7060 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0x375c010249035afc expref: 64 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869453.816855:0:5786:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff94c803990f00) 00010000:00010000:0.0:1788869453.816859:0:5786:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1788869453.816863:0:5786:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94c81a583000, rc 0) 00000100:00100000:0.0:1788869453.816942:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c835150a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2125b9b3-626e-4cbe-be83-fb446e976ce2+64:11445:x1875765413095168:12345-192.168.201.39@tcp:101:lhsmtool_posix.0 Request processed in 390us (578us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869453.816950:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 182 00000100:00100000:0.0:1788869453.819983:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1788869453.820066:0:11822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765413095296 00000100:00100000:3.0:1788869453.820079:0:11822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765413095296 00000100:00100000:3.0:1788869453.820146:0:11822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 51 00000100:00100000:3.0:1788869453.820168:0:11822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c8354d3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:2125b9b3-626e-4cbe-be83-fb446e976ce2+7:2345:x1875765413095296:12345-192.168.201.39@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788869453.820191:0:11822:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788869453.820217:0:11822:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000978d1b1c/0x3d2d1916761d7067 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x375c010249035b03 expref: -99 pid: 11822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788869453.820272:0:11822:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a9ffb4c, blocks: 0x1 00010000:00010000:3.0:1788869453.820296:0:11822:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=202s v=(0 0) 00010000:00010000:3.0:1788869453.820302:0:11822:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788869453.820316:0:11822:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000978d1b1c/0x3d2d1916761d7067 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.39@tcp remote: 0x375c010249035b03 expref: 8 pid: 11822 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869453.820337:0:11822:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000978d1b1c/0x3d2d1916761d7067 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.39@tcp remote: 0x375c010249035b03 expref: 8 pid: 11822 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869453.820353:0:11822:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94c83504d400, rc 0) 00000100:00100000:3.0:1788869453.820420:0:11822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c8354d3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:2125b9b3-626e-4cbe-be83-fb446e976ce2+8:2345:x1875765413095296:12345-192.168.201.39@tcp:101:lhsmtool_posix.0 Request processed in 255us (446us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869453.820427:0:11822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 51 00000100:00100000:0.0:1788869453.823689:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1788869453.823942:0:5756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765413095552 00000100:00100000:1.0:1788869453.823955:0:5756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765413095552 00000100:00100000:1.0:1788869453.824126:0:5756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 183 00000100:00100000:1.0:1788869453.824141:0:5756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c8354d1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2125b9b3-626e-4cbe-be83-fb446e976ce2+64:11445:x1875765413095552:12345-192.168.201.39@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1788869453.824291:0:5756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c8354d1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2125b9b3-626e-4cbe-be83-fb446e976ce2+64:11445:x1875765413095552:12345-192.168.201.39@tcp:57:lhsmtool_posix.0 Request processed in 154us (612us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869453.824299:0:5756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 183 00000100:00100000:1.0:1788869453.826601:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1788869453.826739:0:7884:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765413095680 00000100:00100000:3.0:1788869453.826751:0:7884:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765413095680 00000100:00100000:3.0:1788869453.826817:0:7884:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 52 00000100:00100000:3.0:1788869453.826829:0:7884:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c835155180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:2125b9b3-626e-4cbe-be83-fb446e976ce2+8:11445:x1875765413095680:12345-192.168.201.39@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788869453.826852:0:7884:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788869453.826872:0:7884:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008b0be560/0x3d2d1916761d706e lrc: 2/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x375c010249035b0a expref: -99 pid: 7884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869453.827872:0:7884:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000978d1b1c/0x3d2d1916761d7067 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.39@tcp remote: 0x375c010249035b03 expref: 9 pid: 11822 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869453.827880:0:7884:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788869453.827884:0:7884:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788869453.827888:0:7884:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008b0be560/0x3d2d1916761d706e lrc: 4/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.201.39@tcp remote: 0x375c010249035b0a expref: 9 pid: 7884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869453.827978:0:7884:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000978d1b1c/0x3d2d1916761d7067 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.39@tcp remote: 0x375c010249035b03 expref: 9 pid: 11822 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869453.827997:0:7884:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000978d1b1c/0x3d2d1916761d7067 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.39@tcp remote: 0x375c010249035b03 expref: 9 pid: 11822 timeout: 302 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788869453.828014:0:7884:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94c835153800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:7884:1875765421469312:192.168.201.39@tcp:104: 00000100:00100000:3.0:1788869453.828122:0:7884:0:(client.c:2702:ptlrpc_set_wait()) set ffff94c81075acc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788869453.832669:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1788869453.832673:0:7884:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94c835153800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:7884:1875765421469312:192.168.201.39@tcp:104: 00010000:00010000:3.0:1788869453.832719:0:7884:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000008b0be560/0x3d2d1916761d706e lrc: 3/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.39@tcp remote: 0x375c010249035b0a expref: 9 pid: 7884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788869453.832745:0:7448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765413095808 00010000:00010000:3.0:1788869453.832746:0:7884:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94c83504c800, rc 0) 00000100:00100000:2.0:1788869453.832755:0:7448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765413095808 00010000:00010000:2.0:1788869453.832803:0:7448:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000978d1b1c/0x3d2d1916761d7067 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.39@tcp remote: 0x375c010249035b03 expref: 10 pid: 11822 timeout: 302 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788869453.832834:0:7884:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c835155180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:2125b9b3-626e-4cbe-be83-fb446e976ce2+10:11445:x1875765413095680:12345-192.168.201.39@tcp:101:lhsmtool_posix.0 Request processed in 6006us (6243us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869453.832844:0:7884:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 52 00000100:00100000:2.0:1788869453.832849:0:7448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 71 00000100:00100000:2.0:1788869453.832862:0:7448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c8354d2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:2125b9b3-626e-4cbe-be83-fb446e976ce2+10:2347:x1875765413095808:12345-192.168.201.39@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788869453.832881:0:7448:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788869453.832907:0:7448:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000978d1b1c/0x3d2d1916761d7067 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.39@tcp remote: 0x375c010249035b03 expref: 9 pid: 11822 timeout: 302 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869453.832920:0:7448:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000978d1b1c/0x3d2d1916761d7067 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.39@tcp remote: 0x375c010249035b03 expref: 9 pid: 11822 timeout: 302 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869453.832946:0:7448:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000978d1b1c/0x3d2d1916761d7067 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.39@tcp remote: 0x375c010249035b03 expref: 9 pid: 11822 timeout: 302 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869453.832957:0:7448:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788869453.832962:0:7448:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788869453.832971:0:7448:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000008b0be560/0x3d2d1916761d706e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.39@tcp remote: 0x375c010249035b0a expref: 8 pid: 7884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869453.832982:0:7448:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008b0be560/0x3d2d1916761d706e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.39@tcp remote: 0x375c010249035b0a expref: 8 pid: 7884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869453.833027:0:7448:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000008b0be560/0x3d2d1916761d706e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.39@tcp remote: 0x375c010249035b0a expref: 8 pid: 7884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788869453.833043:0:7448:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94c835a3fb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:7448:1875765421469440:192.168.201.39@tcp:105: 00000100:00100000:2.0:1788869453.833105:0:7448:0:(client.c:2702:ptlrpc_set_wait()) set ffff94c805068240 going to sleep for 11 seconds 00000100:00100000:1.0:1788869453.835903:0:7448:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94c835a3fb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:7448:1875765421469440:192.168.201.39@tcp:105: 00010000:00010000:1.0:1788869453.835937:0:7448:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788869453.836007:0:7448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c8354d2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:2125b9b3-626e-4cbe-be83-fb446e976ce2+8:2347:x1875765413095808:12345-192.168.201.39@tcp:103:ldlm_bl.0 Request processed in 3146us (3350us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869453.836019:0:7448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 71 00000100:00100000:0.0:1788869453.839688:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1788869453.839748:0:6552:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765413095936 00000100:00100000:3.0:1788869453.839764:0:6552:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765413095936 00002000:00100000:3.0:1788869453.839834:0:6552:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x5:0x0] (0->8) req@ffff94c8354d1500 x1875765413095936/t0(0) o4->2125b9b3-626e-4cbe-be83-fb446e976ce2@192.168.201.39@tcp:399/0 lens 504/0 e 0 to 0 dl 1788869464 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788869453.839849:0:6552:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff94c8354d1500 with x1875765413095936 ext(0->8) 00002000:00010000:3.0:1788869453.839855:0:6552:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff94c8354d1500 00000100:00100000:3.0:1788869453.840007:0:6552:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 4 00000100:00100000:3.0:1788869453.840021:0:6552:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c8354d1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:2125b9b3-626e-4cbe-be83-fb446e976ce2+8:2346:x1875765413095936:12345-192.168.201.39@tcp:4:lhsmtool_posix.0 00000100:00100000:3.0:1788869453.840649:0:6552:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c8354d1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:2125b9b3-626e-4cbe-be83-fb446e976ce2+10:2346:x1875765413095936:12345-192.168.201.39@tcp:4:lhsmtool_posix.0 Request processed in 630us (975us total) trans 4294967314 rc 0/0 00000100:00100000:3.0:1788869453.840659:0:6552:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 4 00002000:00100000:3.0:1788869453.840668:0:6552:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x5:0x0] (0->8) req@ffff94c8354d1500 x1875765413095936/t4294967314(0) o4->2125b9b3-626e-4cbe-be83-fb446e976ce2@192.168.201.39@tcp:399/0 lens 504/448 e 0 to 0 dl 1788869464 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788869453.840678:0:6552:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff94c8354d1500 with x1875765413095936 ext(0->8) 00002000:00010000:3.0:1788869453.840682:0:6552:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff94c8354d1500 00000100:00100000:3.0:1788869453.843046:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1788869453.844648:0:5757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765413096064 00000100:00100000:2.0:1788869453.844668:0:5757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765413096064 00000100:00100000:2.0:1788869453.844763:0:5757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 184 00000100:00100000:2.0:1788869453.844775:0:5757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c835153800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2125b9b3-626e-4cbe-be83-fb446e976ce2+64:11445:x1875765413096064:12345-192.168.201.39@tcp:44:lhsmtool_posix.0 00000100:00100000:3.0:1788869453.879351:0:5757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c835153800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2125b9b3-626e-4cbe-be83-fb446e976ce2+64:11445:x1875765413096064:12345-192.168.201.39@tcp:44:lhsmtool_posix.0 Request processed in 34561us (36303us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869453.879369:0:5757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 184 00000001:00080000:3.0:1788869453.879430:0:5777:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967460 is committed 00000004:00080000:3.0:1788869453.879508:0:5777:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 4 committed 00000020:00080000:3.0:1788869453.879550:0:5777:0:(update_trans.c:58:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff94c810e32600 refcount 2 committed 0 result 0 batchid 5 00000020:00080000:3.0:1788869453.879556:0:5777:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff94c8105be800 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff94c810e326c0 00000020:00080000:3.0:1788869453.879560:0:5777:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff94c8105be000 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff94c83faed000 00000020:00080000:3.0:1788869453.879588:0:5777:0:(update_trans.c:1348:distribute_txn_batchid_cb()) lustre-MDT0000: 4 batchid updated 00000004:00080000:3.0:1788869453.879605:0:5777:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 6 committed 00000100:00100000:0.0:1788869453.879707:0:3285:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94c8354d3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3285:1875765421469568:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1788869453.879773:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869453.879850:0:6544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765421469568 00000100:00100000:0.0:1788869453.879860:0:6544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765421469568 00000100:00100000:0.0:1788869453.879918:0:6544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1788869453.879927:0:6544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c8354d0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3285:x1875765421469568:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:0.0:1788869453.879958:0:6544:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:4 count 1 00002000:00010000:0.0:1788869453.879997:0:6544:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x4:0x0] initial LVB size: 13, mtime: 0x6a9ffb4a, atime: 0x6a9ffb4a, ctime: 0x6a9ffb4a, blocks: 0x1 00010000:00010000:0.0:1788869453.880007:0:6544:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000da038adf/0x3d2d1916761d7075 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869453.880028:0:6544:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=202s v=(0 0) 00010000:00010000:0.0:1788869453.880032:0:6544:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788869453.880040:0:6544:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000da038adf/0x3d2d1916761d7075 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869453.880071:0:6544:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000da038adf/0x3d2d1916761d7075 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869453.880084:0:6544:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000da038adf/0x3d2d1916761d7075 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869453.880092:0:6544:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000da038adf/0x3d2d1916761d7075 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869453.880113:0:6544:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1788869453.880734:0:6544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c8354d0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3285:x1875765421469568:12345-0@lo:6:osp-syn-0-0.0 Request processed in 806us (959us total) trans 4294967307 rc 0/0 00000100:00100000:0.0:1788869453.880743:0:6544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00080000:0.0:1788869453.880770:0:5751:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1788869453.880787:0:7447:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788869453.880794:0:7447:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000da038adf/0x3d2d1916761d7075 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869453.880805:0:7447:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94c81a582200 already unused, calling callback (ffffffffc1703220) 00010000:00010000:0.0:1788869453.880809:0:7447:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000da038adf/0x3d2d1916761d7075 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869453.880820:0:7447:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000da038adf/0x3d2d1916761d7075 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869453.880851:0:7447:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000da038adf/0x3d2d1916761d7075 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869453.880860:0:7447:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000da038adf/0x3d2d1916761d7075 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869453.880878:0:7447:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788869453.880880:0:7447:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788869453.880882:0:7447:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1788869453.880921:0:3285:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94c8354d3100/2, rc 0, transno 4294967307 00000100:00100000:0.0:1788869453.880927:0:3285:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94c8354d3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3285:1875765421469568:0@lo:6:osp-syn-0-0.0 00000020:00080000:1.0:1788869453.881004:0:5791:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 5 committed batchid 4 00000100:00100000:0.0:1788869453.881350:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1788869453.881384:0:11822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765413096192 00000100:00100000:0.0:1788869453.881391:0:11822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765413096192 00000100:00100000:0.0:1788869453.881435:0:11822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 54 00000100:00100000:0.0:1788869453.881444:0:11822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c808f53b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:2125b9b3-626e-4cbe-be83-fb446e976ce2+10:2346:x1875765413096192:12345-192.168.201.39@tcp:16:lhsmtool_posix.0 00000100:00100000:0.0:1788869453.881518:0:3286:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94c835152300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3286:1875765421469696:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1788869453.881571:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869453.881623:0:7884:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765421469696 00000100:00100000:0.0:1788869453.881627:0:7884:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765421469696 00000100:00080000:3.0:1788869453.881666:0:5751:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788869453.881667:0:7884:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1788869453.881678:0:7884:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c808f50380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3286:x1875765421469696:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1788869453.881794:0:7884:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:0.0:1788869453.881797:0:7884:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb mtime from disk: 0 -> 1788869452 00002000:00010000:0.0:1788869453.881800:0:7884:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1788869453.881809:0:7884:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb ctime from disk: 1788869452 -> 1788869452 00002000:00010000:0.0:1788869453.881811:0:7884:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:0.0:1788869453.881853:0:7884:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c808f50380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3286:x1875765421469696:12345-0@lo:2:osp-syn-1-0.0 Request processed in 175us (282us total) trans 4294967315 rc 0/0 00000100:00100000:0.0:1788869453.881862:0:7884:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000004:00080000:3.0:1788869453.881870:0:3286:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94c835152300/2, rc 0, transno 4294967315 00000100:00100000:3.0:1788869453.881877:0:3286:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94c835152300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3286:1875765421469696:0@lo:2:osp-syn-1-0.0 00000020:00080000:1.0:1788869453.882113:0:5791:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000100:00100000:0.0:1788869453.916463:0:3283:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94c808f50000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3283:1875765421469824:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788869453.916568:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869453.916662:0:6548:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765421469824 00000100:00100000:0.0:1788869453.916671:0:6548:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765421469824 00000100:00100000:0.0:1788869453.916724:0:6548:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1788869453.916734:0:6548:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c808f53480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3283:x1875765421469824:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788869453.916777:0:6548:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 1703936 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788869453.916827:0:6548:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c808f53480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3283:x1875765421469824:12345-0@lo:13:osp-pre-0-0.0 Request processed in 94us (259us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869453.916835:0:6548:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1788869453.916893:0:3283:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94c808f50000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3283:1875765421469824:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788869453.920986:0:11822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c808f53b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:2125b9b3-626e-4cbe-be83-fb446e976ce2+10:2346:x1875765413096192:12345-192.168.201.39@tcp:16:lhsmtool_posix.0 Request processed in 39530us (39626us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869453.921005:0:11822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 54 00000001:00080000:1.0:1788869453.922713:0:7458:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967315 is committed 00000001:00080000:1.0:1788869453.922733:0:7458:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967313 is committed 00000001:00080000:1.0:1788869453.922743:0:7458:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967314 is committed 00000100:00100000:1.0:1788869453.925695:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1788869453.925750:0:5755:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765413096448 00000100:00100000:3.0:1788869453.925762:0:5755:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765413096448 00000100:00100000:3.0:1788869453.925827:0:5755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 185 00000100:00100000:3.0:1788869453.925839:0:5755:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c835154e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2125b9b3-626e-4cbe-be83-fb446e976ce2+18:11445:x1875765413096448:12345-192.168.201.39@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1788869453.925919:0:5755:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788869453.925953:0:5755:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94c81a583000/0x3d2d1916761d7060 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.39@tcp remote: 0x375c010249035afc expref: 18 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869453.925977:0:5755:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff94c803990f00) 00010000:00010000:3.0:1788869453.925983:0:5755:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788869453.926022:0:5755:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504d800/0x3d2d1916761d707c lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869453.926040:0:5755:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504d800/0x3d2d1916761d707c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869453.926051:0:5755:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504d800/0x3d2d1916761d707c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788869453.926373:0:5755:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000dc10887a reply state 0000000021446da8 transno 4294967461 ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504d800/0x3d2d1916761d707c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788869453.926384:0:5755:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788869453.926503:0:5755:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c835154e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2125b9b3-626e-4cbe-be83-fb446e976ce2+19:11445:x1875765413096448:12345-192.168.201.39@tcp:36:lhsmtool_posix.0 Request processed in 666us (822us total) trans 4294967461 rc 0/0 00000100:00100000:3.0:1788869453.926511:0:5755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 185 00010000:00010000:1.0:1788869453.929634:0:3270:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504d800/0x3d2d1916761d707c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869453.929657:0:3270:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504d800/0x3d2d1916761d707c lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788869453.929670:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00010000:00010000:1.0:1788869453.929683:0:3270:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504d800/0x3d2d1916761d707c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869453.929690:0:3270:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94c83504d800 already unused, calling callback (ffffffffc21124f0) 00010000:00010000:1.0:1788869453.929697:0:3270:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504d800/0x3d2d1916761d707c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869453.929707:0:3270:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504d800/0x3d2d1916761d707c lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869453.929728:0:3270:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff94c803990f00) 00010000:00010000:1.0:1788869453.929732:0:3270:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788869453.929737:0:3270:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504d800/0x3d2d1916761d707c lrc: 2/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869453.929744:0:3270:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504d800/0x3d2d1916761d707c lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788869453.929818:0:6546:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765413096576 00000100:00100000:0.0:1788869453.929831:0:6546:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765413096576 00000100:00100000:0.0:1788869453.929893:0:6546:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 56 00000100:00100000:0.0:1788869453.929905:0:6546:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c835151880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2125b9b3-626e-4cbe-be83-fb446e976ce2+7:2345:x1875765413096576:12345-192.168.201.39@tcp:2:lhsmtool_posix.0 00002000:00010000:0.0:1788869453.930332:0:6546:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb size from disk: 9 -> 9 00002000:00010000:0.0:1788869453.930337:0:6546:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb mtime from disk: 1788869452 -> 1788869451 00002000:00010000:0.0:1788869453.930341:0:6546:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb atime from disk: 0 -> 1788869450 00002000:00010000:0.0:1788869453.930351:0:6546:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb ctime from disk: 1788869452 -> 1788869451 00002000:00010000:0.0:1788869453.930354:0:6546:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:0.0:1788869453.930506:0:6546:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c835151880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2125b9b3-626e-4cbe-be83-fb446e976ce2+8:2345:x1875765413096576:12345-192.168.201.39@tcp:2:lhsmtool_posix.0 Request processed in 524us (762us total) trans 4294967316 rc 0/0 00000100:00100000:0.0:1788869453.930517:0:6546:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 56 00000100:00100000:0.0:1788869453.933683:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1788869453.933829:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765413096832 00000100:00100000:1.0:1788869453.933842:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765413096832 00000100:00100000:1.0:1788869453.934043:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 186 00000100:00100000:1.0:1788869453.934056:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c808f50000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2125b9b3-626e-4cbe-be83-fb446e976ce2+18:11445:x1875765413096832:12345-192.168.201.39@tcp:55:lhsmtool_posix.0 00010000:00010000:1.0:1788869453.934156:0:5786:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94c83fde6200/0x3d2d1916761d7083 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869453.934183:0:5786:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff94c81a582a00/0x3d2d1916761d7044 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0x375c010249035aee expref: 18 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869453.934196:0:5786:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff94c83fde6200/0x3d2d1916761d7083 lrc: 4/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869453.934283:0:5786:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff94c81a582a00/0x3d2d1916761d7044 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.39@tcp remote: 0x375c010249035aee expref: 18 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869453.934301:0:5786:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff94c81a582a00/0x3d2d1916761d7044 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.39@tcp remote: 0x375c010249035aee expref: 18 pid: 5786 timeout: 302 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788869453.934319:0:5786:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94c835155f80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:5786:1875765421469952:192.168.201.39@tcp:104: 00000100:00100000:1.0:1788869453.934424:0:5786:0:(client.c:2702:ptlrpc_set_wait()) set ffff94c818e67d80 going to sleep for 11 seconds 00000100:00100000:0.0:1788869453.937007:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1788869453.937157:0:5786:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94c835155f80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:5786:1875765421469952:192.168.201.39@tcp:104: 00010000:00010000:1.0:1788869453.937189:0:5786:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff94c83fde6200/0x3d2d1916761d7083 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788869453.937467:0:5741:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765413096960 00000100:00100000:2.0:1788869453.937476:0:5741:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765413096960 00010000:00010000:2.0:1788869453.937518:0:5741:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff94c81a582a00/0x3d2d1916761d7044 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.39@tcp remote: 0x375c010249035aee expref: 19 pid: 5786 timeout: 302 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788869453.937600:0:5741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 72 00000100:00100000:2.0:1788869453.937611:0:5741:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c808f51c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2125b9b3-626e-4cbe-be83-fb446e976ce2+19:2348:x1875765413096960:12345-192.168.201.39@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788869453.937628:0:5741:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788869453.937636:0:5741:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff94c81a582a00/0x3d2d1916761d7044 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.39@tcp remote: 0x375c010249035aee expref: 19 pid: 5786 timeout: 302 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869453.937649:0:5741:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff94c81a582a00/0x3d2d1916761d7044 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.39@tcp remote: 0x375c010249035aee expref: 19 pid: 5786 timeout: 302 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869453.937677:0:5741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94c81a582a00/0x3d2d1916761d7044 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.39@tcp remote: 0x375c010249035aee expref: 19 pid: 5786 timeout: 302 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869453.937710:0:5741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff94c803990f00) 00010000:00010000:2.0:1788869453.937716:0:5741:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff94c83fde6200/0x3d2d1916761d7083 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869453.937728:0:5741:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff94c83fde6200/0x3d2d1916761d7083 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869453.937738:0:5741:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94c83fde6200/0x3d2d1916761d7083 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869453.937773:0:5741:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788869453.937832:0:5741:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c808f51c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2125b9b3-626e-4cbe-be83-fb446e976ce2+18:2348:x1875765413096960:12345-192.168.201.39@tcp:103:ldlm_bl.0 Request processed in 222us (838us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869453.937841:0:5741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 72 00010000:00010000:0.0:1788869453.937990:0:5786:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff94c83fde6200/0x3d2d1916761d7083 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869453.937999:0:5786:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94c83fde6200/0x3d2d1916761d7083 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869453.938033:0:5786:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94c83fde6200/0x3d2d1916761d7083 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869453.938041:0:5786:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94c83fde6200/0x3d2d1916761d7083 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869453.938048:0:5786:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94c83fde6200/0x3d2d1916761d7083 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869453.938053:0:5786:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94c83fde6200 already unused, calling callback (ffffffffc21124f0) 00010000:00010000:0.0:1788869453.938059:0:5786:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94c83fde6200/0x3d2d1916761d7083 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869453.938067:0:5786:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94c83fde6200/0x3d2d1916761d7083 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869453.938078:0:5786:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff94c803990f00) 00010000:00010000:0.0:1788869453.938081:0:5786:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:0.0:1788869453.938092:0:5786:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94c83fde6200/0x3d2d1916761d7083 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869453.938099:0:5786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94c83fde6200/0x3d2d1916761d7083 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788869453.938161:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c808f50000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2125b9b3-626e-4cbe-be83-fb446e976ce2+17:11445:x1875765413096832:12345-192.168.201.39@tcp:55:lhsmtool_posix.0 Request processed in 4108us (4489us total) trans 0 rc -22/-22 00000100:00100000:0.0:1788869453.938171:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 186 00000100:00100000:0.0:1788869453.940965:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1788869453.941017:0:7884:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765413097088 00000100:00100000:1.0:1788869453.941027:0:7884:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765413097088 00000100:00100000:1.0:1788869453.941092:0:7884:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 57 00000100:00100000:1.0:1788869453.941101:0:7884:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c808f52d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:2125b9b3-626e-4cbe-be83-fb446e976ce2+8:2346:x1875765413097088:12345-192.168.201.39@tcp:1:lhsmtool_posix.0 00010000:00010000:1.0:1788869453.941165:0:7884:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 000000000ccbd149/0x3d2d1916761d708a lrc: 3/1,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 7884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869453.941189:0:7884:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000008b0be560/0x3d2d1916761d706e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.39@tcp remote: 0x375c010249035b0a expref: 8 pid: 7884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869453.941199:0:7884:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788869453.941205:0:7884:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788869453.941209:0:7884:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000ccbd149/0x3d2d1916761d708a lrc: 4/1,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 7884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869453.941278:0:7884:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000008b0be560/0x3d2d1916761d706e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.201.39@tcp remote: 0x375c010249035b0a expref: 8 pid: 7884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869453.941291:0:7884:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000008b0be560/0x3d2d1916761d706e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.201.39@tcp remote: 0x375c010249035b0a expref: 8 pid: 7884 timeout: 302 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788869453.941304:0:7884:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94c835155f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:7884:1875765421470080:192.168.201.39@tcp:104: 00000100:00100000:1.0:1788869453.941390:0:7884:0:(client.c:2702:ptlrpc_set_wait()) set ffff94c818e67d80 going to sleep for 11 seconds 00000100:00100000:0.0:1788869453.944136:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1788869453.944180:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765413097216 00000100:00100000:0.0:1788869453.944190:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765413097216 00010000:00010000:0.0:1788869453.944234:0:5788:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000008b0be560/0x3d2d1916761d706e lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.39@tcp remote: 0x375c010249035b0a expref: 9 pid: 7884 timeout: 302 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788869453.944300:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 73 00000100:00100000:0.0:1788869453.944311:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c808f51500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2125b9b3-626e-4cbe-be83-fb446e976ce2+9:2348:x1875765413097216:12345-192.168.201.39@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788869453.944328:0:5788:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788869453.944357:0:5788:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000008b0be560/0x3d2d1916761d706e lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.39@tcp remote: 0x375c010249035b0a expref: 9 pid: 7884 timeout: 302 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869453.944372:0:5788:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000008b0be560/0x3d2d1916761d706e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.201.39@tcp remote: 0x375c010249035b0a expref: 9 pid: 7884 timeout: 302 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869453.944414:0:5788:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788869453.944419:0:5788:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788869453.944426:0:5788:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000000ccbd149/0x3d2d1916761d708a lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 7884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869453.944446:0:5788:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000ccbd149/0x3d2d1916761d708a lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 7884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869453.944471:0:5788:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788869453.944528:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c808f51500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2125b9b3-626e-4cbe-be83-fb446e976ce2+9:2348:x1875765413097216:12345-192.168.201.39@tcp:103:ldlm_bl.0 Request processed in 219us (406us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869453.944550:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 73 00010000:00010000:2.0:1788869453.945085:0:7884:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008b0be560/0x3d2d1916761d706e lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.201.39@tcp remote: 0x375c010249035b0a expref: 8 pid: 7884 timeout: 302 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788869453.945103:0:7884:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94c835155f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:7884:1875765421470080:192.168.201.39@tcp:104: 00010000:00010000:2.0:1788869453.945126:0:7884:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000000ccbd149/0x3d2d1916761d708a lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 7884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869453.945625:0:7884:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000000ccbd149/0x3d2d1916761d708a lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 7884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869453.945636:0:7884:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000ccbd149/0x3d2d1916761d708a lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 7884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869453.945681:0:7884:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 000000000ccbd149/0x3d2d1916761d708a lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 7884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869453.945690:0:7884:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000ccbd149/0x3d2d1916761d708a lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 7884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869453.945698:0:7884:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000ccbd149/0x3d2d1916761d708a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 7884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869453.945706:0:7884:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94c83fde7400 already unused, calling callback (ffffffffc1703220) 00010000:00010000:2.0:1788869453.945711:0:7884:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000ccbd149/0x3d2d1916761d708a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 7884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869453.945720:0:7884:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000ccbd149/0x3d2d1916761d708a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 7884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869453.945737:0:7884:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000ccbd149/0x3d2d1916761d708a lrc: 2/0,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 7884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869453.945744:0:7884:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000ccbd149/0x3d2d1916761d708a lrc: 0/0,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 7884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788869453.945812:0:7884:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c808f52d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:2125b9b3-626e-4cbe-be83-fb446e976ce2+7:2346:x1875765413097088:12345-192.168.201.39@tcp:1:lhsmtool_posix.0 Request processed in 4710us (4860us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869453.945822:0:7884:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 57 00000100:00100000:0.0:1788869453.947797:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1788869453.948171:0:5756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765413097472 00000100:00100000:1.0:1788869453.948185:0:5756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765413097472 00000100:00100000:1.0:1788869453.948276:0:5756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 187 00000100:00100000:1.0:1788869453.948287:0:5756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c808f53100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2125b9b3-626e-4cbe-be83-fb446e976ce2+17:11445:x1875765413097472:12345-192.168.201.39@tcp:57:lhsmtool_posix.0 00010000:00010000:1.0:1788869453.948512:0:5756:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94c83fde6e00/0x3d2d1916761d7091 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869453.948544:0:5756:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94c83fde6e00/0x3d2d1916761d7091 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869453.948560:0:5756:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94c83fde6e00/0x3d2d1916761d7091 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869453.948822:0:5756:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94c83fde6a00/0x3d2d1916761d7098 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869453.948835:0:5756:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504ca00/0x3d2d1916761d7052 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.39@tcp remote: 0x375c010249035af5 expref: 18 pid: 5757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869453.948856:0:5756:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff94c83fde6a00/0x3d2d1916761d7098 lrc: 4/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869453.948897:0:5756:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504ca00/0x3d2d1916761d7052 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.201.39@tcp remote: 0x375c010249035af5 expref: 18 pid: 5757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869453.948912:0:5756:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504ca00/0x3d2d1916761d7052 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.201.39@tcp remote: 0x375c010249035af5 expref: 18 pid: 5757 timeout: 302 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788869453.948929:0:5756:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94c835156680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5756:1875765421470208:192.168.201.39@tcp:104: 00000100:00100000:1.0:1788869453.949030:0:5756:0:(client.c:2702:ptlrpc_set_wait()) set ffff94c818e67e40 going to sleep for 11 seconds 00000100:00100000:0.0:1788869453.951685:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1788869453.951734:0:7448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765413097600 00000100:00100000:3.0:1788869453.951746:0:7448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765413097600 00010000:00010000:3.0:1788869453.951835:0:7448:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504ca00/0x3d2d1916761d7052 lrc: 5/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.39@tcp remote: 0x375c010249035af5 expref: 19 pid: 5757 timeout: 302 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788869453.951884:0:7448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 74 00000100:00100000:3.0:1788869453.951895:0:7448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c808f50700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:2125b9b3-626e-4cbe-be83-fb446e976ce2+19:2348:x1875765413097600:12345-192.168.201.39@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788869453.951914:0:7448:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788869453.951922:0:7448:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504ca00/0x3d2d1916761d7052 lrc: 5/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.39@tcp remote: 0x375c010249035af5 expref: 19 pid: 5757 timeout: 302 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869453.951937:0:7448:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504ca00/0x3d2d1916761d7052 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.201.39@tcp remote: 0x375c010249035af5 expref: 19 pid: 5757 timeout: 302 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869453.951974:0:7448:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff94c803990f00) 00010000:00010000:3.0:1788869453.951979:0:7448:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff94c83fde6a00/0x3d2d1916761d7098 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869453.951990:0:7448:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff94c83fde6a00/0x3d2d1916761d7098 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869453.951998:0:7448:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94c83fde6a00/0x3d2d1916761d7098 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869453.952023:0:7448:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788869453.952085:0:7448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c808f50700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:2125b9b3-626e-4cbe-be83-fb446e976ce2+19:2348:x1875765413097600:12345-192.168.201.39@tcp:103:ldlm_bl.0 Request processed in 192us (408us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869453.952094:0:7448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 74 00010000:00010000:1.0:1788869453.952471:0:5756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504ca00/0x3d2d1916761d7052 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.201.39@tcp remote: 0x375c010249035af5 expref: 18 pid: 5757 timeout: 302 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788869453.952492:0:5756:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94c835156680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5756:1875765421470208:192.168.201.39@tcp:104: 00010000:00010000:1.0:1788869453.952517:0:5756:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff94c83fde6a00/0x3d2d1916761d7098 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869453.952527:0:5756:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff94c83fde6a00/0x3d2d1916761d7098 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869453.952546:0:5756:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94c83fde6a00/0x3d2d1916761d7098 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788869453.952785:0:5756:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967462 00000001:00080000:1.0:1788869453.952936:0:5756:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967463 00000001:00080000:1.0:1788869453.952982:0:5756:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967464 00000100:00100000:1.0:1788869453.953091:0:5756:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94c835156680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5756:1875765421470336:0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1788869453.953153:0:5756:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869453.953189:0:5756:0:(client.c:2702:ptlrpc_set_wait()) set ffff94c818e67540 going to sleep for 11 seconds 00000100:00100000:0.0:1788869453.953207:0:5760:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765421470336 00000100:00100000:0.0:1788869453.953212:0:5760:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765421470336 00000100:00100000:0.0:1788869453.953279:0:5760:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788869453.953289:0:5760:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c835156a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5756:x1875765421470336:12345-0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1788869453.953446:0:5760:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c835156a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5756:x1875765421470336:12345-0@lo:1000:mdt00_001.0 Request processed in 158us (292us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869453.953454:0:5760:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788869453.954561:0:5756:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967315 gen 2 00000004:00080000:1.0:1788869453.954569:0:5756:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94c835152300, transno 4294967315 00000100:00100000:1.0:1788869453.954586:0:5756:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94c835156680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5756:1875765421470336:0@lo:1000:mdt00_001.0 00000001:00080000:1.0:1788869453.955113:0:5756:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967465 00000100:00100000:1.0:1788869453.955184:0:5756:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94c835156680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5756:1875765421470464:0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1788869453.955229:0:5756:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869453.955285:0:5756:0:(client.c:2702:ptlrpc_set_wait()) set ffff94c818e67e40 going to sleep for 11 seconds 00000100:00100000:3.0:1788869453.955292:0:5761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765421470464 00000100:00100000:3.0:1788869453.955300:0:5761:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765421470464 00000100:00100000:3.0:1788869453.955348:0:5761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788869453.955356:0:5761:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c835154a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5756:x1875765421470464:12345-0@lo:1000:mdt00_001.0 00000100:00100000:3.0:1788869453.955542:0:5761:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c835154a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5756:x1875765421470464:12345-0@lo:1000:mdt00_001.0 Request processed in 178us (304us total) trans 4294967317 rc 0/0 00000100:00100000:3.0:1788869453.955550:0:5761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788869453.955572:0:5756:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94c835156680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5756:1875765421470464:0@lo:1000:mdt00_001.0 00010000:00010000:0.0:1788869453.955606:0:5756:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94c83fde6a00/0x3d2d1916761d7098 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869453.955617:0:5756:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94c83fde6a00/0x3d2d1916761d7098 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869453.955626:0:5756:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94c83fde6a00/0x3d2d1916761d7098 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869453.955633:0:5756:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94c83fde6a00 already unused, calling callback (ffffffffc21124f0) 00010000:00010000:0.0:1788869453.955644:0:5756:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94c83fde6a00/0x3d2d1916761d7098 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869453.955651:0:5756:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94c83fde6a00/0x3d2d1916761d7098 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869453.955664:0:5756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff94c803990f00) 00010000:00010000:0.0:1788869453.955666:0:5756:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788869453.955669:0:5756:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94c83fde6a00/0x3d2d1916761d7098 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869453.955675:0:5756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94c83fde6a00/0x3d2d1916761d7098 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869453.955700:0:5756:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504c200/0x3d2d1916761d6fcd lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869453.955704:0:5756:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504c200/0x3d2d1916761d6fcd lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869453.955708:0:5756:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504c200/0x3d2d1916761d6fcd lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869453.955711:0:5756:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94c83504c200 already unused, calling callback (ffffffffc21124f0) 00010000:00010000:0.0:1788869453.955713:0:5756:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504c200/0x3d2d1916761d6fcd lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869453.955716:0:5756:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504c200/0x3d2d1916761d6fcd lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869453.955722:0:5756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff94c819394b00) 00010000:00010000:0.0:1788869453.955724:0:5756:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788869453.955732:0:5756:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504c200/0x3d2d1916761d6fcd lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869453.955736:0:5756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504c200/0x3d2d1916761d6fcd lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869453.955758:0:5756:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94c81a582e00/0x3d2d1916761d709f lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869453.955770:0:5756:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff94c81a583400/0x3d2d1916761d6fe9 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0x375c010249035ad9 expref: 21 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869453.955777:0:5756:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff94c81a582e00/0x3d2d1916761d709f lrc: 4/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869453.955798:0:5756:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff94c81a583400/0x3d2d1916761d6fe9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.39@tcp remote: 0x375c010249035ad9 expref: 21 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869453.955808:0:5756:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff94c81a583400/0x3d2d1916761d6fe9 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.39@tcp remote: 0x375c010249035ad9 expref: 21 pid: 5786 timeout: 302 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788869453.955816:0:5756:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94c808f51180 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5756:1875765421470592:192.168.201.39@tcp:104: 00000100:00100000:0.0:1788869453.955879:0:5756:0:(client.c:2702:ptlrpc_set_wait()) set ffff94c8033c4b40 going to sleep for 11 seconds 00000100:00100000:1.0:1788869453.959213:0:5756:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94c808f51180 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5756:1875765421470592:192.168.201.39@tcp:104: 00010000:00010000:1.0:1788869453.959242:0:5756:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff94c81a582e00/0x3d2d1916761d709f lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788869453.959545:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1788869453.959606:0:5741:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765413097728 00000100:00100000:2.0:1788869453.959615:0:5741:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765413097728 00010000:00010000:2.0:1788869453.959675:0:5741:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff94c81a583400/0x3d2d1916761d6fe9 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.39@tcp remote: 0x375c010249035ad9 expref: 22 pid: 5786 timeout: 302 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788869453.959715:0:5741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 75 00000100:00100000:2.0:1788869453.959724:0:5741:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c808f50e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2125b9b3-626e-4cbe-be83-fb446e976ce2+22:2347:x1875765413097728:12345-192.168.201.39@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788869453.959741:0:5741:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788869453.959748:0:5741:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff94c81a583400/0x3d2d1916761d6fe9 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.39@tcp remote: 0x375c010249035ad9 expref: 22 pid: 5786 timeout: 302 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869453.959762:0:5741:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff94c81a583400/0x3d2d1916761d6fe9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.39@tcp remote: 0x375c010249035ad9 expref: 22 pid: 5786 timeout: 302 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869453.959787:0:5741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94c81a583400/0x3d2d1916761d6fe9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.39@tcp remote: 0x375c010249035ad9 expref: 22 pid: 5786 timeout: 302 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869453.959803:0:5741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff94c819394b00) 00010000:00010000:2.0:1788869453.959809:0:5741:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff94c81a582e00/0x3d2d1916761d709f lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869453.959820:0:5741:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff94c81a582e00/0x3d2d1916761d709f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869453.959829:0:5741:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94c81a582e00/0x3d2d1916761d709f lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869453.959854:0:5741:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788869453.959868:0:5756:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff94c81a582e00/0x3d2d1916761d709f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869453.959875:0:5756:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94c81a582e00/0x3d2d1916761d709f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788869453.959911:0:5741:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c808f50e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2125b9b3-626e-4cbe-be83-fb446e976ce2+21:2347:x1875765413097728:12345-192.168.201.39@tcp:103:ldlm_bl.0 Request processed in 188us (377us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869453.959934:0:5741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 75 00010000:00010000:0.0:1788869453.960044:0:5756:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94c81a582e00/0x3d2d1916761d709f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869453.960060:0:5756:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94c81a582e00/0x3d2d1916761d709f lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869453.960067:0:5756:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94c81a582e00/0x3d2d1916761d709f lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869453.960075:0:5756:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94c81a582e00 already unused, calling callback (ffffffffc21124f0) 00010000:00010000:0.0:1788869453.960080:0:5756:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94c81a582e00/0x3d2d1916761d709f lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869453.960089:0:5756:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94c81a582e00/0x3d2d1916761d709f lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869453.960100:0:5756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff94c819394b00) 00010000:00010000:0.0:1788869453.960103:0:5756:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788869453.960107:0:5756:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94c81a582e00/0x3d2d1916761d709f lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869453.960114:0:5756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94c81a582e00/0x3d2d1916761d709f lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869453.960126:0:5756:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94c83fde6e00/0x3d2d1916761d7091 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869453.960133:0:5756:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94c83fde6e00/0x3d2d1916761d7091 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869453.960140:0:5756:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94c83fde6e00/0x3d2d1916761d7091 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869453.960145:0:5756:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94c83fde6e00 already unused, calling callback (ffffffffc21124f0) 00010000:00010000:0.0:1788869453.960155:0:5756:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94c83fde6e00/0x3d2d1916761d7091 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869453.960162:0:5756:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94c83fde6e00/0x3d2d1916761d7091 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869453.960171:0:5756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff94c819394b00) 00010000:00010000:0.0:1788869453.960174:0:5756:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1788869453.960177:0:5756:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94c83fde6e00/0x3d2d1916761d7091 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869453.960183:0:5756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94c83fde6e00/0x3d2d1916761d7091 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788869453.960571:0:5756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c808f53100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2125b9b3-626e-4cbe-be83-fb446e976ce2+20:11445:x1875765413097472:12345-192.168.201.39@tcp:57:lhsmtool_posix.0 Request processed in 12285us (12781us total) trans 4294967466 rc 0/0 00000100:00100000:0.0:1788869453.960581:0:5756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 187 00000020:00080000:0.0:1788869453.960585:0:5756:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:2.0:1788869453.960772:0:11485:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788869453.960778:0:11485:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788869453.961417:0:11485:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 5 00000040:00080000:2.0:1788869453.961427:0:11485:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1788869453.962639:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1788869453.963241:0:11820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765413097984 00000100:00100000:1.0:1788869453.963282:0:11820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765413097984 00000100:00100000:1.0:1788869453.963775:0:11820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 50 00000100:00100000:1.0:1788869453.963789:0:11820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c81876bc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:2125b9b3-626e-4cbe-be83-fb446e976ce2+20:11445:x1875765413097984:12345-192.168.201.39@tcp:35:lhsmtool_posix.0 00000004:00080000:1.0:1788869453.965123:0:11820:0:(mdd_object.c:4016:mdd_close()) Object [0x200000401:0xd:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:1.0:1788869453.965266:0:11820:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967467 00010000:00010000:1.0:1788869453.965547:0:11820:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94c83fde6400/0x3d2d1916761d70a6 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869453.965569:0:11820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94c83fde6400/0x3d2d1916761d70a6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 11820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869453.965583:0:11820:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94c83fde6400/0x3d2d1916761d70a6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 11820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869453.965606:0:11820:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94c83fde6400/0x3d2d1916761d70a6 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 11820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869453.965614:0:11820:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94c83fde6400/0x3d2d1916761d70a6 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 11820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869453.965621:0:11820:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94c83fde6400/0x3d2d1916761d70a6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 11820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869453.965643:0:11820:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788869453.965671:0:5743:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788869453.965679:0:5743:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94c83fde6400/0x3d2d1916761d70a6 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 11820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869453.965687:0:5743:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94c83fde6400 already unused, calling callback (ffffffffc1703220) 00010000:00010000:0.0:1788869453.965691:0:5743:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94c83fde6400/0x3d2d1916761d70a6 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 11820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869453.965697:0:5743:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94c83fde6400/0x3d2d1916761d70a6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 11820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869453.965710:0:5743:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff94c81a585800) 00010000:00010000:0.0:1788869453.965712:0:5743:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1788869453.965721:0:5743:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94c83fde6400/0x3d2d1916761d70a6 lrc: 1/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 11820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869453.965727:0:5743:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94c83fde6400/0x3d2d1916761d70a6 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 11820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869453.965742:0:5743:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788869453.965743:0:5743:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788869453.965745:0:5743:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788869453.965770:0:11820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c81876bc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:2125b9b3-626e-4cbe-be83-fb446e976ce2+22:11445:x1875765413097984:12345-192.168.201.39@tcp:35:lhsmtool_posix.0 Request processed in 1981us (3134us total) trans 4294967468 rc 0/0 00000100:00100000:1.0:1788869453.965778:0:11820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 50 00000020:00080000:1.0:1788869453.965783:0:11820:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1788869454.237353:0:5742:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788869455.259520:0:7447:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788869455.264178:0:12312:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788869455.264187:0:12312:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788869455.264244:0:12312:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 5 00000040:00080000:2.0:1788869455.266262:0:12312:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1788869455.321598:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1788869455.321669:0:5757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765413098240 00000100:00100000:2.0:1788869455.321678:0:5757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765413098240 00000100:00100000:2.0:1788869455.321750:0:5757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 188 00000100:00100000:2.0:1788869455.321761:0:5757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c808f51f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2125b9b3-626e-4cbe-be83-fb446e976ce2+22:11463:x1875765413098240:12345-192.168.201.39@tcp:101:lfs.0 00010000:00010000:2.0:1788869455.321784:0:5757:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788869455.321803:0:5757:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94c805038800/0x3d2d1916761d70ad lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x375c010249035b11 expref: -99 pid: 5757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869455.322045:0:5757:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff94c805039400/0x3d2d1916761d70b4 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869455.322058:0:5757:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94c805039400/0x3d2d1916761d70b4 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869455.322068:0:5757:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94c805039400/0x3d2d1916761d70b4 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5757 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788869455.322079:0:5757:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 7680 00010000:00010000:2.0:1788869455.322273:0:5757:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94c805038800/0x3d2d1916761d70ad lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0x375c010249035b11 expref: 25 pid: 5757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869455.322295:0:5757:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94c805039400/0x3d2d1916761d70b4 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0x375c010249035b11 expref: 24 pid: 5757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869455.322303:0:5757:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff94c802f3fd00) 00010000:00010000:2.0:1788869455.322307:0:5757:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1788869455.322310:0:5757:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94c805039400, rc 0) 00000100:00100000:2.0:1788869455.322367:0:5757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c808f51f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2125b9b3-626e-4cbe-be83-fb446e976ce2+24:11463:x1875765413098240:12345-192.168.201.39@tcp:101:lfs.0 Request processed in 608us (777us total) trans 4294967469 rc 0/0 00000100:00100000:2.0:1788869455.322374:0:5757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 188 00000100:00080000:3.0:1788869455.322438:0:5751:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788869455.323862:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1788869455.323942:0:5755:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765413098368 00000100:00100000:3.0:1788869455.323950:0:5755:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765413098368 00000100:00100000:3.0:1788869455.323996:0:5755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 189 00000100:00100000:3.0:1788869455.324005:0:5755:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c808f52680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2125b9b3-626e-4cbe-be83-fb446e976ce2+24:11463:x1875765413098368:12345-192.168.201.39@tcp:34:lfs.0 00010000:00010000:3.0:1788869455.324064:0:5755:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504c400/0x3d2d1916761d70c2 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869455.324076:0:5755:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504c400/0x3d2d1916761d70c2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869455.324085:0:5755:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504c400/0x3d2d1916761d70c2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869455.324103:0:5755:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504c000/0x3d2d1916761d70c9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869455.324111:0:5755:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504c000/0x3d2d1916761d70c9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869455.324118:0:5755:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504c000/0x3d2d1916761d70c9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869455.324679:0:5755:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504c200/0x3d2d1916761d70d0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869455.324695:0:5755:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504c200/0x3d2d1916761d70d0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869455.324703:0:5755:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504c200/0x3d2d1916761d70d0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788869455.324738:0:5755:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504c200/0x3d2d1916761d70d0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869455.324751:0:5755:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504c400/0x3d2d1916761d70c2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869455.324758:0:5755:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504c400/0x3d2d1916761d70c2 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869455.324766:0:5755:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504c400/0x3d2d1916761d70c2 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869455.324771:0:5755:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94c83504c400 already unused, calling callback (ffffffffc21124f0) 00010000:00010000:3.0:1788869455.324775:0:5755:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504c400/0x3d2d1916761d70c2 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869455.324783:0:5755:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504c400/0x3d2d1916761d70c2 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869455.324794:0:5755:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff94c802f3fd00) 00010000:00010000:3.0:1788869455.324797:0:5755:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788869455.324802:0:5755:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504c400/0x3d2d1916761d70c2 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869455.324809:0:5755:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504c400/0x3d2d1916761d70c2 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869455.324829:0:5755:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504c000/0x3d2d1916761d70c9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869455.324836:0:5755:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504c000/0x3d2d1916761d70c9 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869455.324842:0:5755:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504c000/0x3d2d1916761d70c9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869455.324848:0:5755:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94c83504c000 already unused, calling callback (ffffffffc21124f0) 00010000:00010000:3.0:1788869455.324852:0:5755:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504c000/0x3d2d1916761d70c9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869455.324858:0:5755:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504c000/0x3d2d1916761d70c9 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869455.324867:0:5755:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff94c819394500) 00010000:00010000:3.0:1788869455.324870:0:5755:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788869455.324872:0:5755:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504c000/0x3d2d1916761d70c9 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869455.324878:0:5755:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504c000/0x3d2d1916761d70c9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869455.324891:0:5755:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504c200/0x3d2d1916761d70d0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869455.324898:0:5755:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504c200/0x3d2d1916761d70d0 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869455.324903:0:5755:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504c200/0x3d2d1916761d70d0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869455.324916:0:5755:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94c83504c200 already unused, calling callback (ffffffffc21124f0) 00010000:00010000:3.0:1788869455.324919:0:5755:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504c200/0x3d2d1916761d70d0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869455.324926:0:5755:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504c200/0x3d2d1916761d70d0 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869455.324935:0:5755:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff94c819394800) 00010000:00010000:3.0:1788869455.324937:0:5755:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788869455.324941:0:5755:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504c200/0x3d2d1916761d70d0 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869455.324947:0:5755:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504c200/0x3d2d1916761d70d0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788869455.325025:0:5755:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c808f52680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2125b9b3-626e-4cbe-be83-fb446e976ce2+24:11463:x1875765413098368:12345-192.168.201.39@tcp:34:lfs.0 Request processed in 1020us (1165us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869455.325034:0:5755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 189 00000100:00100000:0.0:1788869455.354225:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1788869455.354403:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765413098624 00000100:00100000:1.0:1788869455.354421:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765413098624 00000100:00100000:1.0:1788869455.354475:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 190 00000100:00100000:1.0:1788869455.354484:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c808f52a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2125b9b3-626e-4cbe-be83-fb446e976ce2+24:11466:x1875765413098624:12345-192.168.201.39@tcp:101:lfs.0 00010000:00010000:1.0:1788869455.354515:0:5786:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788869455.354536:0:5786:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94c83fde7a00/0x3d2d1916761d70d7 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x375c010249035b18 expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869455.354603:0:5786:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff94c83fde7c00/0x3d2d1916761d70de lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869455.354618:0:5786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94c83fde7c00/0x3d2d1916761d70de lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869455.354629:0:5786:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94c83fde7c00/0x3d2d1916761d70de lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869455.354655:0:5786:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94c83fde6c00/0x3d2d1916761d70e5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869455.354662:0:5786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94c83fde6c00/0x3d2d1916761d70e5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869455.354669:0:5786:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94c83fde6c00/0x3d2d1916761d70e5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869455.354929:0:5786:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94c83fde7200/0x3d2d1916761d70ec lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869455.354937:0:5786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94c83fde7200/0x3d2d1916761d70ec lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869455.354944:0:5786:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94c83fde7200/0x3d2d1916761d70ec lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788869455.354954:0:5786:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 9 00010000:00010000:1.0:1788869455.355034:0:5786:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff94c83fde7c00/0x3d2d1916761d70de lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869455.355042:0:5786:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94c83fde7c00/0x3d2d1916761d70de lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869455.355048:0:5786:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94c83fde7c00/0x3d2d1916761d70de lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869455.355054:0:5786:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94c83fde7c00 already unused, calling callback (ffffffffc21124f0) 00010000:00010000:1.0:1788869455.355058:0:5786:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94c83fde7c00/0x3d2d1916761d70de lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869455.355075:0:5786:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94c83fde7c00/0x3d2d1916761d70de lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869455.355086:0:5786:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff94c802f3fd00) 00010000:00010000:1.0:1788869455.355089:0:5786:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788869455.355092:0:5786:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94c83fde7c00/0x3d2d1916761d70de lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869455.355099:0:5786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94c83fde7c00/0x3d2d1916761d70de lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869455.355108:0:5786:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94c83fde6c00/0x3d2d1916761d70e5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869455.355113:0:5786:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94c83fde6c00/0x3d2d1916761d70e5 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869455.355119:0:5786:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94c83fde6c00/0x3d2d1916761d70e5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869455.355124:0:5786:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94c83fde6c00 already unused, calling callback (ffffffffc21124f0) 00010000:00010000:1.0:1788869455.355126:0:5786:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94c83fde6c00/0x3d2d1916761d70e5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869455.355131:0:5786:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94c83fde6c00/0x3d2d1916761d70e5 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869455.355137:0:5786:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff94c81a585c00) 00010000:00010000:1.0:1788869455.355140:0:5786:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788869455.355142:0:5786:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94c83fde6c00/0x3d2d1916761d70e5 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869455.355156:0:5786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94c83fde6c00/0x3d2d1916761d70e5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869455.355202:0:5786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94c83fde7a00/0x3d2d1916761d70d7 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0x375c010249035b18 expref: 27 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869455.355216:0:5786:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94c83fde7200/0x3d2d1916761d70ec lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0x375c010249035b18 expref: 26 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869455.355224:0:5786:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff94c81a585500) 00010000:00010000:1.0:1788869455.355226:0:5786:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788869455.355229:0:5786:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94c83fde7200, rc 0) 00000100:00100000:1.0:1788869455.355304:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c808f52a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2125b9b3-626e-4cbe-be83-fb446e976ce2+26:11466:x1875765413098624:12345-192.168.201.39@tcp:101:lfs.0 Request processed in 821us (1087us total) trans 4294967470 rc 0/0 00000100:00100000:1.0:1788869455.355311:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 190 00000100:00100000:1.0:1788869455.357949:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1788869455.357997:0:5756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765413098752 00000100:00100000:0.0:1788869455.358013:0:5756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765413098752 00000100:00100000:0.0:1788869455.358066:0:5756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 191 00000100:00100000:0.0:1788869455.358076:0:5756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c835155500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2125b9b3-626e-4cbe-be83-fb446e976ce2+26:11466:x1875765413098752:12345-192.168.201.39@tcp:54:lfs.0 00010000:00010000:0.0:1788869455.358134:0:5756:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94c81a582e00/0x3d2d1916761d70fa lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869455.358146:0:5756:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94c81a582e00/0x3d2d1916761d70fa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869455.358154:0:5756:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94c81a582e00/0x3d2d1916761d70fa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869455.358174:0:5756:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94c81a582e00/0x3d2d1916761d70fa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869455.358178:0:5756:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94c81a582e00/0x3d2d1916761d70fa lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869455.358195:0:5756:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94c81a582e00/0x3d2d1916761d70fa lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869455.358199:0:5756:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94c81a582e00 already unused, calling callback (ffffffffc21124f0) 00010000:00010000:0.0:1788869455.358202:0:5756:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94c81a582e00/0x3d2d1916761d70fa lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869455.358208:0:5756:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94c81a582e00/0x3d2d1916761d70fa lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869455.358218:0:5756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff94c81a585500) 00010000:00010000:0.0:1788869455.358221:0:5756:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788869455.358225:0:5756:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94c81a582e00/0x3d2d1916761d70fa lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869455.358231:0:5756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94c81a582e00/0x3d2d1916761d70fa lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788869455.358338:0:5756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c835155500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2125b9b3-626e-4cbe-be83-fb446e976ce2+26:11466:x1875765413098752:12345-192.168.201.39@tcp:54:lfs.0 Request processed in 263us (396us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869455.358347:0:5756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 191 00000100:00100000:0.0:1788869455.359436:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1788869455.359491:0:5758:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765413099008 00000100:00100000:2.0:1788869455.359497:0:5758:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765413099008 00000100:00100000:2.0:1788869455.359551:0:5758:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 51 00000100:00100000:2.0:1788869455.359560:0:5758:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c808f50a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2125b9b3-626e-4cbe-be83-fb446e976ce2+26:11466:x1875765413099008:12345-192.168.201.39@tcp:35:lfs.0 00000100:00100000:2.0:1788869455.359886:0:5758:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c808f50a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2125b9b3-626e-4cbe-be83-fb446e976ce2+27:11466:x1875765413099008:12345-192.168.201.39@tcp:35:lfs.0 Request processed in 326us (451us total) trans 4294967471 rc 0/0 00000100:00100000:2.0:1788869455.359894:0:5758:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 51 00000100:00100000:2.0:1788869455.384003:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1788869455.384080:0:5757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765413099264 00000100:00100000:3.0:1788869455.384091:0:5757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765413099264 00000100:00100000:3.0:1788869455.384154:0:5757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 192 00000100:00100000:3.0:1788869455.384163:0:5757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c835a3ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2125b9b3-626e-4cbe-be83-fb446e976ce2+27:10993:x1875765413099264:12345-192.168.201.39@tcp:101:bash.0 00010000:00010000:3.0:1788869455.384186:0:5757:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788869455.384205:0:5757:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504c200/0x3d2d1916761d7101 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x375c010249035b1f expref: -99 pid: 5757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869455.384338:0:5757:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504c000/0x3d2d1916761d7108 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869455.384367:0:5757:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff94c83fde7200/0x3d2d1916761d70ec lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0x375c010249035b18 expref: 28 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869455.384377:0:5757:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504c000/0x3d2d1916761d7108 lrc: 4/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869455.384420:0:5757:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff94c83fde7200/0x3d2d1916761d70ec lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.39@tcp remote: 0x375c010249035b18 expref: 28 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869455.384433:0:5757:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff94c83fde7200/0x3d2d1916761d70ec lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.39@tcp remote: 0x375c010249035b18 expref: 28 pid: 5786 timeout: 303 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788869455.384447:0:5757:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94c835152300 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5757:1875765421470720:192.168.201.39@tcp:104: 00000100:00100000:3.0:1788869455.384561:0:5757:0:(client.c:2702:ptlrpc_set_wait()) set ffff94c8357d5f00 going to sleep for 11 seconds 00000100:00100000:3.0:1788869455.387705:0:5757:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94c835152300 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5757:1875765421470720:192.168.201.39@tcp:104: 00010000:00010000:3.0:1788869455.387733:0:5757:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504c000/0x3d2d1916761d7108 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5757 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788869455.387772:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1788869455.387832:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765413099392 00000100:00100000:0.0:1788869455.387840:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765413099392 00010000:00010000:0.0:1788869455.387875:0:5788:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff94c83fde7200/0x3d2d1916761d70ec lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.39@tcp remote: 0x375c010249035b18 expref: 29 pid: 5786 timeout: 303 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788869455.387914:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 76 00000100:00100000:0.0:1788869455.387925:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c835a3f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2125b9b3-626e-4cbe-be83-fb446e976ce2+29:2347:x1875765413099392:12345-192.168.201.39@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788869455.387953:0:5788:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788869455.387961:0:5788:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff94c83fde7200/0x3d2d1916761d70ec lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.39@tcp remote: 0x375c010249035b18 expref: 29 pid: 5786 timeout: 303 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869455.387974:0:5788:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff94c83fde7200/0x3d2d1916761d70ec lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.39@tcp remote: 0x375c010249035b18 expref: 29 pid: 5786 timeout: 303 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869455.388007:0:5788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94c83fde7200/0x3d2d1916761d70ec lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.39@tcp remote: 0x375c010249035b18 expref: 29 pid: 5786 timeout: 303 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869455.388022:0:5788:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff94c81a585500) 00010000:00010000:0.0:1788869455.388027:0:5788:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504c000/0x3d2d1916761d7108 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869455.388040:0:5788:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504c000/0x3d2d1916761d7108 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869455.388048:0:5788:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504c000/0x3d2d1916761d7108 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869455.388073:0:5788:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788869455.388096:0:5757:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504c000/0x3d2d1916761d7108 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869455.388105:0:5757:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504c000/0x3d2d1916761d7108 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5757 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788869455.388125:0:5757:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 9 00000100:00100000:0.0:1788869455.388138:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c835a3f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2125b9b3-626e-4cbe-be83-fb446e976ce2+28:2347:x1875765413099392:12345-192.168.201.39@tcp:103:ldlm_bl.0 Request processed in 214us (365us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869455.388147:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 76 00010000:00010000:3.0:1788869455.388282:0:5757:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504c200/0x3d2d1916761d7101 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0x375c010249035b1f expref: 29 pid: 5757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869455.388359:0:5757:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504c000/0x3d2d1916761d7108 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0x375c010249035b1f expref: 28 pid: 5757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869455.388369:0:5757:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff94c81a585500) 00010000:00010000:3.0:1788869455.388371:0:5757:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1788869455.388374:0:5757:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94c83504c000, rc 0) 00000100:00100000:3.0:1788869455.388416:0:5757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c835a3ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2125b9b3-626e-4cbe-be83-fb446e976ce2+28:10993:x1875765413099264:12345-192.168.201.39@tcp:101:bash.0 Request processed in 4254us (4419us total) trans 4294967472 rc 0/0 00000100:00100000:3.0:1788869455.388423:0:5757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 192 00000100:00100000:2.0:1788869455.391172:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1788869455.391219:0:5755:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765413099648 00000100:00100000:3.0:1788869455.391229:0:5755:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765413099648 00000100:00100000:0.0:1788869455.391333:0:5756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 193 00000100:00100000:0.0:1788869455.391346:0:5756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c835a3e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2125b9b3-626e-4cbe-be83-fb446e976ce2+28:10993:x1875765413099648:12345-192.168.201.39@tcp:36:bash.0 00010000:00010000:0.0:1788869455.391583:0:5756:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94c81a582a00/0x3d2d1916761d7116 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869455.391614:0:5756:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94c81a582a00/0x3d2d1916761d7116 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869455.391625:0:5756:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94c81a582a00/0x3d2d1916761d7116 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788869455.391677:0:5756:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967473 00000004:00010000:0.0:1788869455.391702:0:5756:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000017ad28fa reply state 0000000094438fb1 transno 4294967474 ns: mdt-lustre-MDT0000_UUID lock: ffff94c81a582a00/0x3d2d1916761d7116 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788869455.391723:0:5756:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000001:00080000:0.0:1788869455.391772:0:5756:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967474 00000100:00100000:0.0:1788869455.391864:0:5756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c835a3e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2125b9b3-626e-4cbe-be83-fb446e976ce2+32:10993:x1875765413099648:12345-192.168.201.39@tcp:36:bash.0 Request processed in 522us (696us total) trans 4294967475 rc 0/0 00000100:00100000:0.0:1788869455.391872:0:5756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 193 00000020:00080000:0.0:1788869455.391877:0:5756:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00010000:00010000:2.0:1788869455.393965:0:3269:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94c81a582a00/0x3d2d1916761d7116 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788869455.393976:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00010000:00010000:2.0:1788869455.393984:0:3269:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94c81a582a00/0x3d2d1916761d7116 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869455.394000:0:3269:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94c81a582a00/0x3d2d1916761d7116 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869455.394019:0:3269:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94c81a582a00 already unused, calling callback (ffffffffc21124f0) 00010000:00010000:2.0:1788869455.394025:0:3269:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94c81a582a00/0x3d2d1916761d7116 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788869455.394026:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765413099776 00010000:00010000:2.0:1788869455.394034:0:3269:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94c81a582a00/0x3d2d1916761d7116 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788869455.394045:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765413099776 00010000:00010000:2.0:1788869455.394052:0:3269:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff94c81a585500) 00010000:00010000:2.0:1788869455.394057:0:3269:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788869455.394061:0:3269:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94c81a582a00/0x3d2d1916761d7116 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869455.394068:0:3269:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94c81a582a00/0x3d2d1916761d7116 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788869455.394096:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 194 00000100:00100000:0.0:1788869455.394105:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c835157800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2125b9b3-626e-4cbe-be83-fb446e976ce2+31:10993:x1875765413099776:12345-192.168.201.39@tcp:101:bash.0 00010000:00010000:0.0:1788869455.394124:0:5786:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788869455.394136:0:5786:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94c81a583400/0x3d2d1916761d711d lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x375c010249035b26 expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869455.394174:0:5786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94c81a583400/0x3d2d1916761d711d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.39@tcp remote: 0x375c010249035b26 expref: 32 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869455.394183:0:5786:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94c81a583400/0x3d2d1916761d711d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.39@tcp remote: 0x375c010249035b26 expref: 32 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869455.394202:0:5786:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff94c81a585500) 00010000:00010000:0.0:1788869455.394204:0:5786:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788869455.394205:0:5786:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94c81a583400, rc 0) 00000100:00100000:0.0:1788869455.394245:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c835157800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2125b9b3-626e-4cbe-be83-fb446e976ce2+32:10993:x1875765413099776:12345-192.168.201.39@tcp:101:bash.0 Request processed in 141us (276us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869455.394276:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 194 00000100:00100000:1.0:1788869455.395970:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1788869455.396015:0:11822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765413099904 00000100:00100000:0.0:1788869455.396022:0:11822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765413099904 00000100:00080000:3.0:1788869455.396067:0:5751:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788869455.396087:0:11822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 58 00000100:00100000:0.0:1788869455.396095:0:11822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c835155f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:2125b9b3-626e-4cbe-be83-fb446e976ce2+7:10993:x1875765413099904:12345-192.168.201.39@tcp:101:bash.0 00010000:00010000:0.0:1788869455.396105:0:11822:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788869455.396117:0:11822:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000546e452a/0x3d2d1916761d7124 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x375c010249035b2d expref: -99 pid: 11822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788869455.396135:0:11822:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x5:0x0] initial LVB size: 9, mtime: 0x6a9ffb4b, atime: 0x6a9ffb4a, ctime: 0x6a9ffb4b, blocks: 0xb 00010000:00010000:0.0:1788869455.396149:0:11822:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=203s v=(0 0) 00010000:00010000:0.0:1788869455.396153:0:11822:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788869455.396160:0:11822:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000546e452a/0x3d2d1916761d7124 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.201.39@tcp remote: 0x375c010249035b2d expref: 8 pid: 11822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869455.396185:0:11822:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000546e452a/0x3d2d1916761d7124 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.39@tcp remote: 0x375c010249035b2d expref: 8 pid: 11822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869455.396196:0:11822:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94c81a583000, rc 0) 00000100:00100000:0.0:1788869455.396230:0:11822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c835155f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:2125b9b3-626e-4cbe-be83-fb446e976ce2+8:10993:x1875765413099904:12345-192.168.201.39@tcp:101:bash.0 Request processed in 137us (266us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869455.396242:0:11822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 58 00000100:00100000:2.0:1788869455.397538:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1788869455.397590:0:6551:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765413100032 00000100:00100000:1.0:1788869455.397596:0:6551:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765413100032 00002000:00010000:1.0:1788869455.397623:0:6551:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/5 (0->18446744073709551615) 00002000:00100000:1.0:1788869455.397628:0:6551:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff94c835a3f100 with x1875765413100032 ext(0->18446744073709551615) 00002000:00010000:1.0:1788869455.397636:0:6551:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff94c835a3f100. 00000100:00100000:1.0:1788869455.397662:0:6551:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 5 00000100:00100000:1.0:1788869455.397669:0:6551:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c835a3f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:2125b9b3-626e-4cbe-be83-fb446e976ce2+8:2348:x1875765413100032:12345-192.168.201.39@tcp:10:bash.0 00002000:00010000:1.0:1788869455.397923:0:6551:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:1.0:1788869455.397933:0:6551:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb mtime from disk: 1788869451 -> 1788869454 00002000:00010000:1.0:1788869455.397935:0:6551:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb atime from disk: 1788869450 -> 1788869450 00002000:00010000:1.0:1788869455.397937:0:6551:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb ctime from disk: 1788869451 -> 1788869454 00002000:00010000:1.0:1788869455.397940:0:6551:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb blocks from disk: 11 -> 11 00000100:00100000:1.0:1788869455.397984:0:6551:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c835a3f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:2125b9b3-626e-4cbe-be83-fb446e976ce2+9:2348:x1875765413100032:12345-192.168.201.39@tcp:10:bash.0 Request processed in 315us (451us total) trans 4294967318 rc 0/0 00000100:00100000:1.0:1788869455.398008:0:6551:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 5 00002000:00010000:1.0:1788869455.398012:0:6551:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/5 (0->18446744073709551615) 00002000:00100000:1.0:1788869455.398014:0:6551:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff94c835a3f100 with x1875765413100032 ext(0->18446744073709551615) 00002000:00010000:1.0:1788869455.398020:0:6551:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff94c835a3f100. 00000100:00100000:1.0:1788869455.429691:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1788869455.429773:0:5756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765413100160 00000100:00100000:0.0:1788869455.429783:0:5756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765413100160 00000100:00100000:0.0:1788869455.429861:0:5756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 195 00000100:00100000:0.0:1788869455.429870:0:5756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c835157b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2125b9b3-626e-4cbe-be83-fb446e976ce2+32:11480:x1875765413100160:12345-192.168.201.39@tcp:34:lfs.0 00010000:00010000:0.0:1788869455.429940:0:5756:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff94c81a582a00/0x3d2d1916761d712b lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869455.429956:0:5756:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94c81a582a00/0x3d2d1916761d712b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869455.429968:0:5756:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94c81a582a00/0x3d2d1916761d712b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869455.429984:0:5756:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94c81a582e00/0x3d2d1916761d7132 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869455.429992:0:5756:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94c81a582e00/0x3d2d1916761d7132 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869455.429997:0:5756:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94c81a582e00/0x3d2d1916761d7132 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869455.430309:0:5756:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94c81a582200/0x3d2d1916761d7139 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869455.430318:0:5756:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94c81a582200/0x3d2d1916761d7139 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869455.430325:0:5756:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94c81a582200/0x3d2d1916761d7139 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788869455.430371:0:5756:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff94c81a582200/0x3d2d1916761d7139 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869455.430398:0:5756:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff94c81a582a00/0x3d2d1916761d712b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869455.430406:0:5756:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94c81a582a00/0x3d2d1916761d712b lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869455.430413:0:5756:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94c81a582a00/0x3d2d1916761d712b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869455.430419:0:5756:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94c81a582a00 already unused, calling callback (ffffffffc21124f0) 00010000:00010000:0.0:1788869455.430423:0:5756:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94c81a582a00/0x3d2d1916761d712b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869455.430431:0:5756:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94c81a582a00/0x3d2d1916761d712b lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869455.430443:0:5756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff94c802f3fd00) 00010000:00010000:0.0:1788869455.430446:0:5756:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788869455.430451:0:5756:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94c81a582a00/0x3d2d1916761d712b lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869455.430457:0:5756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94c81a582a00/0x3d2d1916761d712b lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869455.430469:0:5756:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94c81a582e00/0x3d2d1916761d7132 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869455.430475:0:5756:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94c81a582e00/0x3d2d1916761d7132 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869455.430488:0:5756:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94c81a582e00/0x3d2d1916761d7132 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869455.430494:0:5756:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94c81a582e00 already unused, calling callback (ffffffffc21124f0) 00010000:00010000:0.0:1788869455.430497:0:5756:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94c81a582e00/0x3d2d1916761d7132 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869455.430516:0:5756:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94c81a582e00/0x3d2d1916761d7132 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869455.430525:0:5756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff94c803990600) 00010000:00010000:0.0:1788869455.430528:0:5756:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788869455.430531:0:5756:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94c81a582e00/0x3d2d1916761d7132 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869455.430536:0:5756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94c81a582e00/0x3d2d1916761d7132 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869455.430551:0:5756:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94c81a582200/0x3d2d1916761d7139 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869455.430557:0:5756:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94c81a582200/0x3d2d1916761d7139 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869455.430562:0:5756:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94c81a582200/0x3d2d1916761d7139 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869455.430567:0:5756:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94c81a582200 already unused, calling callback (ffffffffc21124f0) 00010000:00010000:0.0:1788869455.430569:0:5756:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94c81a582200/0x3d2d1916761d7139 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869455.430584:0:5756:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94c81a582200/0x3d2d1916761d7139 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869455.430592:0:5756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff94c81a585500) 00010000:00010000:0.0:1788869455.430595:0:5756:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788869455.430597:0:5756:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94c81a582200/0x3d2d1916761d7139 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869455.430603:0:5756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94c81a582200/0x3d2d1916761d7139 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788869455.430679:0:5756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c835157b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2125b9b3-626e-4cbe-be83-fb446e976ce2+32:11480:x1875765413100160:12345-192.168.201.39@tcp:34:lfs.0 Request processed in 809us (994us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869455.430687:0:5756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 195 00000100:00100000:2.0:1788869455.453436:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1788869455.453546:0:5757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765413100416 00000100:00100000:3.0:1788869455.453556:0:5757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765413100416 00000100:00100000:3.0:1788869455.453609:0:5757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 196 00000100:00100000:3.0:1788869455.453617:0:5757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c835a3fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2125b9b3-626e-4cbe-be83-fb446e976ce2+32:11483:x1875765413100416:12345-192.168.201.39@tcp:101:lfs.0 00010000:00010000:3.0:1788869455.453633:0:5757:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788869455.453648:0:5757:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504c200/0x3d2d1916761d7140 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x375c010249035b34 expref: -99 pid: 5757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869455.453706:0:5757:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504c400/0x3d2d1916761d7147 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869455.453719:0:5757:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504c400/0x3d2d1916761d7147 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869455.453730:0:5757:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504c400/0x3d2d1916761d7147 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869455.453757:0:5757:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504ca00/0x3d2d1916761d714e lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869455.453762:0:5757:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504ca00/0x3d2d1916761d714e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869455.453766:0:5757:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504ca00/0x3d2d1916761d714e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869455.454049:0:5757:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504c800/0x3d2d1916761d7155 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869455.454059:0:5757:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504c800/0x3d2d1916761d7155 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869455.454067:0:5757:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504c800/0x3d2d1916761d7155 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5757 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788869455.454076:0:5757:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:3.0:1788869455.454158:0:5757:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504c400/0x3d2d1916761d7147 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869455.454164:0:5757:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504c400/0x3d2d1916761d7147 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869455.454168:0:5757:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504c400/0x3d2d1916761d7147 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869455.454171:0:5757:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94c83504c400 already unused, calling callback (ffffffffc21124f0) 00010000:00010000:3.0:1788869455.454174:0:5757:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504c400/0x3d2d1916761d7147 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869455.454186:0:5757:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504c400/0x3d2d1916761d7147 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869455.454194:0:5757:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff94c802f3fd00) 00010000:00010000:3.0:1788869455.454196:0:5757:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788869455.454199:0:5757:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504c400/0x3d2d1916761d7147 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869455.454203:0:5757:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504c400/0x3d2d1916761d7147 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869455.454212:0:5757:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504ca00/0x3d2d1916761d714e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869455.454215:0:5757:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504ca00/0x3d2d1916761d714e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869455.454219:0:5757:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504ca00/0x3d2d1916761d714e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869455.454222:0:5757:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94c83504ca00 already unused, calling callback (ffffffffc21124f0) 00010000:00010000:3.0:1788869455.454223:0:5757:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504ca00/0x3d2d1916761d714e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869455.454226:0:5757:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504ca00/0x3d2d1916761d714e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869455.454229:0:5757:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff94c819394800) 00010000:00010000:3.0:1788869455.454231:0:5757:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788869455.454232:0:5757:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504ca00/0x3d2d1916761d714e lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869455.454241:0:5757:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504ca00/0x3d2d1916761d714e lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869455.454315:0:5757:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504c200/0x3d2d1916761d7140 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0x375c010249035b34 expref: 35 pid: 5757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869455.454330:0:5757:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504c800/0x3d2d1916761d7155 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0x375c010249035b34 expref: 34 pid: 5757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869455.454337:0:5757:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff94c81a585500) 00010000:00010000:3.0:1788869455.454340:0:5757:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1788869455.454342:0:5757:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94c83504c800, rc 0) 00000100:00100000:3.0:1788869455.454396:0:5757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c835a3fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2125b9b3-626e-4cbe-be83-fb446e976ce2+34:11483:x1875765413100416:12345-192.168.201.39@tcp:101:lfs.0 Request processed in 778us (967us total) trans 4294967476 rc 0/0 00000100:00100000:3.0:1788869455.454404:0:5757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 196 00000100:00100000:3.0:1788869455.455832:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1788869455.455894:0:5756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765413100544 00000100:00100000:0.0:1788869455.455903:0:5756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765413100544 00000100:00100000:0.0:1788869455.455946:0:5756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 197 00000100:00100000:0.0:1788869455.455955:0:5756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c835152300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2125b9b3-626e-4cbe-be83-fb446e976ce2+34:11483:x1875765413100544:12345-192.168.201.39@tcp:54:lfs.0 00010000:00010000:0.0:1788869455.456055:0:5756:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94c81a582200/0x3d2d1916761d7163 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869455.456066:0:5756:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504c000/0x3d2d1916761d7108 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0x375c010249035b1f expref: 34 pid: 5757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869455.456072:0:5756:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff94c81a582200/0x3d2d1916761d7163 lrc: 4/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869455.456096:0:5756:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504c000/0x3d2d1916761d7108 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.39@tcp remote: 0x375c010249035b1f expref: 34 pid: 5757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869455.456115:0:5756:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504c000/0x3d2d1916761d7108 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.39@tcp remote: 0x375c010249035b1f expref: 34 pid: 5757 timeout: 303 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788869455.456125:0:5756:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94c808f53800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5756:1875765421470848:192.168.201.39@tcp:104: 00000100:00100000:0.0:1788869455.456183:0:5756:0:(client.c:2702:ptlrpc_set_wait()) set ffff94c81075acc0 going to sleep for 11 seconds 00000100:00100000:1.0:1788869455.458052:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1788869455.458054:0:5756:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94c808f53800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5756:1875765421470848:192.168.201.39@tcp:104: 00010000:00010000:0.0:1788869455.458076:0:5756:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff94c81a582200/0x3d2d1916761d7163 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788869455.458112:0:11820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765413100800 00000100:00100000:2.0:1788869455.458119:0:11820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765413100800 00000100:00100000:2.0:1788869455.458161:0:11820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 52 00000100:00100000:2.0:1788869455.458171:0:11820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c835154000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:2125b9b3-626e-4cbe-be83-fb446e976ce2+35:5553:x1875765413100800:12345-192.168.201.39@tcp:35:ldlm_bl.0 00000100:00100000:2.0:1788869455.458587:0:11820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c835154000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:2125b9b3-626e-4cbe-be83-fb446e976ce2+36:5553:x1875765413100800:12345-192.168.201.39@tcp:35:ldlm_bl.0 Request processed in 417us (539us total) trans 4294967477 rc 0/0 00000100:00100000:2.0:1788869455.458597:0:11820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 52 00000100:00100000:2.0:1788869455.459611:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1788869455.459652:0:7448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765413100928 00000100:00100000:3.0:1788869455.459657:0:7448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765413100928 00010000:00010000:3.0:1788869455.459681:0:7448:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504c000/0x3d2d1916761d7108 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.39@tcp remote: 0x375c010249035b1f expref: 36 pid: 5757 timeout: 303 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788869455.459720:0:7448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 77 00000100:00100000:3.0:1788869455.459731:0:7448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c810ef0850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:2125b9b3-626e-4cbe-be83-fb446e976ce2+36:2348:x1875765413100928:12345-192.168.201.39@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788869455.459742:0:7448:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788869455.459748:0:7448:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504c000/0x3d2d1916761d7108 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.39@tcp remote: 0x375c010249035b1f expref: 36 pid: 5757 timeout: 303 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869455.459777:0:7448:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504c000/0x3d2d1916761d7108 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.39@tcp remote: 0x375c010249035b1f expref: 36 pid: 5757 timeout: 303 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869455.459792:0:7448:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504c000/0x3d2d1916761d7108 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.39@tcp remote: 0x375c010249035b1f expref: 36 pid: 5757 timeout: 303 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869455.459802:0:7448:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff94c81a585500) 00010000:00010000:3.0:1788869455.459806:0:7448:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff94c81a582200/0x3d2d1916761d7163 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869455.459811:0:7448:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff94c81a582200/0x3d2d1916761d7163 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869455.459816:0:7448:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94c81a582200/0x3d2d1916761d7163 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869455.459835:0:7448:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788869455.459863:0:5756:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff94c81a582200/0x3d2d1916761d7163 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788869455.459869:0:7448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c810ef0850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:2125b9b3-626e-4cbe-be83-fb446e976ce2+35:2348:x1875765413100928:12345-192.168.201.39@tcp:103:ldlm_bl.0 Request processed in 139us (257us total) trans 0 rc 0/0 00010000:00010000:0.0:1788869455.459873:0:5756:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94c81a582200/0x3d2d1916761d7163 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788869455.459881:0:7448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 77 00010000:00010000:0.0:1788869455.459897:0:5756:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94c81a582200/0x3d2d1916761d7163 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869455.459906:0:5756:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94c81a582200/0x3d2d1916761d7163 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869455.459914:0:5756:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94c81a582200/0x3d2d1916761d7163 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869455.459920:0:5756:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94c81a582200 already unused, calling callback (ffffffffc21124f0) 00010000:00010000:0.0:1788869455.459924:0:5756:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94c81a582200/0x3d2d1916761d7163 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869455.459929:0:5756:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94c81a582200/0x3d2d1916761d7163 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869455.459942:0:5756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff94c81a585500) 00010000:00010000:0.0:1788869455.459944:0:5756:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788869455.459947:0:5756:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94c81a582200/0x3d2d1916761d7163 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869455.459952:0:5756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94c81a582200/0x3d2d1916761d7163 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788869455.460001:0:5756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c835152300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2125b9b3-626e-4cbe-be83-fb446e976ce2+34:11483:x1875765413100544:12345-192.168.201.39@tcp:54:lfs.0 Request processed in 4047us (4172us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869455.460009:0:5756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 197 00000100:00100000:2.0:1788869455.460794:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1788869455.460842:0:5758:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765413101184 00000100:00100000:0.0:1788869455.460847:0:5758:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765413101184 00000100:00100000:0.0:1788869455.460880:0:5758:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 53 00000100:00100000:0.0:1788869455.460888:0:5758:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c835a3df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2125b9b3-626e-4cbe-be83-fb446e976ce2+34:11483:x1875765413101184:12345-192.168.201.39@tcp:35:lfs.0 00000100:00100000:0.0:1788869455.461041:0:5758:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c835a3df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2125b9b3-626e-4cbe-be83-fb446e976ce2+35:11483:x1875765413101184:12345-192.168.201.39@tcp:35:lfs.0 Request processed in 154us (248us total) trans 4294967478 rc 0/0 00000100:00100000:0.0:1788869455.461048:0:5758:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 53 00000100:00100000:3.0:1788869455.497768:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1788869455.497813:0:5757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765413101440 00000100:00100000:2.0:1788869455.497821:0:5757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765413101440 00000100:00100000:2.0:1788869455.497889:0:5757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 198 00000100:00100000:2.0:1788869455.497899:0:5757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c835153b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2125b9b3-626e-4cbe-be83-fb446e976ce2+35:11494:x1875765413101440:12345-192.168.201.39@tcp:101:cat.0 00010000:00010000:2.0:1788869455.497923:0:5757:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788869455.497945:0:5757:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94c805039200/0x3d2d1916761d716a lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x375c010249035b3b expref: -99 pid: 5757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869455.498029:0:5757:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff94c805039800/0x3d2d1916761d7171 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869455.498044:0:5757:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94c805039800/0x3d2d1916761d7171 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869455.498055:0:5757:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94c805039800/0x3d2d1916761d7171 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869455.498069:0:5757:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94c805038000/0x3d2d1916761d7178 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869455.498077:0:5757:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94c805038000/0x3d2d1916761d7178 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869455.498084:0:5757:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94c805038000/0x3d2d1916761d7178 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869455.498425:0:5757:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94c805038600/0x3d2d1916761d717f lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869455.498435:0:5757:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94c805038600/0x3d2d1916761d717f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869455.498443:0:5757:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94c805038600/0x3d2d1916761d717f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5757 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788869455.498463:0:5757:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 8 00010000:00010000:2.0:1788869455.498579:0:5757:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff94c805039800/0x3d2d1916761d7171 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869455.498587:0:5757:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94c805039800/0x3d2d1916761d7171 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869455.498593:0:5757:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94c805039800/0x3d2d1916761d7171 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869455.498597:0:5757:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94c805039800 already unused, calling callback (ffffffffc21124f0) 00010000:00010000:2.0:1788869455.498600:0:5757:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94c805039800/0x3d2d1916761d7171 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869455.498605:0:5757:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94c805039800/0x3d2d1916761d7171 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869455.498614:0:5757:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff94c802f3fd00) 00010000:00010000:2.0:1788869455.498615:0:5757:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788869455.498618:0:5757:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94c805039800/0x3d2d1916761d7171 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869455.498622:0:5757:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94c805039800/0x3d2d1916761d7171 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869455.498630:0:5757:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94c805038000/0x3d2d1916761d7178 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869455.498634:0:5757:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94c805038000/0x3d2d1916761d7178 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869455.498645:0:5757:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94c805038000/0x3d2d1916761d7178 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869455.498648:0:5757:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94c805038000 already unused, calling callback (ffffffffc21124f0) 00010000:00010000:2.0:1788869455.498650:0:5757:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94c805038000/0x3d2d1916761d7178 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869455.498653:0:5757:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94c805038000/0x3d2d1916761d7178 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869455.498657:0:5757:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff94c802f3f500) 00010000:00010000:2.0:1788869455.498659:0:5757:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788869455.498660:0:5757:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94c805038000/0x3d2d1916761d7178 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869455.498665:0:5757:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94c805038000/0x3d2d1916761d7178 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869455.498703:0:5757:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94c805039200/0x3d2d1916761d716a lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0x375c010249035b3b expref: 38 pid: 5757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869455.498716:0:5757:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94c805038600/0x3d2d1916761d717f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0x375c010249035b3b expref: 37 pid: 5757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869455.498721:0:5757:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff94c81a585500) 00010000:00010000:2.0:1788869455.498723:0:5757:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788869455.498724:0:5757:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94c805038600, rc 0) 00000100:00100000:2.0:1788869455.498771:0:5757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c835153b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2125b9b3-626e-4cbe-be83-fb446e976ce2+37:11494:x1875765413101440:12345-192.168.201.39@tcp:101:cat.0 Request processed in 875us (1010us total) trans 4294967479 rc 0/0 00000100:00100000:2.0:1788869455.498782:0:5757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 198 00000100:00100000:1.0:1788869455.503023:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1788869455.503097:0:11820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765413101696 00000100:00100000:2.0:1788869455.503107:0:11820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765413101696 00000100:00100000:2.0:1788869455.503156:0:11820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 54 00000100:00100000:2.0:1788869455.503166:0:11820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c835154380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:2125b9b3-626e-4cbe-be83-fb446e976ce2+37:11494:x1875765413101696:12345-192.168.201.39@tcp:35:cat.0 00000100:00100000:2.0:1788869455.503452:0:11820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c835154380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:2125b9b3-626e-4cbe-be83-fb446e976ce2+38:11494:x1875765413101696:12345-192.168.201.39@tcp:35:cat.0 Request processed in 286us (436us total) trans 4294967480 rc 0/0 00000100:00100000:2.0:1788869455.503461:0:11820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 54 00000100:00100000:1.0:1788869455.525784:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1788869455.525841:0:5755:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765413101952 00000100:00100000:2.0:1788869455.525850:0:5755:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765413101952 00000100:00100000:2.0:1788869455.526074:0:5755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 199 00000100:00100000:2.0:1788869455.526086:0:5755:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c8354d2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2125b9b3-626e-4cbe-be83-fb446e976ce2+38:11495:x1875765413101952:12345-192.168.201.39@tcp:36:rm.0 00010000:00010000:2.0:1788869455.526161:0:5755:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:2.0:1788869455.526196:0:5755:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94c805038600/0x3d2d1916761d717f lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.39@tcp remote: 0x375c010249035b3b expref: 38 pid: 5757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869455.526217:0:5755:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504c800/0x3d2d1916761d7155 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.39@tcp remote: 0x375c010249035b34 expref: 37 pid: 5757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869455.526231:0:5755:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94c81a583400/0x3d2d1916761d711d lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.39@tcp remote: 0x375c010249035b26 expref: 36 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869455.526242:0:5755:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff94c81a585500) 00010000:00010000:2.0:1788869455.526273:0:5755:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788869455.526293:0:5755:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94c805039200/0x3d2d1916761d718d lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869455.526318:0:5755:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94c805039200/0x3d2d1916761d718d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869455.526327:0:5755:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94c805039200/0x3d2d1916761d718d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869455.526342:0:5755:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94c805038000/0x3d2d1916761d7194 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869455.526348:0:5755:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94c805038000/0x3d2d1916761d7194 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869455.526353:0:5755:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94c805038000/0x3d2d1916761d7194 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869455.526662:0:5755:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94c805039800/0x3d2d1916761d719b lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869455.526672:0:5755:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94c805039800/0x3d2d1916761d719b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869455.526679:0:5755:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94c805039800/0x3d2d1916761d719b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788869455.527340:0:5755:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].7, 64 off8712 00000004:00080000:2.0:1788869455.527352:0:5755:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 203819100756ns, next at 204819098480ns, rc = 0 00010000:00010000:2.0:1788869455.527405:0:5755:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94c805038800/0x3d2d1916761d71a2 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869455.527415:0:5755:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94c805038800/0x3d2d1916761d71a2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869455.527434:0:5755:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94c805038800/0x3d2d1916761d71a2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869455.527440:0:5755:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94c805038800/0x3d2d1916761d71a2 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869455.527445:0:5755:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94c805038800/0x3d2d1916761d71a2 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869455.527450:0:5755:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94c805038800/0x3d2d1916761d71a2 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869455.527479:0:5755:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788869455.527496:0:5755:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94c805039800/0x3d2d1916761d719b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869455.527514:0:5755:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94c805039800/0x3d2d1916761d719b lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869455.527521:0:5755:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94c805039800/0x3d2d1916761d719b lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869455.527531:0:5755:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94c805039800 already unused, calling callback (ffffffffc21124f0) 00010000:00010000:2.0:1788869455.527535:0:5755:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94c805039800/0x3d2d1916761d719b lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869455.527543:0:5755:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94c805039800/0x3d2d1916761d719b lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869455.527552:0:5743:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788869455.527555:0:5755:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff94c802f3f200) 00010000:00010000:3.0:1788869455.527560:0:5743:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94c805038800/0x3d2d1916761d71a2 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869455.527560:0:5755:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1788869455.527571:0:5755:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94c805039800/0x3d2d1916761d719b lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869455.527578:0:5743:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94c805038800 already unused, calling callback (ffffffffc1703220) 00010000:00010000:2.0:1788869455.527581:0:5755:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94c805039800/0x3d2d1916761d719b lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869455.527584:0:5743:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94c805038800/0x3d2d1916761d71a2 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869455.527604:0:5755:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94c805039200/0x3d2d1916761d718d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869455.527609:0:5743:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94c805038800/0x3d2d1916761d71a2 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869455.527614:0:5755:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94c805039200/0x3d2d1916761d718d lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869455.527624:0:5755:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94c805039200/0x3d2d1916761d718d lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869455.527625:0:5743:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff94c802f3f200) 00010000:00010000:3.0:1788869455.527631:0:5743:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1788869455.527636:0:5755:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94c805039200 already unused, calling callback (ffffffffc21124f0) 00010000:00010000:3.0:1788869455.527637:0:5743:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94c805038800/0x3d2d1916761d71a2 lrc: 1/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869455.527641:0:5755:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94c805039200/0x3d2d1916761d718d lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869455.527648:0:5743:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94c805038800/0x3d2d1916761d71a2 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869455.527652:0:5755:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94c805039200/0x3d2d1916761d718d lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869455.527667:0:5755:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff94c802f3fd00) 00010000:00010000:2.0:1788869455.527670:0:5755:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788869455.527671:0:5743:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788869455.527674:0:5755:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94c805039200/0x3d2d1916761d718d lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869455.527675:0:5743:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788869455.527678:0:5743:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788869455.527684:0:5755:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94c805039200/0x3d2d1916761d718d lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788869455.527694:0:5755:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000013d62768 reply state 00000000f586482e transno 4294967481 ns: mdt-lustre-MDT0000_UUID lock: ffff94c805038000/0x3d2d1916761d7194 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788869455.527714:0:5755:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788869455.527787:0:5755:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c8354d2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2125b9b3-626e-4cbe-be83-fb446e976ce2+37:11495:x1875765413101952:12345-192.168.201.39@tcp:36:rm.0 Request processed in 1703us (2011us total) trans 4294967481 rc 0/0 00000100:00100000:2.0:1788869455.527794:0:5755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 199 00010000:00010000:1.0:1788869455.529654:0:3270:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94c805038000/0x3d2d1916761d7194 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869455.529677:0:3270:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94c805038000/0x3d2d1916761d7194 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869455.529684:0:3270:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94c805038000/0x3d2d1916761d7194 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869455.529689:0:3270:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94c805038000 already unused, calling callback (ffffffffc21124f0) 00010000:00010000:1.0:1788869455.529694:0:3270:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94c805038000/0x3d2d1916761d7194 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869455.529701:0:3270:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94c805038000/0x3d2d1916761d7194 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869455.529738:0:3270:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff94c802f3f500) 00010000:00010000:1.0:1788869455.529741:0:3270:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788869455.529745:0:3270:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94c805038000/0x3d2d1916761d7194 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869455.529752:0:3270:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94c805038000/0x3d2d1916761d7194 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788869455.562736:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1788869455.562970:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765413102208 00000100:00100000:0.0:1788869455.562980:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765413102208 00000100:00100000:0.0:1788869455.563045:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 200 00000100:00100000:0.0:1788869455.563055:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c8354d0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2125b9b3-626e-4cbe-be83-fb446e976ce2+36:11501:x1875765413102208:12345-192.168.201.39@tcp:101:bash.0 00010000:00010000:0.0:1788869455.563079:0:5786:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788869455.563098:0:5786:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94c81a582200/0x3d2d1916761d71a9 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x375c010249035b42 expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869455.563221:0:5786:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94c81a582e00/0x3d2d1916761d71b0 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869455.563282:0:5786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94c81a582e00/0x3d2d1916761d71b0 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869455.563294:0:5786:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94c81a582e00/0x3d2d1916761d71b0 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869455.563326:0:5786:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94c81a582a00/0x3d2d1916761d71b7 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869455.563334:0:5786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94c81a582a00/0x3d2d1916761d71b7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869455.563341:0:5786:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94c81a582a00/0x3d2d1916761d71b7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1788869455.563894:0:5786:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x5:0x0], index 0: 0 00010000:00010000:0.0:1788869455.564051:0:5786:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94c81a583400/0x3d2d1916761d71be lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869455.564062:0:5786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94c81a583400/0x3d2d1916761d71be lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869455.564070:0:5786:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94c81a583400/0x3d2d1916761d71be lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869455.564101:0:5786:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94c81a582e00/0x3d2d1916761d71b0 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869455.564109:0:5786:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94c81a582e00/0x3d2d1916761d71b0 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869455.564133:0:5786:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94c81a582e00/0x3d2d1916761d71b0 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869455.564146:0:5786:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94c81a582e00 already unused, calling callback (ffffffffc21124f0) 00010000:00010000:0.0:1788869455.564151:0:5786:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94c81a582e00/0x3d2d1916761d71b0 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869455.564159:0:5786:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94c81a582e00/0x3d2d1916761d71b0 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869455.564173:0:5786:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff94c802f3fd00) 00010000:00010000:0.0:1788869455.564175:0:5786:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788869455.564180:0:5786:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94c81a582e00/0x3d2d1916761d71b0 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869455.564187:0:5786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94c81a582e00/0x3d2d1916761d71b0 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788869455.564200:0:5786:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000008bb5b89d reply state 000000005cd3b987 transno 4294967482 ns: mdt-lustre-MDT0000_UUID lock: ffff94c81a582a00/0x3d2d1916761d71b7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788869455.564209:0:5786:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1788869455.564236:0:5786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94c81a582200/0x3d2d1916761d71a9 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0x375c010249035b42 expref: 39 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869455.564247:0:5786:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94c81a583400/0x3d2d1916761d71be lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0x375c010249035b42 expref: 38 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869455.564292:0:5786:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff94c803990400) 00010000:00010000:0.0:1788869455.564295:0:5786:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788869455.564297:0:5786:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94c81a583400, rc 0) 00000100:00100000:0.0:1788869455.564368:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c8354d0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2125b9b3-626e-4cbe-be83-fb446e976ce2+39:11501:x1875765413102208:12345-192.168.201.39@tcp:101:bash.0 Request processed in 1315us (1643us total) trans 4294967482 rc 0/0 00000100:00100000:0.0:1788869455.565407:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 200 00010000:00010000:2.0:1788869455.566317:0:3269:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94c81a582a00/0x3d2d1916761d71b7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869455.566330:0:3269:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94c81a582a00/0x3d2d1916761d71b7 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869455.566337:0:3269:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94c81a582a00/0x3d2d1916761d71b7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869455.566343:0:3269:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94c81a582a00 already unused, calling callback (ffffffffc21124f0) 00010000:00010000:2.0:1788869455.566348:0:3269:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94c81a582a00/0x3d2d1916761d71b7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869455.566355:0:3269:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94c81a582a00/0x3d2d1916761d71b7 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869455.566369:0:3269:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff94c803990600) 00010000:00010000:2.0:1788869455.566372:0:3269:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788869455.566375:0:3269:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94c81a582a00/0x3d2d1916761d71b7 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869455.566381:0:3269:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94c81a582a00/0x3d2d1916761d71b7 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788869455.568032:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1788869455.568431:0:6547:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765413102336 00000100:00100000:0.0:1788869455.568442:0:6547:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765413102336 00000100:00080000:3.0:1788869455.568519:0:5751:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788869455.568522:0:6547:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 59 00000100:00100000:0.0:1788869455.568534:0:6547:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c8354d3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2125b9b3-626e-4cbe-be83-fb446e976ce2+7:2347:x1875765413102336:12345-192.168.201.39@tcp:101:bash.0 00010000:00010000:0.0:1788869455.568551:0:6547:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788869455.568570:0:6547:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002bff636d/0x3d2d1916761d71cc lrc: 2/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x375c010249035b49 expref: -99 pid: 6547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788869455.568594:0:6547:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788869455.568612:0:6547:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=203s v=(0 0) 00010000:00010000:0.0:1788869455.568616:0:6547:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788869455.568626:0:6547:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002bff636d/0x3d2d1916761d71cc lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.39@tcp remote: 0x375c010249035b49 expref: 8 pid: 6547 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869455.568644:0:6547:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000002bff636d/0x3d2d1916761d71cc lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.39@tcp remote: 0x375c010249035b49 expref: 8 pid: 6547 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869455.568656:0:6547:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94c818d1f000, rc 0) 00000100:00100000:0.0:1788869455.568714:0:6547:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c8354d3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2125b9b3-626e-4cbe-be83-fb446e976ce2+8:2347:x1875765413102336:12345-192.168.201.39@tcp:101:bash.0 Request processed in 182us (689us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869455.568721:0:6547:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 59 00000100:00100000:3.0:1788869455.571124:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1788869455.571586:0:7884:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765413102464 00000100:00100000:2.0:1788869455.571600:0:7884:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765413102464 00000100:00100000:2.0:1788869455.571667:0:7884:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 60 00000100:00100000:2.0:1788869455.571677:0:7884:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c835152680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:2125b9b3-626e-4cbe-be83-fb446e976ce2+8:11501:x1875765413102464:12345-192.168.201.39@tcp:101:bash.0 00010000:00010000:2.0:1788869455.571694:0:7884:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788869455.571710:0:7884:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f49ccba3/0x3d2d1916761d71d3 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x375c010249035b50 expref: -99 pid: 7884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869455.571751:0:7884:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000002bff636d/0x3d2d1916761d71cc lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.39@tcp remote: 0x375c010249035b49 expref: 9 pid: 6547 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869455.571760:0:7884:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788869455.571764:0:7884:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788869455.571769:0:7884:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f49ccba3/0x3d2d1916761d71d3 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.201.39@tcp remote: 0x375c010249035b50 expref: 9 pid: 7884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869455.571801:0:7884:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000002bff636d/0x3d2d1916761d71cc lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.39@tcp remote: 0x375c010249035b49 expref: 9 pid: 6547 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869455.571815:0:7884:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000002bff636d/0x3d2d1916761d71cc lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.39@tcp remote: 0x375c010249035b49 expref: 9 pid: 6547 timeout: 303 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788869455.571827:0:7884:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94c835a3f800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:7884:1875765421470976:192.168.201.39@tcp:104: 00000100:00100000:2.0:1788869455.571916:0:7884:0:(client.c:2702:ptlrpc_set_wait()) set ffff94c805068300 going to sleep for 11 seconds 00000100:00100000:3.0:1788869455.574911:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1788869455.574983:0:7884:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94c835a3f800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:7884:1875765421470976:192.168.201.39@tcp:104: 00000100:00100000:1.0:1788869455.575002:0:5739:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765413102592 00000100:00100000:1.0:1788869455.575021:0:5739:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765413102592 00010000:00010000:2.0:1788869455.575028:0:7884:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000f49ccba3/0x3d2d1916761d71d3 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.39@tcp remote: 0x375c010249035b50 expref: 10 pid: 7884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869455.575056:0:5739:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000002bff636d/0x3d2d1916761d71cc lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.39@tcp remote: 0x375c010249035b49 expref: 10 pid: 6547 timeout: 303 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869455.575068:0:7884:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94c805039200, rc 0) 00000100:00100000:1.0:1788869455.575102:0:5739:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 78 00000100:00100000:1.0:1788869455.575113:0:5739:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c835152a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2125b9b3-626e-4cbe-be83-fb446e976ce2+10:2348:x1875765413102592:12345-192.168.201.39@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1788869455.575122:0:7884:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c835152680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:2125b9b3-626e-4cbe-be83-fb446e976ce2+10:11501:x1875765413102464:12345-192.168.201.39@tcp:101:bash.0 Request processed in 3444us (4003us total) trans 0 rc 0/0 00010000:00010000:1.0:1788869455.575127:0:5739:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1788869455.575132:0:7884:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 60 00010000:00010000:1.0:1788869455.575152:0:5739:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000002bff636d/0x3d2d1916761d71cc lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.39@tcp remote: 0x375c010249035b49 expref: 9 pid: 6547 timeout: 303 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869455.575168:0:5739:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000002bff636d/0x3d2d1916761d71cc lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.39@tcp remote: 0x375c010249035b49 expref: 9 pid: 6547 timeout: 303 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869455.575191:0:5739:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002bff636d/0x3d2d1916761d71cc lrc: 0/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.39@tcp remote: 0x375c010249035b49 expref: 9 pid: 6547 timeout: 303 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869455.575217:0:5739:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788869455.575222:0:5739:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788869455.575231:0:5739:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000f49ccba3/0x3d2d1916761d71d3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.39@tcp remote: 0x375c010249035b50 expref: 8 pid: 7884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869455.575242:0:5739:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f49ccba3/0x3d2d1916761d71d3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.39@tcp remote: 0x375c010249035b50 expref: 8 pid: 7884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869455.575324:0:5739:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000f49ccba3/0x3d2d1916761d71d3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.39@tcp remote: 0x375c010249035b50 expref: 8 pid: 7884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788869455.575338:0:5739:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94c703414e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:5739:1875765421471104:192.168.201.39@tcp:105: 00000100:00100000:1.0:1788869455.575396:0:5739:0:(client.c:2702:ptlrpc_set_wait()) set ffff94c818e67600 going to sleep for 11 seconds 00000100:00100000:2.0:1788869455.576988:0:5739:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94c703414e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:5739:1875765421471104:192.168.201.39@tcp:105: 00010000:00010000:2.0:1788869455.577007:0:5739:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788869455.577057:0:5739:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c835152a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2125b9b3-626e-4cbe-be83-fb446e976ce2+8:2348:x1875765413102592:12345-192.168.201.39@tcp:103:ldlm_bl.0 Request processed in 1946us (2153us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869455.577067:0:5739:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 78 00000100:00100000:3.0:1788869455.578048:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1788869455.578141:0:5758:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765413102848 00000100:00100000:0.0:1788869455.578148:0:5758:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765413102848 00000100:00100000:0.0:1788869455.578216:0:5758:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 55 00000100:00100000:0.0:1788869455.578224:0:5758:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c835153100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2125b9b3-626e-4cbe-be83-fb446e976ce2+38:11501:x1875765413102848:12345-192.168.201.39@tcp:35:bash.0 00000100:00100000:0.0:1788869455.578549:0:5758:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c835153100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2125b9b3-626e-4cbe-be83-fb446e976ce2+39:11501:x1875765413102848:12345-192.168.201.39@tcp:35:bash.0 Request processed in 325us (502us total) trans 4294967483 rc 0/0 00000100:00100000:0.0:1788869455.578555:0:5758:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 55 00000100:00100000:3.0:1788869455.667710:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1788869455.667773:0:5756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765413102976 00000100:00100000:0.0:1788869455.667792:0:5756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765413102976 00000100:00100000:0.0:1788869455.667852:0:5756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 201 00000100:00100000:0.0:1788869455.667863:0:5756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c835150000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2125b9b3-626e-4cbe-be83-fb446e976ce2+39:11517:x1875765413102976:12345-192.168.201.39@tcp:101:lfs.0 00010000:00010000:0.0:1788869455.667887:0:5756:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788869455.667908:0:5756:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94c818d1f600/0x3d2d1916761d71da lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x375c010249035b57 expref: -99 pid: 5756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869455.667970:0:5756:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94c818d1fe00/0x3d2d1916761d71e1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869455.667984:0:5756:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94c818d1fe00/0x3d2d1916761d71e1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869455.667994:0:5756:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94c818d1fe00/0x3d2d1916761d71e1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788869455.668068:0:5756:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 7680 00000004:00200000:0.0:1788869455.668072:0:5756:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:0.0:1788869455.668094:0:5756:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff94c818d1fe00/0x3d2d1916761d71e1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869455.668119:0:5756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94c818d1f600/0x3d2d1916761d71da lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0x375c010249035b57 expref: 41 pid: 5756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869455.668137:0:5756:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94c818d1fe00/0x3d2d1916761d71e1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0x375c010249035b57 expref: 40 pid: 5756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869455.668159:0:5756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff94c802f3fd00) 00010000:00010000:0.0:1788869455.668162:0:5756:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788869455.668166:0:5756:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94c818d1fe00, rc 0) 00000100:00100000:0.0:1788869455.668225:0:5756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c835150000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2125b9b3-626e-4cbe-be83-fb446e976ce2+40:11517:x1875765413102976:12345-192.168.201.39@tcp:101:lfs.0 Request processed in 364us (520us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869455.668232:0:5756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 201 00000100:00100000:1.0:1788869455.671439:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1788869455.671519:0:5757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765413103232 00000100:00100000:2.0:1788869455.671528:0:5757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765413103232 00000100:00100000:2.0:1788869455.671582:0:5757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 202 00000100:00100000:2.0:1788869455.671593:0:5757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c703415f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2125b9b3-626e-4cbe-be83-fb446e976ce2+40:11517:x1875765413103232:12345-192.168.201.39@tcp:101:lfs.0 00010000:00010000:2.0:1788869455.671612:0:5757:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788869455.671629:0:5757:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94c805039800/0x3d2d1916761d71e8 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x375c010249035b5e expref: -99 pid: 5757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869455.671720:0:5757:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94c805038600/0x3d2d1916761d71ef lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869455.671736:0:5757:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff94c81a583400/0x3d2d1916761d71be lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0x375c010249035b42 expref: 41 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869455.671745:0:5757:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff94c805038600/0x3d2d1916761d71ef lrc: 4/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869455.671810:0:5757:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff94c81a583400/0x3d2d1916761d71be lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.39@tcp remote: 0x375c010249035b42 expref: 41 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869455.671823:0:5757:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff94c81a583400/0x3d2d1916761d71be lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.39@tcp remote: 0x375c010249035b42 expref: 41 pid: 5786 timeout: 303 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788869455.671838:0:5757:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94c835a3f800 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5757:1875765421471232:192.168.201.39@tcp:104: 00000100:00100000:2.0:1788869455.671936:0:5757:0:(client.c:2702:ptlrpc_set_wait()) set ffff94c805068300 going to sleep for 11 seconds 00000100:00100000:2.0:1788869455.679855:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1788869455.679932:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765413103360 00000100:00100000:2.0:1788869455.679933:0:5757:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94c835a3f800 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5757:1875765421471232:192.168.201.39@tcp:104: 00000100:00100000:0.0:1788869455.679941:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765413103360 00010000:00010000:2.0:1788869455.679966:0:5757:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff94c805038600/0x3d2d1916761d71ef lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869455.679982:0:5788:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff94c81a583400/0x3d2d1916761d71be lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.39@tcp remote: 0x375c010249035b42 expref: 42 pid: 5786 timeout: 303 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788869455.680015:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 79 00000100:00100000:0.0:1788869455.680025:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c83faeb100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2125b9b3-626e-4cbe-be83-fb446e976ce2+42:2348:x1875765413103360:12345-192.168.201.39@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788869455.680037:0:5788:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788869455.680045:0:5788:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff94c81a583400/0x3d2d1916761d71be lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.39@tcp remote: 0x375c010249035b42 expref: 42 pid: 5786 timeout: 303 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869455.680057:0:5788:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff94c81a583400/0x3d2d1916761d71be lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.39@tcp remote: 0x375c010249035b42 expref: 42 pid: 5786 timeout: 303 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869455.680078:0:5788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94c81a583400/0x3d2d1916761d71be lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.39@tcp remote: 0x375c010249035b42 expref: 42 pid: 5786 timeout: 303 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869455.680093:0:5788:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff94c803990400) 00010000:00010000:0.0:1788869455.680097:0:5788:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff94c805038600/0x3d2d1916761d71ef lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869455.680117:0:5788:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff94c805038600/0x3d2d1916761d71ef lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869455.680124:0:5788:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94c805038600/0x3d2d1916761d71ef lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869455.680149:0:5788:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788869455.680179:0:5757:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff94c805038600/0x3d2d1916761d71ef lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869455.680189:0:5757:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94c805038600/0x3d2d1916761d71ef lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5757 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788869455.680203:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c83faeb100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2125b9b3-626e-4cbe-be83-fb446e976ce2+41:2348:x1875765413103360:12345-192.168.201.39@tcp:103:ldlm_bl.0 Request processed in 179us (356us total) trans 0 rc 0/0 00000004:00200000:2.0:1788869455.680210:0:5757:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00000100:00100000:0.0:1788869455.680214:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 79 00010000:00010000:2.0:1788869455.681817:0:5757:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94c805039800/0x3d2d1916761d71e8 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0x375c010249035b5e expref: 42 pid: 5757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869455.681843:0:5757:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94c805038600/0x3d2d1916761d71ef lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0x375c010249035b5e expref: 41 pid: 5757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869455.681852:0:5757:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff94c803990400) 00010000:00010000:2.0:1788869455.681867:0:5757:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1788869455.681870:0:5757:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94c805038600, rc 0) 00000100:00100000:2.0:1788869455.681919:0:5757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c703415f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2125b9b3-626e-4cbe-be83-fb446e976ce2+41:11517:x1875765413103232:12345-192.168.201.39@tcp:101:lfs.0 Request processed in 10328us (10487us total) trans 4294967484 rc 0/0 00000100:00100000:2.0:1788869455.681927:0:5757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 202 00000100:00100000:2.0:1788869455.684078:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1788869455.685190:0:5755:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765413103616 00000100:00100000:0.0:1788869455.685199:0:5755:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765413103616 00000100:00100000:0.0:1788869455.685237:0:5755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 203 00000100:00100000:0.0:1788869455.685243:0:5755:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c83fae8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2125b9b3-626e-4cbe-be83-fb446e976ce2+41:11517:x1875765413103616:12345-192.168.201.39@tcp:101:lfs.0 00010000:00010000:0.0:1788869455.685274:0:5755:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788869455.685276:0:5755:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1788869455.685299:0:5755:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94c805038600/0x3d2d1916761d71ef lrc: 0/0,0 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.39@tcp remote: 0x375c010249035b5e expref: 41 pid: 5757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869455.685318:0:5755:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff94c803990400) 00010000:00010000:0.0:1788869455.685328:0:5755:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788869455.685343:0:5755:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94c818d1f600/0x3d2d1916761d71fd lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x375c010249035b65 expref: -99 pid: 5755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869455.685425:0:5755:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94c818d1e200/0x3d2d1916761d7204 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869455.685438:0:5755:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94c818d1e200/0x3d2d1916761d7204 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869455.685455:0:5755:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94c818d1e200/0x3d2d1916761d7204 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788869455.685465:0:5755:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:0.0:1788869455.685587:0:5755:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94c818d1f600/0x3d2d1916761d71fd lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0x375c010249035b65 expref: 43 pid: 5755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869455.685601:0:5755:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94c818d1e200/0x3d2d1916761d7204 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0x375c010249035b65 expref: 42 pid: 5755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869455.685609:0:5755:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff94c803990800) 00010000:00010000:0.0:1788869455.685612:0:5755:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1788869455.685614:0:5755:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94c818d1e200, rc 0) 00000100:00100000:0.0:1788869455.685712:0:5755:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c83fae8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2125b9b3-626e-4cbe-be83-fb446e976ce2+42:11517:x1875765413103616:12345-192.168.201.39@tcp:101:lfs.0 Request processed in 467us (1637us total) trans 4294967485 rc 0/0 00000100:00100000:0.0:1788869455.685721:0:5755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 203 00000100:00100000:3.0:1788869455.688356:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1788869455.688588:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765413103744 00000100:00100000:0.0:1788869455.688598:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765413103744 00000100:00100000:0.0:1788869455.688657:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 204 00000100:00100000:0.0:1788869455.688668:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c835153480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2125b9b3-626e-4cbe-be83-fb446e976ce2+42:11517:x1875765413103744:12345-192.168.201.39@tcp:101:lfs.0 00010000:00010000:0.0:1788869455.688689:0:5786:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788869455.688707:0:5786:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94c818d1ec00/0x3d2d1916761d7212 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x375c010249035b6c expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869455.688778:0:5786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94c818d1ec00/0x3d2d1916761d7212 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.39@tcp remote: 0x375c010249035b6c expref: 43 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869455.688812:0:5786:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94c818d1ec00/0x3d2d1916761d7212 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.39@tcp remote: 0x375c010249035b6c expref: 43 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869455.688832:0:5786:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff94c803990800) 00010000:00010000:0.0:1788869455.688835:0:5786:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788869455.688839:0:5786:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94c818d1ec00, rc 0) 00000100:00100000:0.0:1788869455.688901:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c835153480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2125b9b3-626e-4cbe-be83-fb446e976ce2+43:11517:x1875765413103744:12345-192.168.201.39@tcp:101:lfs.0 Request processed in 234us (551us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869455.688908:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 204 00000100:00100000:1.0:1788869455.692968:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1788869455.693651:0:11822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765413103872 00000100:00100000:0.0:1788869455.693662:0:11822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765413103872 00000100:00100000:0.0:1788869455.693720:0:11822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 61 00000100:00100000:0.0:1788869455.693732:0:11822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c703416680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:2125b9b3-626e-4cbe-be83-fb446e976ce2+8:2348:x1875765413103872:12345-192.168.201.39@tcp:1:lfs.0 00010000:00010000:0.0:1788869455.693778:0:11822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000081575a94/0x3d2d1916761d7219 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869455.693798:0:11822:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000f49ccba3/0x3d2d1916761d71d3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.39@tcp remote: 0x375c010249035b50 expref: 8 pid: 7884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869455.693807:0:11822:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788869455.693812:0:11822:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788869455.693817:0:11822:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000081575a94/0x3d2d1916761d7219 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869455.693851:0:11822:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000f49ccba3/0x3d2d1916761d71d3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.201.39@tcp remote: 0x375c010249035b50 expref: 8 pid: 7884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869455.693878:0:11822:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000f49ccba3/0x3d2d1916761d71d3 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.201.39@tcp remote: 0x375c010249035b50 expref: 8 pid: 7884 timeout: 303 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788869455.693892:0:11822:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94c808f53800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:11822:1875765421471360:192.168.201.39@tcp:104: 00000100:00100000:0.0:1788869455.693967:0:11822:0:(client.c:2702:ptlrpc_set_wait()) set ffff94c81075a600 going to sleep for 11 seconds 00000100:00100000:0.0:1788869455.695359:0:11822:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94c808f53800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:11822:1875765421471360:192.168.201.39@tcp:104: 00010000:00010000:0.0:1788869455.695382:0:11822:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000081575a94/0x3d2d1916761d7219 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788869455.697803:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1788869455.697933:0:6550:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765413104000 00000100:00100000:2.0:1788869455.697942:0:6550:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765413104000 00002000:00100000:2.0:1788869455.697990:0:6550:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x5:0x0] (0->8) req@ffff94c703416a00 x1875765413104000/t0(0) o4->2125b9b3-626e-4cbe-be83-fb446e976ce2@192.168.201.39@tcp:401/0 lens 504/0 e 0 to 0 dl 1788869466 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788869455.698001:0:6550:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff94c703416a00 with x1875765413104000 ext(0->8) 00010000:00010000:2.0:1788869455.698009:0:6550:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000f49ccba3/0x3d2d1916761d71d3 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.39@tcp remote: 0x375c010249035b50 expref: 9 pid: 7884 timeout: 303 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869455.698026:0:6550:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000f49ccba3/0x3d2d1916761d71d3 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.39@tcp remote: 0x375c010249035b50 expref: 9 pid: 7884 timeout: 303 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788869455.698033:0:6550:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff94c703416a00 00000100:00100000:2.0:1788869455.698068:0:6550:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 3 00000100:00100000:2.0:1788869455.698078:0:6550:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c703416a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:2125b9b3-626e-4cbe-be83-fb446e976ce2+9:2348:x1875765413104000:12345-192.168.201.39@tcp:4:lfs.0 00000100:00100000:2.0:1788869455.698520:0:6550:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c703416a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:2125b9b3-626e-4cbe-be83-fb446e976ce2+11:2348:x1875765413104000:12345-192.168.201.39@tcp:4:lfs.0 Request processed in 442us (721us total) trans 4294967308 rc 0/0 00000100:00100000:2.0:1788869455.698528:0:6550:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 3 00002000:00100000:2.0:1788869455.698534:0:6550:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x5:0x0] (0->8) req@ffff94c703416a00 x1875765413104000/t4294967308(0) o4->2125b9b3-626e-4cbe-be83-fb446e976ce2@192.168.201.39@tcp:401/0 lens 504/448 e 0 to 0 dl 1788869466 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788869455.698543:0:6550:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff94c703416a00 with x1875765413104000 ext(0->8) 00010000:00010000:2.0:1788869455.698555:0:6550:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000f49ccba3/0x3d2d1916761d71d3 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.39@tcp remote: 0x375c010249035b50 expref: 11 pid: 7884 timeout: 303 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869455.698583:0:6550:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000f49ccba3/0x3d2d1916761d71d3 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.39@tcp remote: 0x375c010249035b50 expref: 11 pid: 7884 timeout: 303 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788869455.698590:0:6550:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff94c703416a00 00000100:00100000:3.0:1788869455.700369:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1788869455.700455:0:7448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765413104128 00000100:00100000:1.0:1788869455.700462:0:7448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765413104128 00010000:00010000:1.0:1788869455.700541:0:7448:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000f49ccba3/0x3d2d1916761d71d3 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.39@tcp remote: 0x375c010249035b50 expref: 11 pid: 7884 timeout: 303 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788869455.700573:0:7448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 80 00000100:00100000:1.0:1788869455.700581:0:7448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c83fbb2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:2125b9b3-626e-4cbe-be83-fb446e976ce2+11:2346:x1875765413104128:12345-192.168.201.39@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788869455.700593:0:7448:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:1.0:1788869455.700619:0:7448:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:1.0:1788869455.700622:0:7448:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb mtime from disk: 0 -> 1788869454 00002000:00010000:1.0:1788869455.700624:0:7448:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb atime from disk: 0 -> 1788869454 00002000:00010000:1.0:1788869455.700626:0:7448:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb ctime from disk: 0 -> 1788869454 00010000:00010000:1.0:1788869455.700631:0:7448:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000f49ccba3/0x3d2d1916761d71d3 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.39@tcp remote: 0x375c010249035b50 expref: 11 pid: 7884 timeout: 303 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869455.700643:0:7448:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000f49ccba3/0x3d2d1916761d71d3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.201.39@tcp remote: 0x375c010249035b50 expref: 11 pid: 7884 timeout: 303 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869455.700664:0:7448:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f49ccba3/0x3d2d1916761d71d3 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.201.39@tcp remote: 0x375c010249035b50 expref: 11 pid: 7884 timeout: 303 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869455.700678:0:7448:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788869455.700683:0:7448:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788869455.700688:0:7448:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000081575a94/0x3d2d1916761d7219 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 11822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869455.700697:0:7448:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000081575a94/0x3d2d1916761d7219 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 11822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869455.700725:0:7448:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788869455.700764:0:7448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c83fbb2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:2125b9b3-626e-4cbe-be83-fb446e976ce2+10:2346:x1875765413104128:12345-192.168.201.39@tcp:103:ldlm_bl.0 Request processed in 184us (402us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869455.700771:0:7448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 80 00010000:00010000:0.0:1788869455.701369:0:11822:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000081575a94/0x3d2d1916761d7219 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869455.701382:0:11822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000081575a94/0x3d2d1916761d7219 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869455.701407:0:11822:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000081575a94/0x3d2d1916761d7219 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869455.701415:0:11822:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000081575a94/0x3d2d1916761d7219 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 11822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869455.701423:0:11822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000081575a94/0x3d2d1916761d7219 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869455.701443:0:11822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94c818d1f600 already unused, calling callback (ffffffffc1703220) 00010000:00010000:0.0:1788869455.701447:0:11822:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000081575a94/0x3d2d1916761d7219 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869455.701457:0:11822:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000081575a94/0x3d2d1916761d7219 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 11822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869455.701468:0:11822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000081575a94/0x3d2d1916761d7219 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869455.701475:0:11822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000081575a94/0x3d2d1916761d7219 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788869455.701545:0:11822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c703416680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:2125b9b3-626e-4cbe-be83-fb446e976ce2+9:2348:x1875765413103872:12345-192.168.201.39@tcp:1:lfs.0 Request processed in 7815us (8584us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869455.701553:0:11822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 61 00000100:00100000:3.0:1788869455.703602:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1788869455.703698:0:11820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765413104384 00000100:00100000:2.0:1788869455.703706:0:11820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765413104384 00000100:00100000:2.0:1788869455.703798:0:11820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 56 00000100:00100000:2.0:1788869455.703809:0:11820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c81876a450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:2125b9b3-626e-4cbe-be83-fb446e976ce2+43:11517:x1875765413104384:12345-192.168.201.39@tcp:35:lfs.0 00000004:00010000:2.0:1788869455.703863:0:11820:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0xe:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff94c818d1e200/0x3d2d1916761d7204 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0x375c010249035b65 expref: 43 pid: 5755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788869455.704109:0:11820:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967486 00000001:00080000:2.0:1788869455.704156:0:11820:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967487 00000001:00080000:2.0:1788869455.704520:0:11820:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967488 00010000:00010000:2.0:1788869455.704572:0:11820:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94c805039a00/0x3d2d1916761d7220 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869455.704586:0:11820:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff94c818d1ec00/0x3d2d1916761d7212 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.39@tcp remote: 0x375c010249035b6c expref: 47 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869455.704596:0:11820:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff94c805039a00/0x3d2d1916761d7220 lrc: 4/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869455.704629:0:11820:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff94c818d1ec00/0x3d2d1916761d7212 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.201.39@tcp remote: 0x375c010249035b6c expref: 47 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869455.704660:0:11820:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff94c818d1ec00/0x3d2d1916761d7212 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.201.39@tcp remote: 0x375c010249035b6c expref: 47 pid: 5786 timeout: 303 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788869455.704674:0:11820:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94c83fae8000 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000_UUID:11820:1875765421471488:192.168.201.39@tcp:104: 00000100:00100000:2.0:1788869455.704750:0:11820:0:(client.c:2702:ptlrpc_set_wait()) set ffff94c805068300 going to sleep for 11 seconds 00000100:00100000:2.0:1788869455.708399:0:11820:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94c83fae8000 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000_UUID:11820:1875765421471488:192.168.201.39@tcp:104: 00010000:00010000:2.0:1788869455.708425:0:11820:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff94c805039a00/0x3d2d1916761d7220 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11820 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788869455.708679:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1788869455.708747:0:5739:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765413104512 00000100:00100000:2.0:1788869455.708753:0:5739:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765413104512 00010000:00010000:2.0:1788869455.708782:0:5739:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff94c818d1ec00/0x3d2d1916761d7212 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.39@tcp remote: 0x375c010249035b6c expref: 48 pid: 5786 timeout: 303 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788869455.708813:0:5739:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 81 00000100:00100000:2.0:1788869455.708819:0:5739:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c83fbb3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2125b9b3-626e-4cbe-be83-fb446e976ce2+48:2348:x1875765413104512:12345-192.168.201.39@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788869455.708831:0:5739:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788869455.708836:0:5739:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff94c818d1ec00/0x3d2d1916761d7212 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.39@tcp remote: 0x375c010249035b6c expref: 48 pid: 5786 timeout: 303 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869455.708845:0:5739:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff94c818d1ec00/0x3d2d1916761d7212 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.201.39@tcp remote: 0x375c010249035b6c expref: 48 pid: 5786 timeout: 303 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869455.708861:0:5739:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94c818d1ec00/0x3d2d1916761d7212 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.201.39@tcp remote: 0x375c010249035b6c expref: 48 pid: 5786 timeout: 303 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869455.708892:0:5739:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff94c803990800) 00010000:00010000:2.0:1788869455.708897:0:5739:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff94c805039a00/0x3d2d1916761d7220 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869455.708907:0:5739:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff94c805039a00/0x3d2d1916761d7220 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 11820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869455.708915:0:5739:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94c805039a00/0x3d2d1916761d7220 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 11820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869455.708934:0:5739:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788869455.708968:0:11820:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff94c805039a00/0x3d2d1916761d7220 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869455.708988:0:11820:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94c805039a00/0x3d2d1916761d7220 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11820 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788869455.709009:0:5739:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c83fbb3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2125b9b3-626e-4cbe-be83-fb446e976ce2+47:2348:x1875765413104512:12345-192.168.201.39@tcp:103:ldlm_bl.0 Request processed in 189us (331us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869455.709015:0:5739:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 81 00000001:00080000:1.0:1788869455.709116:0:11820:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967489 00000001:00080000:1.0:1788869455.709347:0:11820:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967490 00000100:00100000:1.0:1788869455.709472:0:11820:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94c703414a80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000-mdtlov_UUID:11820:1875765421471616:0@lo:1000:mdt_rdpg00_002.0 00000100:00100000:1.0:1788869455.709540:0:11820:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869455.709564:0:11820:0:(client.c:2702:ptlrpc_set_wait()) set ffff94c818e67300 going to sleep for 11 seconds 00000100:00100000:3.0:1788869455.709571:0:5761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765421471616 00000100:00100000:3.0:1788869455.709577:0:5761:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765421471616 00000100:00100000:3.0:1788869455.709661:0:5761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788869455.709669:0:5761:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c703417800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:11820:x1875765421471616:12345-0@lo:1000:mdt_rdpg00_002.0 00000100:00100000:3.0:1788869455.709739:0:5761:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c703417800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:11820:x1875765421471616:12345-0@lo:1000:mdt_rdpg00_002.0 Request processed in 70us (199us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869455.709752:0:5761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788869455.709818:0:11820:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94c703414a80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000-mdtlov_UUID:11820:1875765421471616:0@lo:1000:mdt_rdpg00_002.0 00000001:00080000:2.0:1788869455.710108:0:11820:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967491 00000100:00100000:2.0:1788869455.710149:0:11820:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94c83fae8000 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000-mdtlov_UUID:11820:1875765421471744:0@lo:1000:mdt_rdpg00_002.0 00000100:00100000:2.0:1788869455.710169:0:11820:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869455.710187:0:11820:0:(client.c:2702:ptlrpc_set_wait()) set ffff94c8050683c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788869455.710223:0:5761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765421471744 00000100:00100000:3.0:1788869455.710226:0:5761:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765421471744 00000100:00100000:3.0:1788869455.710244:0:5761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1788869455.710276:0:5761:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c83faeb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:11820:x1875765421471744:12345-0@lo:1000:mdt_rdpg00_002.0 00000100:00100000:3.0:1788869455.710492:0:5761:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c83faeb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+8:11820:x1875765421471744:12345-0@lo:1000:mdt_rdpg00_002.0 Request processed in 242us (320us total) trans 4294967309 rc 0/0 00000100:00100000:3.0:1788869455.710508:0:5761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00080000:0.0:1788869455.710566:0:5751:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788869455.710616:0:11820:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94c83fae8000 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000-mdtlov_UUID:11820:1875765421471744:0@lo:1000:mdt_rdpg00_002.0 00000001:00080000:2.0:1788869455.710649:0:11820:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967492 00010000:00010000:2.0:1788869455.710680:0:11820:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94c805039a00/0x3d2d1916761d7220 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869455.710689:0:11820:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94c805039a00/0x3d2d1916761d7220 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 11820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869455.710705:0:11820:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94c805039a00/0x3d2d1916761d7220 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869455.710712:0:11820:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94c805039a00 already unused, calling callback (ffffffffc21124f0) 00010000:00010000:2.0:1788869455.710716:0:11820:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94c805039a00/0x3d2d1916761d7220 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869455.710724:0:11820:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94c805039a00/0x3d2d1916761d7220 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 11820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869455.710738:0:11820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff94c803990800) 00010000:00010000:2.0:1788869455.710741:0:11820:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:2.0:1788869455.710745:0:11820:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94c805039a00/0x3d2d1916761d7220 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869455.710751:0:11820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94c805039a00/0x3d2d1916761d7220 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11820 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788869455.710856:0:11820:0:(mdd_object.c:4016:mdd_close()) Object [0x200000401:0xf:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:2.0:1788869455.710938:0:11820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].5, 64 off8512 00000004:00080000:2.0:1788869455.710946:0:11820:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 204002695825ns, next at 205002694342ns, rc = 0 00000001:00080000:2.0:1788869455.710951:0:11820:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967493 00010000:00010000:2.0:1788869455.710971:0:11820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff94c803990800) 00010000:00010000:2.0:1788869455.710972:0:11820:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1788869455.710977:0:11820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94c818d1e200/0x3d2d1916761d7204 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.39@tcp remote: 0x375c010249035b65 expref: 51 pid: 5755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788869455.711041:0:11820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c81876a450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:2125b9b3-626e-4cbe-be83-fb446e976ce2+50:11517:x1875765413104384:12345-192.168.201.39@tcp:35:lfs.0 Request processed in 7236us (7447us total) trans 4294967494 rc 0/0 00000100:00100000:2.0:1788869455.711053:0:11820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 56 00000020:00080000:2.0:1788869455.711056:0:11820:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:3.0:1788869455.714353:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1788869455.714421:0:5756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765413104640 00000100:00100000:1.0:1788869455.714432:0:5756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765413104640 00000100:00100000:1.0:1788869455.714488:0:5756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 205 00000100:00100000:1.0:1788869455.714663:0:5756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c83f9ab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2125b9b3-626e-4cbe-be83-fb446e976ce2+50:11517:x1875765413104640:12345-192.168.201.39@tcp:101:lfs.0 00010000:00010000:1.0:1788869455.714688:0:5756:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788869455.714712:0:5756:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94c83fde6800/0x3d2d1916761d7227 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x375c010249035b73 expref: -99 pid: 5756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869455.714768:0:5756:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94c83fde6800/0x3d2d1916761d7227 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.39@tcp remote: 0x375c010249035b73 expref: 51 pid: 5756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869455.714778:0:5756:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94c83fde6800/0x3d2d1916761d7227 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.39@tcp remote: 0x375c010249035b73 expref: 51 pid: 5756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869455.714791:0:5756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff94c81a585c00) 00010000:00010000:1.0:1788869455.714793:0:5756:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788869455.714796:0:5756:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94c83fde6800, rc 0) 00000100:00100000:1.0:1788869455.714842:0:5756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c83f9ab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2125b9b3-626e-4cbe-be83-fb446e976ce2+51:11517:x1875765413104640:12345-192.168.201.39@tcp:101:lfs.0 Request processed in 184us (597us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869455.714866:0:5756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 205 00000100:00100000:1.0:1788869455.716820:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1788869455.716900:0:5758:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765413104896 00000100:00100000:0.0:1788869455.716906:0:5758:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765413104896 00000100:00100000:0.0:1788869455.716944:0:5758:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 57 00000100:00100000:0.0:1788869455.716950:0:5758:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c703416300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2125b9b3-626e-4cbe-be83-fb446e976ce2+51:11517:x1875765413104896:12345-192.168.201.39@tcp:35:lfs.0 00000100:00100000:0.0:1788869455.717117:0:5758:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c703416300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2125b9b3-626e-4cbe-be83-fb446e976ce2+52:11517:x1875765413104896:12345-192.168.201.39@tcp:35:lfs.0 Request processed in 166us (302us total) trans 4294967495 rc 0/0 00000100:00100000:0.0:1788869455.717124:0:5758:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 57 00000100:00100000:3.0:1788869455.751940:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1788869455.751996:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765413105024 00000100:00100000:0.0:1788869455.752006:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765413105024 00000100:00100000:0.0:1788869455.752063:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 206 00000100:00100000:0.0:1788869455.752072:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c83f9aad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2125b9b3-626e-4cbe-be83-fb446e976ce2+52:11527:x1875765413105024:12345-192.168.201.39@tcp:34:lfs.0 00010000:00010000:0.0:1788869455.752148:0:5786:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff94c818d1f600/0x3d2d1916761d722e lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869455.752165:0:5786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94c818d1f600/0x3d2d1916761d722e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869455.752175:0:5786:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94c818d1f600/0x3d2d1916761d722e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869455.752188:0:5786:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94c818d1fc00/0x3d2d1916761d7235 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869455.752195:0:5786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94c818d1fc00/0x3d2d1916761d7235 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869455.752201:0:5786:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94c818d1fc00/0x3d2d1916761d7235 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869455.752322:0:5786:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94c818d1fa00/0x3d2d1916761d723c lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869455.752331:0:5786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94c818d1fa00/0x3d2d1916761d723c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869455.752339:0:5786:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94c818d1fa00/0x3d2d1916761d723c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788869455.752371:0:5786:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff94c818d1fa00/0x3d2d1916761d723c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869455.752395:0:5786:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff94c818d1f600/0x3d2d1916761d722e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869455.752411:0:5786:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94c818d1f600/0x3d2d1916761d722e lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869455.752419:0:5786:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94c818d1f600/0x3d2d1916761d722e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869455.752424:0:5786:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94c818d1f600 already unused, calling callback (ffffffffc21124f0) 00010000:00010000:0.0:1788869455.752428:0:5786:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94c818d1f600/0x3d2d1916761d722e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869455.752433:0:5786:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94c818d1f600/0x3d2d1916761d722e lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869455.752443:0:5786:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff94c802f3fd00) 00010000:00010000:0.0:1788869455.752444:0:5786:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788869455.752447:0:5786:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94c818d1f600/0x3d2d1916761d722e lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869455.752451:0:5786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94c818d1f600/0x3d2d1916761d722e lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869455.752460:0:5786:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94c818d1fc00/0x3d2d1916761d7235 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869455.752463:0:5786:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94c818d1fc00/0x3d2d1916761d7235 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869455.752467:0:5786:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94c818d1fc00/0x3d2d1916761d7235 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869455.752474:0:5786:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94c818d1fc00 already unused, calling callback (ffffffffc21124f0) 00010000:00010000:0.0:1788869455.752477:0:5786:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94c818d1fc00/0x3d2d1916761d7235 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869455.752483:0:5786:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94c818d1fc00/0x3d2d1916761d7235 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869455.752491:0:5786:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff94c803990b00) 00010000:00010000:0.0:1788869455.752504:0:5786:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788869455.752507:0:5786:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94c818d1fc00/0x3d2d1916761d7235 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869455.752513:0:5786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94c818d1fc00/0x3d2d1916761d7235 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869455.752527:0:5786:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94c818d1fa00/0x3d2d1916761d723c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869455.752532:0:5786:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94c818d1fa00/0x3d2d1916761d723c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869455.752537:0:5786:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94c818d1fa00/0x3d2d1916761d723c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869455.752542:0:5786:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94c818d1fa00 already unused, calling callback (ffffffffc21124f0) 00010000:00010000:0.0:1788869455.752545:0:5786:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94c818d1fa00/0x3d2d1916761d723c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869455.752550:0:5786:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94c818d1fa00/0x3d2d1916761d723c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869455.752567:0:5786:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff94c81a585c00) 00010000:00010000:0.0:1788869455.752569:0:5786:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788869455.752572:0:5786:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94c818d1fa00/0x3d2d1916761d723c lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869455.752576:0:5786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94c818d1fa00/0x3d2d1916761d723c lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788869455.752642:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c83f9aad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2125b9b3-626e-4cbe-be83-fb446e976ce2+52:11527:x1875765413105024:12345-192.168.201.39@tcp:34:lfs.0 Request processed in 571us (711us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869455.752651:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 206 00000100:00100000:2.0:1788869455.774532:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1788869455.774594:0:5755:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765413105280 00000100:00100000:0.0:1788869455.774603:0:5755:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765413105280 00000100:00100000:0.0:1788869455.774653:0:5755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 207 00000100:00100000:0.0:1788869455.774661:0:5755:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c83faea680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2125b9b3-626e-4cbe-be83-fb446e976ce2+52:11530:x1875765413105280:12345-192.168.201.39@tcp:101:lfs.0 00010000:00010000:0.0:1788869455.774678:0:5755:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788869455.774693:0:5755:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94c818d1fa00/0x3d2d1916761d7243 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x375c010249035b7a expref: -99 pid: 5755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869455.774774:0:5755:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff94c818d1fc00/0x3d2d1916761d724a lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869455.774789:0:5755:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94c818d1fc00/0x3d2d1916761d724a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869455.774801:0:5755:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94c818d1fc00/0x3d2d1916761d724a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869455.774815:0:5755:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94c818d1f600/0x3d2d1916761d7251 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869455.774833:0:5755:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94c818d1f600/0x3d2d1916761d7251 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869455.774837:0:5755:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94c818d1f600/0x3d2d1916761d7251 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869455.774933:0:5755:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94c818d1e000/0x3d2d1916761d7258 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869455.774939:0:5755:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94c818d1e000/0x3d2d1916761d7258 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869455.774944:0:5755:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94c818d1e000/0x3d2d1916761d7258 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788869455.774950:0:5755:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:0.0:1788869455.775043:0:5755:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff94c818d1fc00/0x3d2d1916761d724a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869455.775050:0:5755:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94c818d1fc00/0x3d2d1916761d724a lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869455.775055:0:5755:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94c818d1fc00/0x3d2d1916761d724a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869455.775058:0:5755:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94c818d1fc00 already unused, calling callback (ffffffffc21124f0) 00010000:00010000:0.0:1788869455.775061:0:5755:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94c818d1fc00/0x3d2d1916761d724a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869455.775066:0:5755:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94c818d1fc00/0x3d2d1916761d724a lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869455.775089:0:5755:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff94c802f3fd00) 00010000:00010000:0.0:1788869455.775092:0:5755:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788869455.775096:0:5755:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94c818d1fc00/0x3d2d1916761d724a lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869455.775103:0:5755:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94c818d1fc00/0x3d2d1916761d724a lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869455.775116:0:5755:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94c818d1f600/0x3d2d1916761d7251 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869455.775123:0:5755:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94c818d1f600/0x3d2d1916761d7251 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869455.775129:0:5755:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94c818d1f600/0x3d2d1916761d7251 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869455.775135:0:5755:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94c818d1f600 already unused, calling callback (ffffffffc21124f0) 00010000:00010000:0.0:1788869455.775138:0:5755:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94c818d1f600/0x3d2d1916761d7251 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869455.775144:0:5755:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94c818d1f600/0x3d2d1916761d7251 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869455.775151:0:5755:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff94c803990b00) 00010000:00010000:0.0:1788869455.775154:0:5755:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788869455.775157:0:5755:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94c818d1f600/0x3d2d1916761d7251 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869455.775162:0:5755:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94c818d1f600/0x3d2d1916761d7251 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869455.775211:0:5755:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94c818d1fa00/0x3d2d1916761d7243 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0x375c010249035b7a expref: 55 pid: 5755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869455.775225:0:5755:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94c818d1e000/0x3d2d1916761d7258 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0x375c010249035b7a expref: 54 pid: 5755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869455.775232:0:5755:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff94c81a585c00) 00010000:00010000:0.0:1788869455.775234:0:5755:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788869455.775237:0:5755:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94c818d1e000, rc 0) 00000100:00100000:0.0:1788869455.775334:0:5755:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c83faea680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2125b9b3-626e-4cbe-be83-fb446e976ce2+54:11530:x1875765413105280:12345-192.168.201.39@tcp:101:lfs.0 Request processed in 672us (811us total) trans 4294967496 rc 0/0 00000100:00100000:0.0:1788869455.775343:0:5755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 207 00000100:00100000:1.0:1788869455.778043:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1788869455.778103:0:5757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765413105408 00000100:00100000:2.0:1788869455.778113:0:5757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765413105408 00000100:00100000:2.0:1788869455.778164:0:5757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 208 00000100:00100000:2.0:1788869455.778175:0:5757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c703415880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2125b9b3-626e-4cbe-be83-fb446e976ce2+54:11530:x1875765413105408:12345-192.168.201.39@tcp:54:lfs.0 00010000:00010000:2.0:1788869455.778231:0:5757:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94c805039a00/0x3d2d1916761d7266 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869455.778246:0:5757:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94c805039a00/0x3d2d1916761d7266 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869455.778288:0:5757:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94c805039a00/0x3d2d1916761d7266 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869455.778311:0:5757:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94c805039a00/0x3d2d1916761d7266 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869455.778427:0:5757:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94c805039a00/0x3d2d1916761d7266 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869455.778434:0:5757:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94c805039a00/0x3d2d1916761d7266 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869455.778440:0:5757:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94c805039a00 already unused, calling callback (ffffffffc21124f0) 00010000:00010000:2.0:1788869455.778444:0:5757:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94c805039a00/0x3d2d1916761d7266 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869455.778451:0:5757:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94c805039a00/0x3d2d1916761d7266 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869455.778475:0:5757:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff94c81a585c00) 00010000:00010000:2.0:1788869455.778478:0:5757:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788869455.778482:0:5757:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94c805039a00/0x3d2d1916761d7266 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869455.778489:0:5757:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94c805039a00/0x3d2d1916761d7266 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5757 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788869455.778569:0:5757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c703415880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2125b9b3-626e-4cbe-be83-fb446e976ce2+54:11530:x1875765413105408:12345-192.168.201.39@tcp:54:lfs.0 Request processed in 395us (531us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869455.778578:0:5757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 208 00000100:00100000:3.0:1788869455.779774:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1788869455.779931:0:11820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765413105664 00000100:00100000:2.0:1788869455.779937:0:11820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765413105664 00000100:00100000:2.0:1788869455.779973:0:11820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 58 00000100:00100000:2.0:1788869455.779982:0:11820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c83f9a9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:2125b9b3-626e-4cbe-be83-fb446e976ce2+54:11530:x1875765413105664:12345-192.168.201.39@tcp:35:lfs.0 00000100:00100000:2.0:1788869455.780356:0:11820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c83f9a9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:2125b9b3-626e-4cbe-be83-fb446e976ce2+55:11530:x1875765413105664:12345-192.168.201.39@tcp:35:lfs.0 Request processed in 373us (584us total) trans 4294967497 rc 0/0 00000100:00100000:2.0:1788869455.780364:0:11820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 58 00000100:00100000:3.0:1788869455.828014:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1788869455.828084:0:5755:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765413105920 00000100:00100000:0.0:1788869455.828092:0:5755:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765413105920 00000100:00100000:0.0:1788869455.828150:0:5755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 209 00000100:00100000:0.0:1788869455.828160:0:5755:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c803fb9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2125b9b3-626e-4cbe-be83-fb446e976ce2+55:11540:x1875765413105920:12345-192.168.201.39@tcp:101:bash.0 00010000:00010000:0.0:1788869455.828185:0:5755:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788869455.828188:0:5755:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1788869455.828223:0:5755:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94c818d1fe00/0x3d2d1916761d71e1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.39@tcp remote: 0x375c010249035b57 expref: 55 pid: 5756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869455.828238:0:5755:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff94c802f3fd00) 00010000:00010000:0.0:1788869455.828242:0:5755:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788869455.828294:0:5755:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94c818d1fa00/0x3d2d1916761d726d lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x375c010249035b81 expref: -99 pid: 5755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869455.828406:0:5755:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94c818d1f600/0x3d2d1916761d7274 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869455.828416:0:5755:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff94c818d1e000/0x3d2d1916761d7258 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0x375c010249035b7a expref: 55 pid: 5755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869455.828422:0:5755:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff94c818d1f600/0x3d2d1916761d7274 lrc: 4/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869455.828446:0:5755:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff94c818d1e000/0x3d2d1916761d7258 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.39@tcp remote: 0x375c010249035b7a expref: 55 pid: 5755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869455.828454:0:5755:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff94c818d1e000/0x3d2d1916761d7258 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.39@tcp remote: 0x375c010249035b7a expref: 55 pid: 5755 timeout: 304 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788869455.828464:0:5755:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94c808f53800 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5755:1875765421471872:192.168.201.39@tcp:104: 00000100:00100000:0.0:1788869455.828566:0:5755:0:(client.c:2702:ptlrpc_set_wait()) set ffff94c81075aa80 going to sleep for 11 seconds 00000100:00100000:1.0:1788869455.833123:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1788869455.833415:0:5755:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94c808f53800 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5755:1875765421471872:192.168.201.39@tcp:104: 00000100:00100000:2.0:1788869455.833444:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765413106048 00010000:00010000:0.0:1788869455.833445:0:5755:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff94c818d1f600/0x3d2d1916761d7274 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788869455.833453:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765413106048 00010000:00010000:2.0:1788869455.833502:0:5788:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff94c818d1e000/0x3d2d1916761d7258 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.39@tcp remote: 0x375c010249035b7a expref: 56 pid: 5755 timeout: 304 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788869455.833539:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 82 00000100:00100000:2.0:1788869455.833549:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c703417b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2125b9b3-626e-4cbe-be83-fb446e976ce2+56:2347:x1875765413106048:12345-192.168.201.39@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788869455.833577:0:5788:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788869455.833603:0:5788:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff94c818d1e000/0x3d2d1916761d7258 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.39@tcp remote: 0x375c010249035b7a expref: 56 pid: 5755 timeout: 304 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869455.833616:0:5788:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff94c818d1e000/0x3d2d1916761d7258 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.39@tcp remote: 0x375c010249035b7a expref: 56 pid: 5755 timeout: 304 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869455.833642:0:5788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94c818d1e000/0x3d2d1916761d7258 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.39@tcp remote: 0x375c010249035b7a expref: 56 pid: 5755 timeout: 304 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869455.833660:0:5788:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff94c81a585c00) 00010000:00010000:2.0:1788869455.833665:0:5788:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff94c818d1f600/0x3d2d1916761d7274 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869455.833675:0:5788:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff94c818d1f600/0x3d2d1916761d7274 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869455.833683:0:5788:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94c818d1f600/0x3d2d1916761d7274 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869455.833716:0:5788:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788869455.833775:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c703417b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2125b9b3-626e-4cbe-be83-fb446e976ce2+55:2347:x1875765413106048:12345-192.168.201.39@tcp:103:ldlm_bl.0 Request processed in 227us (660us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869455.833783:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 82 00010000:00010000:0.0:1788869455.833821:0:5755:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff94c818d1f600/0x3d2d1916761d7274 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869455.833830:0:5755:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94c818d1f600/0x3d2d1916761d7274 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788869455.833851:0:5755:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:0.0:1788869455.833991:0:5755:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94c818d1fa00/0x3d2d1916761d726d lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0x375c010249035b81 expref: 56 pid: 5755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869455.834007:0:5755:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94c818d1f600/0x3d2d1916761d7274 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0x375c010249035b81 expref: 55 pid: 5755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869455.834015:0:5755:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff94c81a585c00) 00010000:00010000:0.0:1788869455.834018:0:5755:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1788869455.834021:0:5755:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94c818d1f600, rc 0) 00000100:00100000:0.0:1788869455.834045:0:5755:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c803fb9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2125b9b3-626e-4cbe-be83-fb446e976ce2+55:11540:x1875765413105920:12345-192.168.201.39@tcp:101:bash.0 Request processed in 5887us (6042us total) trans 4294967498 rc 0/0 00000100:00100000:0.0:1788869455.834052:0:5755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 209 00000100:00100000:3.0:1788869455.841579:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1788869455.841631:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765413106304 00000100:00100000:0.0:1788869455.841640:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765413106304 00000100:00100000:0.0:1788869455.841709:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 210 00000100:00100000:0.0:1788869455.841720:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c810e68a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2125b9b3-626e-4cbe-be83-fb446e976ce2+55:11540:x1875765413106304:12345-192.168.201.39@tcp:36:bash.0 00010000:00010000:0.0:1788869455.841997:0:5786:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94c818d1fe00/0x3d2d1916761d7282 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869455.842014:0:5786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94c818d1fe00/0x3d2d1916761d7282 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869455.842026:0:5786:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94c818d1fe00/0x3d2d1916761d7282 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788869455.842077:0:5786:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967499 00000004:00010000:0.0:1788869455.842107:0:5786:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000000d1d67f9 reply state 000000009b648698 transno 4294967500 ns: mdt-lustre-MDT0000_UUID lock: ffff94c818d1fe00/0x3d2d1916761d7282 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788869455.842116:0:5786:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788869455.842229:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c810e68a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2125b9b3-626e-4cbe-be83-fb446e976ce2+58:11540:x1875765413106304:12345-192.168.201.39@tcp:36:bash.0 Request processed in 507us (655us total) trans 4294967500 rc 0/0 00000100:00100000:0.0:1788869455.842237:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 210 00000020:00080000:0.0:1788869455.842241:0:5786:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1788869455.843726:0:3270:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94c818d1fe00/0x3d2d1916761d7282 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869455.843740:0:3270:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94c818d1fe00/0x3d2d1916761d7282 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869455.843747:0:3270:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94c818d1fe00/0x3d2d1916761d7282 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869455.843753:0:3270:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94c818d1fe00 already unused, calling callback (ffffffffc21124f0) 00010000:00010000:1.0:1788869455.843758:0:3270:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94c818d1fe00/0x3d2d1916761d7282 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869455.843766:0:3270:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94c818d1fe00/0x3d2d1916761d7282 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869455.843781:0:3270:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff94c81a585c00) 00010000:00010000:1.0:1788869455.843784:0:3270:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788869455.843788:0:3270:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94c818d1fe00/0x3d2d1916761d7282 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869455.843794:0:3270:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94c818d1fe00/0x3d2d1916761d7282 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788869455.843975:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1788869455.844045:0:5756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765413106432 00000100:00100000:1.0:1788869455.844051:0:5756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765413106432 00000100:00100000:1.0:1788869455.844100:0:5756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 211 00000100:00100000:1.0:1788869455.844115:0:5756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c810e6aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2125b9b3-626e-4cbe-be83-fb446e976ce2+57:11540:x1875765413106432:12345-192.168.201.39@tcp:101:bash.0 00010000:00010000:1.0:1788869455.844131:0:5756:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788869455.844145:0:5756:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94c83fde7000/0x3d2d1916761d7289 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x375c010249035b88 expref: -99 pid: 5756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869455.844225:0:5756:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94c83fde7400/0x3d2d1916761d7290 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869455.844239:0:5756:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff94c818d1f600/0x3d2d1916761d7274 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0x375c010249035b81 expref: 58 pid: 5755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869455.844284:0:5756:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff94c83fde7400/0x3d2d1916761d7290 lrc: 4/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869455.844328:0:5756:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff94c818d1f600/0x3d2d1916761d7274 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.39@tcp remote: 0x375c010249035b81 expref: 58 pid: 5755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869455.844349:0:5756:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff94c818d1f600/0x3d2d1916761d7274 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.39@tcp remote: 0x375c010249035b81 expref: 58 pid: 5755 timeout: 304 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788869455.844368:0:5756:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94c703414380 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5756:1875765421472000:192.168.201.39@tcp:104: 00000100:00100000:1.0:1788869455.844432:0:5756:0:(client.c:2702:ptlrpc_set_wait()) set ffff94c818e67240 going to sleep for 11 seconds 00000100:00100000:3.0:1788869455.845606:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1788869455.845682:0:5756:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94c703414380 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5756:1875765421472000:192.168.201.39@tcp:104: 00010000:00010000:1.0:1788869455.845710:0:5756:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff94c83fde7400/0x3d2d1916761d7290 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788869455.845760:0:7448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765413106560 00000100:00100000:2.0:1788869455.845764:0:7448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765413106560 00010000:00010000:2.0:1788869455.845872:0:7448:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff94c818d1f600/0x3d2d1916761d7274 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.39@tcp remote: 0x375c010249035b81 expref: 59 pid: 5755 timeout: 304 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788869455.845909:0:7448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 83 00000100:00100000:2.0:1788869455.845916:0:7448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c810e6b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:2125b9b3-626e-4cbe-be83-fb446e976ce2+59:2348:x1875765413106560:12345-192.168.201.39@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788869455.845934:0:7448:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788869455.845938:0:7448:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff94c818d1f600/0x3d2d1916761d7274 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.39@tcp remote: 0x375c010249035b81 expref: 59 pid: 5755 timeout: 304 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869455.845946:0:7448:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff94c818d1f600/0x3d2d1916761d7274 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.39@tcp remote: 0x375c010249035b81 expref: 59 pid: 5755 timeout: 304 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869455.845960:0:7448:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94c818d1f600/0x3d2d1916761d7274 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.39@tcp remote: 0x375c010249035b81 expref: 59 pid: 5755 timeout: 304 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869455.845968:0:7448:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff94c81a585c00) 00010000:00010000:2.0:1788869455.845971:0:7448:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff94c83fde7400/0x3d2d1916761d7290 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869455.845977:0:7448:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff94c83fde7400/0x3d2d1916761d7290 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869455.845982:0:7448:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94c83fde7400/0x3d2d1916761d7290 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869455.846006:0:7448:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788869455.846038:0:5756:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff94c83fde7400/0x3d2d1916761d7290 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788869455.846044:0:7448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c810e6b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:2125b9b3-626e-4cbe-be83-fb446e976ce2+58:2348:x1875765413106560:12345-192.168.201.39@tcp:103:ldlm_bl.0 Request processed in 127us (439us total) trans 0 rc 0/0 00010000:00010000:0.0:1788869455.846054:0:5756:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94c83fde7400/0x3d2d1916761d7290 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788869455.846055:0:7448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 83 00000004:00200000:0.0:1788869455.846092:0:5756:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:0.0:1788869455.846097:0:5756:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1788869455.846115:0:5756:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff94c83fde7400/0x3d2d1916761d7290 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869455.846143:0:5756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94c83fde7000/0x3d2d1916761d7289 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0x375c010249035b88 expref: 58 pid: 5756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869455.846161:0:5756:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94c83fde7400/0x3d2d1916761d7290 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0x375c010249035b88 expref: 57 pid: 5756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869455.846169:0:5756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff94c81a585c00) 00010000:00010000:0.0:1788869455.846172:0:5756:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788869455.846175:0:5756:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94c83fde7400, rc 0) 00000100:00100000:0.0:1788869455.846223:0:5756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c810e6aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2125b9b3-626e-4cbe-be83-fb446e976ce2+57:11540:x1875765413106432:12345-192.168.201.39@tcp:101:bash.0 Request processed in 2108us (2249us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869455.846231:0:5756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 211 00000100:00100000:3.0:1788869455.847931:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1788869455.847970:0:5759:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765413106816 00000100:00100000:0.0:1788869455.847977:0:5759:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765413106816 00000100:00100000:0.0:1788869455.848061:0:5759:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 59 00000100:00100000:0.0:1788869455.848075:0:5759:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c8349eed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2125b9b3-626e-4cbe-be83-fb446e976ce2+57:11540:x1875765413106816:12345-192.168.201.39@tcp:35:bash.0 00000100:00100000:0.0:1788869455.848245:0:5759:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c8349eed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2125b9b3-626e-4cbe-be83-fb446e976ce2+58:11540:x1875765413106816:12345-192.168.201.39@tcp:35:bash.0 Request processed in 169us (316us total) trans 4294967501 rc 0/0 00000100:00100000:0.0:1788869455.848270:0:5759:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 59 00000100:00100000:3.0:1788869455.884145:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1788869455.884220:0:5757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765413106944 00000100:00100000:2.0:1788869455.884232:0:5757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765413106944 00000100:00100000:2.0:1788869455.884323:0:5757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 212 00000100:00100000:2.0:1788869455.884333:0:5757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c82065f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2125b9b3-626e-4cbe-be83-fb446e976ce2+58:11546:x1875765413106944:12345-192.168.201.39@tcp:101:lfs.0 00010000:00010000:2.0:1788869455.884381:0:5757:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788869455.884403:0:5757:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94c805039a00/0x3d2d1916761d7297 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x375c010249035b8f expref: -99 pid: 5757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869455.884465:0:5757:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94c805038400/0x3d2d1916761d729e lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869455.884479:0:5757:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94c805038400/0x3d2d1916761d729e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869455.884489:0:5757:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94c805038400/0x3d2d1916761d729e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5757 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788869455.884557:0:5757:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 7680 00000004:00200000:2.0:1788869455.884561:0:5757:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:2.0:1788869455.884587:0:5757:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff94c805038400/0x3d2d1916761d729e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869455.884609:0:5757:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94c805039a00/0x3d2d1916761d7297 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0x375c010249035b8f expref: 60 pid: 5757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869455.884627:0:5757:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94c805038400/0x3d2d1916761d729e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0x375c010249035b8f expref: 59 pid: 5757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869455.884636:0:5757:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff94c802f3fd00) 00010000:00010000:2.0:1788869455.884639:0:5757:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788869455.884642:0:5757:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94c805038400, rc 0) 00000100:00100000:2.0:1788869455.884696:0:5757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c82065f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2125b9b3-626e-4cbe-be83-fb446e976ce2+59:11546:x1875765413106944:12345-192.168.201.39@tcp:101:lfs.0 Request processed in 364us (562us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869455.884703:0:5757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 212 00000100:00100000:3.0:1788869455.886051:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1788869455.886102:0:5755:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765413107072 00000100:00100000:0.0:1788869455.886109:0:5755:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765413107072 00000100:00100000:0.0:1788869455.886147:0:5755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 213 00000100:00100000:0.0:1788869455.886156:0:5755:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c702348a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2125b9b3-626e-4cbe-be83-fb446e976ce2+59:11546:x1875765413107072:12345-192.168.201.39@tcp:101:lfs.0 00010000:00010000:0.0:1788869455.886167:0:5755:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788869455.886178:0:5755:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94c818d1fa00/0x3d2d1916761d72a5 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x375c010249035b96 expref: -99 pid: 5755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869455.886215:0:5755:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff94c818d1fc00/0x3d2d1916761d72ac lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869455.886226:0:5755:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94c818d1fc00/0x3d2d1916761d72ac lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869455.886234:0:5755:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94c818d1fc00/0x3d2d1916761d72ac lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869455.886277:0:5755:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94c818d1e600/0x3d2d1916761d72b3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869455.886286:0:5755:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94c818d1e600/0x3d2d1916761d72b3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869455.886302:0:5755:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94c818d1e600/0x3d2d1916761d72b3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869455.886398:0:5755:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94c818d1f600/0x3d2d1916761d72ba lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869455.886407:0:5755:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94c818d1f600/0x3d2d1916761d72ba lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869455.886414:0:5755:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94c818d1f600/0x3d2d1916761d72ba lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788869455.886441:0:5755:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:0.0:1788869455.886445:0:5755:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1788869455.886456:0:5755:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff94c818d1f600/0x3d2d1916761d72ba lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869455.886467:0:5755:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94c818d1f600/0x3d2d1916761d72ba lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869455.886475:0:5755:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff94c818d1fc00/0x3d2d1916761d72ac lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869455.886489:0:5755:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94c818d1fc00/0x3d2d1916761d72ac lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869455.886507:0:5755:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94c818d1fc00/0x3d2d1916761d72ac lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869455.886513:0:5755:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94c818d1fc00 already unused, calling callback (ffffffffc21124f0) 00010000:00010000:0.0:1788869455.886518:0:5755:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94c818d1fc00/0x3d2d1916761d72ac lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869455.886526:0:5755:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94c818d1fc00/0x3d2d1916761d72ac lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869455.886542:0:5755:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff94c802f3fd00) 00010000:00010000:0.0:1788869455.886545:0:5755:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788869455.886550:0:5755:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94c818d1fc00/0x3d2d1916761d72ac lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869455.886556:0:5755:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94c818d1fc00/0x3d2d1916761d72ac lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869455.886569:0:5755:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94c818d1e600/0x3d2d1916761d72b3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869455.886575:0:5755:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94c818d1e600/0x3d2d1916761d72b3 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869455.886580:0:5755:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94c818d1e600/0x3d2d1916761d72b3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869455.886585:0:5755:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94c818d1e600 already unused, calling callback (ffffffffc21124f0) 00010000:00010000:0.0:1788869455.886588:0:5755:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94c818d1e600/0x3d2d1916761d72b3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869455.886595:0:5755:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94c818d1e600/0x3d2d1916761d72b3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869455.886602:0:5755:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff94c803990b00) 00010000:00010000:0.0:1788869455.886604:0:5755:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788869455.886607:0:5755:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94c818d1e600/0x3d2d1916761d72b3 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869455.886613:0:5755:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94c818d1e600/0x3d2d1916761d72b3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869455.886647:0:5755:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94c818d1fa00/0x3d2d1916761d72a5 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0x375c010249035b96 expref: 61 pid: 5755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869455.886660:0:5755:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94c818d1f600/0x3d2d1916761d72ba lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0x375c010249035b96 expref: 60 pid: 5755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869455.886667:0:5755:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff94c81a585c00) 00010000:00010000:0.0:1788869455.886669:0:5755:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788869455.886671:0:5755:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94c818d1f600, rc 0) 00000100:00100000:0.0:1788869455.886715:0:5755:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c702348a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2125b9b3-626e-4cbe-be83-fb446e976ce2+60:11546:x1875765413107072:12345-192.168.201.39@tcp:101:lfs.0 Request processed in 561us (665us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869455.886722:0:5755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 213 00000100:00100000:3.0:1788869455.888020:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1788869455.888062:0:5741:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765413107200 00000100:00100000:0.0:1788869455.888069:0:5741:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765413107200 00000100:00100000:0.0:1788869455.888105:0:5741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 13 00000100:00100000:0.0:1788869455.888112:0:5741:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c808ee7450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2125b9b3-626e-4cbe-be83-fb446e976ce2+60:2348:x1875765413107200:12345-192.168.201.39@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788869455.888121:0:5741:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788869455.888134:0:5741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94c818d1f600/0x3d2d1916761d72ba lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.39@tcp remote: 0x375c010249035b96 expref: 60 pid: 5755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869455.888143:0:5741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff94c81a585c00) 00010000:00010000:0.0:1788869455.888146:0:5741:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788869455.888173:0:5741:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c808ee7450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2125b9b3-626e-4cbe-be83-fb446e976ce2+59:2348:x1875765413107200:12345-192.168.201.39@tcp:103:ldlm_bl.0 Request processed in 61us (156us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869455.888180:0:5741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 13 00000100:00100000:3.0:1788869455.888411:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1788869455.888452:0:5757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765413107456 00000100:00100000:2.0:1788869455.888457:0:5757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765413107456 00000100:00100000:2.0:1788869455.888511:0:5757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 214 00000100:00100000:2.0:1788869455.888521:0:5757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c70234a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2125b9b3-626e-4cbe-be83-fb446e976ce2+59:11546:x1875765413107456:12345-192.168.201.39@tcp:101:lfs.0 00010000:00010000:2.0:1788869455.888536:0:5757:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788869455.888547:0:5757:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94c805038c00/0x3d2d1916761d72c1 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x375c010249035b9d expref: -99 pid: 5757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869455.888606:0:5757:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94c805039e00/0x3d2d1916761d72c8 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869455.888616:0:5757:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff94c83fde7400/0x3d2d1916761d7290 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0x375c010249035b88 expref: 60 pid: 5756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869455.888625:0:5757:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff94c805039e00/0x3d2d1916761d72c8 lrc: 4/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869455.888655:0:5757:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff94c83fde7400/0x3d2d1916761d7290 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.39@tcp remote: 0x375c010249035b88 expref: 60 pid: 5756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869455.888668:0:5757:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff94c83fde7400/0x3d2d1916761d7290 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.39@tcp remote: 0x375c010249035b88 expref: 60 pid: 5756 timeout: 304 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788869455.888680:0:5757:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94c83fae9880 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5757:1875765421472128:192.168.201.39@tcp:104: 00000100:00100000:2.0:1788869455.888813:0:5757:0:(client.c:2702:ptlrpc_set_wait()) set ffff94c810e32240 going to sleep for 11 seconds 00000100:00100000:2.0:1788869455.890596:0:5757:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94c83fae9880 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5757:1875765421472128:192.168.201.39@tcp:104: 00010000:00010000:2.0:1788869455.890613:0:5757:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff94c805039e00/0x3d2d1916761d72c8 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5757 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788869455.890822:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1788869455.890862:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765413107584 00000100:00100000:2.0:1788869455.890867:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765413107584 00010000:00010000:2.0:1788869455.890892:0:5788:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff94c83fde7400/0x3d2d1916761d7290 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.39@tcp remote: 0x375c010249035b88 expref: 61 pid: 5756 timeout: 304 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788869455.890927:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 84 00000100:00100000:2.0:1788869455.890937:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c702349500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2125b9b3-626e-4cbe-be83-fb446e976ce2+61:2347:x1875765413107584:12345-192.168.201.39@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788869455.890946:0:5788:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788869455.890950:0:5788:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff94c83fde7400/0x3d2d1916761d7290 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.39@tcp remote: 0x375c010249035b88 expref: 61 pid: 5756 timeout: 304 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869455.890960:0:5788:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff94c83fde7400/0x3d2d1916761d7290 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.39@tcp remote: 0x375c010249035b88 expref: 61 pid: 5756 timeout: 304 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869455.890973:0:5788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94c83fde7400/0x3d2d1916761d7290 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.39@tcp remote: 0x375c010249035b88 expref: 61 pid: 5756 timeout: 304 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869455.890981:0:5788:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff94c81a585c00) 00010000:00010000:2.0:1788869455.890984:0:5788:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff94c805039e00/0x3d2d1916761d72c8 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869455.890991:0:5788:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff94c805039e00/0x3d2d1916761d72c8 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869455.890996:0:5788:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94c805039e00/0x3d2d1916761d72c8 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869455.891017:0:5788:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788869455.891047:0:5757:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff94c805039e00/0x3d2d1916761d72c8 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869455.891053:0:5757:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94c805039e00/0x3d2d1916761d72c8 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5757 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788869455.891064:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c702349500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2125b9b3-626e-4cbe-be83-fb446e976ce2+60:2347:x1875765413107584:12345-192.168.201.39@tcp:103:ldlm_bl.0 Request processed in 127us (240us total) trans 0 rc 0/0 00000004:00200000:3.0:1788869455.891066:0:5757:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000100:00100000:2.0:1788869455.891072:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 84 00010000:00010000:3.0:1788869455.891219:0:5757:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94c805038c00/0x3d2d1916761d72c1 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0x375c010249035b9d expref: 61 pid: 5757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869455.891231:0:5757:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94c805039e00/0x3d2d1916761d72c8 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0x375c010249035b9d expref: 60 pid: 5757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869455.891236:0:5757:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff94c81a585c00) 00010000:00010000:3.0:1788869455.891238:0:5757:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1788869455.891240:0:5757:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94c805039e00, rc 0) 00000100:00100000:3.0:1788869455.891285:0:5757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c70234a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2125b9b3-626e-4cbe-be83-fb446e976ce2+60:11546:x1875765413107456:12345-192.168.201.39@tcp:101:lfs.0 Request processed in 2768us (2881us total) trans 4294967502 rc 0/0 00000100:00100000:3.0:1788869455.891290:0:5757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 214 00000100:00100000:3.0:1788869455.893280:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1788869455.893352:0:5739:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765413107840 00000100:00100000:1.0:1788869455.893361:0:5739:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765413107840 00000100:00100000:1.0:1788869455.893429:0:5739:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 14 00000100:00100000:1.0:1788869455.893443:0:5739:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c82cdc4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2125b9b3-626e-4cbe-be83-fb446e976ce2+60:11546:x1875765413107840:12345-192.168.201.39@tcp:103:lfs.0 00010000:00010000:1.0:1788869455.893455:0:5739:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788869455.893473:0:5739:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94c83fde6800/0x3d2d1916761d7227 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.39@tcp remote: 0x375c010249035b73 expref: 60 pid: 5756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869455.893488:0:5739:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff94c81a585c00) 00010000:00010000:1.0:1788869455.893501:0:5739:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788869455.893539:0:5739:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c82cdc4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2125b9b3-626e-4cbe-be83-fb446e976ce2+59:11546:x1875765413107840:12345-192.168.201.39@tcp:103:lfs.0 Request processed in 98us (262us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869455.893547:0:5739:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 14 00000100:00100000:1.0:1788869455.894326:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1788869455.894377:0:5756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765413107968 00000100:00100000:0.0:1788869455.894386:0:5756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765413107968 00000100:00100000:0.0:1788869455.894415:0:5756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 215 00000100:00100000:0.0:1788869455.894421:0:5756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c703414380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2125b9b3-626e-4cbe-be83-fb446e976ce2+59:11546:x1875765413107968:12345-192.168.201.39@tcp:58:lfs.0 00010000:00010000:0.0:1788869455.894519:0:5756:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94c818d1fa00/0x3d2d1916761d72d6 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869455.894530:0:5756:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94c818d1fa00/0x3d2d1916761d72d6 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869455.894537:0:5756:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94c818d1fa00/0x3d2d1916761d72d6 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788869455.894735:0:5756:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5, 136 off8872 00000100:00100000:0.0:1788869455.894793:0:5756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c703414380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2125b9b3-626e-4cbe-be83-fb446e976ce2+59:11546:x1875765413107968:12345-192.168.201.39@tcp:58:lfs.0 Request processed in 372us (469us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869455.894799:0:5756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 215 00000100:00100000:0.0:1788869455.895613:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1788869455.895654:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765413108096 00000100:00100000:1.0:1788869455.895659:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765413108096 00000100:00100000:1.0:1788869455.895689:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 216 00000100:00100000:1.0:1788869455.895695:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c808f53800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2125b9b3-626e-4cbe-be83-fb446e976ce2+59:11546:x1875765413108096:12345-192.168.201.39@tcp:101:lfs.0 00010000:00010000:1.0:1788869455.895716:0:5786:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788869455.895729:0:5786:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94c83fde6e00/0x3d2d1916761d72dd lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x375c010249035ba4 expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869455.895772:0:5786:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff94c818d1fa00/0x3d2d1916761d72d6 lrc: 2/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869455.895783:0:5786:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff94c83fde6e00/0x3d2d1916761d72dd lrc: 4/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.39@tcp remote: 0x375c010249035ba4 expref: 60 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869455.895800:0:5786:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff94c818d1fa00/0x3d2d1916761d72d6 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869455.895827:0:5786:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94c83fde6e00/0x3d2d1916761d72dd lrc: 3/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.39@tcp remote: 0x375c010249035ba4 expref: 60 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869455.895839:0:5786:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff94c81a585c00) 00010000:00010000:1.0:1788869455.895843:0:5786:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788869455.895846:0:5786:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff94c83fde6e00/0x3d2d1916761d72dd lrc: 3/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.39@tcp remote: 0x375c010249035ba4 expref: 60 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869455.895854:0:5786:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94c83fde6e00, rc 0) 00000100:00100000:1.0:1788869455.895887:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c808f53800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2125b9b3-626e-4cbe-be83-fb446e976ce2+60:11546:x1875765413108096:12345-192.168.201.39@tcp:101:lfs.0 Request processed in 191us (274us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869455.895892:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 216 00000040:00080000:2.0:1788869456.029192:0:11485:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788869456.029201:0:11485:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788869456.029239:0:11485:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 6 00000040:00080000:2.0:1788869456.029245:0:11485:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1788869456.029382:0:11485:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94c83fae9880 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11485:1875765421472256:192.168.201.39@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1788869456.029498:0:11485:0:(client.c:2702:ptlrpc_set_wait()) set ffff94c810e32b40 going to sleep for 11 seconds 00000100:00100000:2.0:1788869456.034786:0:11485:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94c83fae9880 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11485:1875765421472256:192.168.201.39@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1788869456.037500:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1788869456.037740:0:5755:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765413108224 00000100:00100000:2.0:1788869456.037749:0:5755:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765413108224 00000100:00100000:2.0:1788869456.037890:0:5755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 217 00000100:00100000:2.0:1788869456.037900:0:5755:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c810732680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2125b9b3-626e-4cbe-be83-fb446e976ce2+60:11547:x1875765413108224:12345-192.168.201.39@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1788869456.037959:0:5755:0:(mdt_handler.c:8041:mdt_fid2path()) path get [0x200000401:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1788869456.038107:0:5755:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c810732680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2125b9b3-626e-4cbe-be83-fb446e976ce2+60:11547:x1875765413108224:12345-192.168.201.39@tcp:53:lhsmtool_posix.0 Request processed in 202us (621us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869456.038114:0:5755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 217 00000100:00100000:0.0:1788869456.041244:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1788869456.041336:0:5757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765413108352 00000100:00100000:3.0:1788869456.041344:0:5757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765413108352 00000100:00100000:3.0:1788869456.041392:0:5757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 218 00000100:00100000:3.0:1788869456.041399:0:5757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c808f52300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2125b9b3-626e-4cbe-be83-fb446e976ce2+60:11547:x1875765413108352:12345-192.168.201.39@tcp:34:lhsmtool_posix.0 00010000:00010000:3.0:1788869456.041459:0:5757:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504c000/0x3d2d1916761d72e4 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869456.041474:0:5757:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504c000/0x3d2d1916761d72e4 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869456.041482:0:5757:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504c000/0x3d2d1916761d72e4 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869456.041504:0:5757:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504c200/0x3d2d1916761d72eb lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869456.041527:0:5757:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504c200/0x3d2d1916761d72eb lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869456.041535:0:5757:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504c200/0x3d2d1916761d72eb lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869456.041559:0:5757:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504ca00/0x3d2d1916761d72f2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869456.041568:0:5757:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504ca00/0x3d2d1916761d72f2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869456.041575:0:5757:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504ca00/0x3d2d1916761d72f2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5757 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788869456.041620:0:5757:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:3.0:1788869456.041625:0:5757:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1788869456.041641:0:5757:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504ca00/0x3d2d1916761d72f2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869456.041652:0:5757:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504c000/0x3d2d1916761d72e4 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869456.041658:0:5757:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504c000/0x3d2d1916761d72e4 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869456.041665:0:5757:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504c000/0x3d2d1916761d72e4 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869456.041672:0:5757:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94c83504c000 already unused, calling callback (ffffffffc21124f0) 00010000:00010000:3.0:1788869456.041676:0:5757:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504c000/0x3d2d1916761d72e4 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869456.041690:0:5757:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504c000/0x3d2d1916761d72e4 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869456.041702:0:5757:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff94c819394200) 00010000:00010000:3.0:1788869456.041704:0:5757:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788869456.041709:0:5757:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504c000/0x3d2d1916761d72e4 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869456.041715:0:5757:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504c000/0x3d2d1916761d72e4 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869456.041728:0:5757:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504c200/0x3d2d1916761d72eb lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869456.041733:0:5757:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504c200/0x3d2d1916761d72eb lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869456.041739:0:5757:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504c200/0x3d2d1916761d72eb lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869456.041744:0:5757:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94c83504c200 already unused, calling callback (ffffffffc21124f0) 00010000:00010000:3.0:1788869456.041747:0:5757:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504c200/0x3d2d1916761d72eb lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869456.041752:0:5757:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504c200/0x3d2d1916761d72eb lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869456.041759:0:5757:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0xafd4eada (ffff94c819394800) 00010000:00010000:3.0:1788869456.041761:0:5757:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788869456.041764:0:5757:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504c200/0x3d2d1916761d72eb lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869456.041779:0:5757:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504c200/0x3d2d1916761d72eb lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869456.041796:0:5757:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504ca00/0x3d2d1916761d72f2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869456.041803:0:5757:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504ca00/0x3d2d1916761d72f2 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869456.041809:0:5757:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504ca00/0x3d2d1916761d72f2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869456.041813:0:5757:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94c83504ca00 already unused, calling callback (ffffffffc21124f0) 00010000:00010000:3.0:1788869456.041816:0:5757:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504ca00/0x3d2d1916761d72f2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869456.041822:0:5757:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504ca00/0x3d2d1916761d72f2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869456.041830:0:5757:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff94c81a585c00) 00010000:00010000:3.0:1788869456.041833:0:5757:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788869456.041835:0:5757:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504ca00/0x3d2d1916761d72f2 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869456.041841:0:5757:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504ca00/0x3d2d1916761d72f2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5757 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788869456.041905:0:5757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c808f52300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2125b9b3-626e-4cbe-be83-fb446e976ce2+60:11547:x1875765413108352:12345-192.168.201.39@tcp:34:lhsmtool_posix.0 Request processed in 505us (667us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869456.041912:0:5757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 218 00000100:00100000:3.0:1788869456.044699:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1788869456.044820:0:5756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765413108608 00000100:00100000:0.0:1788869456.044829:0:5756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765413108608 00000100:00100000:0.0:1788869456.044890:0:5756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 219 00000100:00100000:0.0:1788869456.044900:0:5756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c810730a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2125b9b3-626e-4cbe-be83-fb446e976ce2+60:11547:x1875765413108608:12345-192.168.201.39@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788869456.044919:0:5756:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788869456.044938:0:5756:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94c818d1f600/0x3d2d1916761d72f9 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x375c010249035bab expref: -99 pid: 5756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869456.045297:0:5756:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94c818d1e600/0x3d2d1916761d7300 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869456.045312:0:5756:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94c818d1e600/0x3d2d1916761d7300 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869456.045336:0:5756:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94c818d1e600/0x3d2d1916761d7300 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788869456.045347:0:5756:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:0.0:1788869456.045421:0:5756:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94c818d1e600/0x3d2d1916761d7300 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869456.045426:0:5756:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94c818d1e600/0x3d2d1916761d7300 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869456.045430:0:5756:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94c818d1e600/0x3d2d1916761d7300 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869456.045433:0:5756:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94c818d1e600 already unused, calling callback (ffffffffc21124f0) 00010000:00010000:0.0:1788869456.045436:0:5756:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94c818d1e600/0x3d2d1916761d7300 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869456.045440:0:5756:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94c818d1e600/0x3d2d1916761d7300 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869456.045449:0:5756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff94c81a585c00) 00010000:00010000:0.0:1788869456.045451:0:5756:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1788869456.045454:0:5756:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94c818d1e600/0x3d2d1916761d7300 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869456.045458:0:5756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94c818d1e600/0x3d2d1916761d7300 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869456.045485:0:5756:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94c818d1f600/0x3d2d1916761d72f9 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0x375c010249035bab expref: 62 pid: 5756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869456.045517:0:5756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff94c819394200) 00010000:00010000:0.0:1788869456.045518:0:5756:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788869456.045522:0:5756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94c818d1f600/0x3d2d1916761d72f9 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.39@tcp remote: 0x375c010249035bab expref: 62 pid: 5756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869456.045529:0:5756:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94c818d1f600, rc 0) 00000100:00100000:0.0:1788869456.045580:0:5756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c810730a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2125b9b3-626e-4cbe-be83-fb446e976ce2+61:11547:x1875765413108608:12345-192.168.201.39@tcp:101:lhsmtool_posix.0 Request processed in 682us (889us total) trans 4294967503 rc 301/301 00000100:00100000:0.0:1788869456.045585:0:5756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 219 00000100:00100000:1.0:1788869456.049431:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1788869456.049472:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765413108736 00000100:00100000:0.0:1788869456.049483:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765413108736 00000100:00100000:0.0:1788869456.049598:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 220 00000100:00100000:0.0:1788869456.049619:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c703414000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2125b9b3-626e-4cbe-be83-fb446e976ce2+61:11547:x1875765413108736:12345-192.168.201.39@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1788869456.049656:0:5786:0:(mdt_handler.c:8041:mdt_fid2path()) path get [0x200000401:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1788869456.049770:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c703414000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2125b9b3-626e-4cbe-be83-fb446e976ce2+61:11547:x1875765413108736:12345-192.168.201.39@tcp:53:lhsmtool_posix.0 Request processed in 163us (344us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869456.049779:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 220 00000100:00100000:3.0:1788869456.053458:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1788869456.053608:0:5755:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765413108992 00000100:00100000:2.0:1788869456.053618:0:5755:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765413108992 00000100:00100000:2.0:1788869456.053849:0:5755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 221 00000100:00100000:2.0:1788869456.053867:0:5755:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c82c842a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2125b9b3-626e-4cbe-be83-fb446e976ce2+61:11547:x1875765413108992:12345-192.168.201.39@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788869456.053902:0:5755:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788869456.053905:0:5755:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1788869456.053938:0:5755:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94c805038400/0x3d2d1916761d729e lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.39@tcp remote: 0x375c010249035b8f expref: 61 pid: 5757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869456.053991:0:5755:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff94c802f3fd00) 00010000:00010000:2.0:1788869456.054004:0:5755:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788869456.055778:0:5755:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94c805039a00/0x3d2d1916761d730e lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x375c010249035bb2 expref: -99 pid: 5755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788869456.056546:0:5755:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x6:0x0], index 1: 0 00010000:00010000:2.0:1788869456.056928:0:5755:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94c805039200/0x3d2d1916761d7315 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869456.056949:0:5755:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94c805039200/0x3d2d1916761d7315 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869456.056965:0:5755:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94c805039200/0x3d2d1916761d7315 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869456.057120:0:5755:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94c805039a00/0x3d2d1916761d730e lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0x375c010249035bb2 expref: 63 pid: 5755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869456.057244:0:5755:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94c805039200/0x3d2d1916761d7315 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0x375c010249035bb2 expref: 62 pid: 5755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869456.057272:0:5755:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff94c802f3f300) 00010000:00010000:2.0:1788869456.057275:0:5755:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788869456.057278:0:5755:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94c805039200, rc 0) 00000100:00100000:2.0:1788869456.057398:0:5755:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c82c842a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2125b9b3-626e-4cbe-be83-fb446e976ce2+62:11547:x1875765413108992:12345-192.168.201.39@tcp:101:lhsmtool_posix.0 Request processed in 3539us (3948us total) trans 4294967504 rc 0/0 00000100:00100000:2.0:1788869456.057408:0:5755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 221 00000100:00100000:1.0:1788869456.059961:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1788869456.060107:0:5757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765413109248 00000100:00100000:3.0:1788869456.060117:0:5757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765413109248 00000100:00100000:3.0:1788869456.060234:0:5757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 222 00000100:00100000:3.0:1788869456.060245:0:5757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c703417480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2125b9b3-626e-4cbe-be83-fb446e976ce2+62:11547:x1875765413109248:12345-192.168.201.39@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1788869456.060329:0:5757:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788869456.060364:0:5757:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94c805039200/0x3d2d1916761d7315 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.39@tcp remote: 0x375c010249035bb2 expref: 62 pid: 5755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869456.060383:0:5757:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff94c802f3f300) 00010000:00010000:3.0:1788869456.060393:0:5757:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788869456.060413:0:5757:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504d800/0x3d2d1916761d7323 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869456.060427:0:5757:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504d800/0x3d2d1916761d7323 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869456.060435:0:5757:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504d800/0x3d2d1916761d7323 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869456.060448:0:5757:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504ca00/0x3d2d1916761d732a lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0xe0df55d3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869456.060455:0:5757:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504ca00/0x3d2d1916761d732a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0xe0df55d3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869456.060461:0:5757:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504ca00/0x3d2d1916761d732a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0xe0df55d3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869456.060539:0:5757:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504d800/0x3d2d1916761d7323 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869456.060558:0:5757:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504d800/0x3d2d1916761d7323 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869456.060564:0:5757:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504d800/0x3d2d1916761d7323 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869456.060571:0:5757:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94c83504d800 already unused, calling callback (ffffffffc21124f0) 00010000:00010000:3.0:1788869456.060575:0:5757:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504d800/0x3d2d1916761d7323 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869456.060583:0:5757:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504d800/0x3d2d1916761d7323 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869456.060591:0:5757:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff94c802f3fd00) 00010000:00010000:3.0:1788869456.060593:0:5757:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788869456.060597:0:5757:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504d800/0x3d2d1916761d7323 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869456.060603:0:5757:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504d800/0x3d2d1916761d7323 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869456.060613:0:5757:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504ca00/0x3d2d1916761d732a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0xe0df55d3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869456.060619:0:5757:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504ca00/0x3d2d1916761d732a lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xe0df55d3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869456.060625:0:5757:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504ca00/0x3d2d1916761d732a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xe0df55d3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869456.060629:0:5757:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94c83504ca00 already unused, calling callback (ffffffffc21124f0) 00010000:00010000:3.0:1788869456.060638:0:5757:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504ca00/0x3d2d1916761d732a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xe0df55d3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869456.060644:0:5757:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504ca00/0x3d2d1916761d732a lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xe0df55d3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869456.060652:0:5757:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0xe0df55d3 (ffff94c819394800) 00010000:00010000:3.0:1788869456.060655:0:5757:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788869456.060658:0:5757:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504ca00/0x3d2d1916761d732a lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0xe0df55d3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869456.060664:0:5757:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504ca00/0x3d2d1916761d732a lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0xe0df55d3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5757 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788869456.060740:0:5757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c703417480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2125b9b3-626e-4cbe-be83-fb446e976ce2+61:11547:x1875765413109248:12345-192.168.201.39@tcp:36:lhsmtool_posix.0 Request processed in 497us (786us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788869456.060747:0:5757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 222 00000100:00100000:1.0:1788869456.063706:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1788869456.063860:0:5756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765413109376 00000100:00100000:0.0:1788869456.063869:0:5756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765413109376 00000100:00100000:0.0:1788869456.063954:0:5756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 223 00000100:00100000:0.0:1788869456.063964:0:5756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c703415c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2125b9b3-626e-4cbe-be83-fb446e976ce2+61:11547:x1875765413109376:12345-192.168.201.39@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788869456.063983:0:5756:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788869456.064003:0:5756:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94c818d1f600/0x3d2d1916761d7331 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x375c010249035bb9 expref: -99 pid: 5756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869456.064059:0:5756:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94c818d1e600/0x3d2d1916761d7338 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869456.064072:0:5756:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94c818d1e600/0x3d2d1916761d7338 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869456.064083:0:5756:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94c818d1e600/0x3d2d1916761d7338 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869456.064188:0:5756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94c818d1f600/0x3d2d1916761d7331 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0x375c010249035bb9 expref: 63 pid: 5756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869456.064205:0:5756:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94c818d1e600/0x3d2d1916761d7338 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0x375c010249035bb9 expref: 62 pid: 5756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869456.064214:0:5756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff94c803990b00) 00010000:00010000:0.0:1788869456.064217:0:5756:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1788869456.064220:0:5756:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94c818d1e600, rc 0) 00000100:00100000:0.0:1788869456.064306:0:5756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c703415c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2125b9b3-626e-4cbe-be83-fb446e976ce2+62:11547:x1875765413109376:12345-192.168.201.39@tcp:101:lhsmtool_posix.0 Request processed in 343us (608us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869456.064313:0:5756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 223 00000100:00100000:1.0:1788869456.067979:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1788869456.068389:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765413109632 00000100:00100000:0.0:1788869456.068399:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765413109632 00000100:00100000:0.0:1788869456.068538:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 224 00000100:00100000:0.0:1788869456.068549:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c703416d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2125b9b3-626e-4cbe-be83-fb446e976ce2+62:11547:x1875765413109632:12345-192.168.201.39@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1788869456.068625:0:5786:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94c818d1fc00/0x3d2d1916761d733f lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869456.068662:0:5786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94c818d1fc00/0x3d2d1916761d733f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869456.068675:0:5786:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94c818d1fc00/0x3d2d1916761d733f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788869456.068912:0:5786:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].8, 88 off8800 00000004:00010000:0.0:1788869456.068996:0:5786:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000a8e8acbd reply state 000000005f495ffa transno 4294967505 ns: mdt-lustre-MDT0000_UUID lock: ffff94c818d1fc00/0x3d2d1916761d733f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788869456.069006:0:5786:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788869456.069094:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c703416d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2125b9b3-626e-4cbe-be83-fb446e976ce2+64:11547:x1875765413109632:12345-192.168.201.39@tcp:36:lhsmtool_posix.0 Request processed in 546us (1122us total) trans 4294967505 rc 0/0 00000100:00100000:0.0:1788869456.069102:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 224 00010000:00010000:2.0:1788869456.070773:0:3269:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94c818d1fc00/0x3d2d1916761d733f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869456.070795:0:3269:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94c818d1fc00/0x3d2d1916761d733f lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869456.070803:0:3269:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94c818d1fc00/0x3d2d1916761d733f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869456.070809:0:3269:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94c818d1fc00 already unused, calling callback (ffffffffc21124f0) 00010000:00010000:2.0:1788869456.070813:0:3269:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94c818d1fc00/0x3d2d1916761d733f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869456.070827:0:3269:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94c818d1fc00/0x3d2d1916761d733f lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869456.070843:0:3269:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff94c803990b00) 00010000:00010000:2.0:1788869456.070846:0:3269:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1788869456.070850:0:3269:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94c818d1fc00/0x3d2d1916761d733f lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869456.070858:0:3269:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94c818d1fc00/0x3d2d1916761d733f lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788869456.072019:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1788869456.072099:0:5755:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765413109760 00000100:00100000:2.0:1788869456.072108:0:5755:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765413109760 00000100:00100000:2.0:1788869456.072194:0:5755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 225 00000100:00100000:2.0:1788869456.072204:0:5755:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c703415500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2125b9b3-626e-4cbe-be83-fb446e976ce2+63:11547:x1875765413109760:12345-192.168.201.39@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788869456.072234:0:5755:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788869456.072292:0:5755:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94c805039a00/0x3d2d1916761d7346 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x375c010249035bc0 expref: -99 pid: 5755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869456.072374:0:5755:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94c805039a00/0x3d2d1916761d7346 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.39@tcp remote: 0x375c010249035bc0 expref: 64 pid: 5755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869456.072388:0:5755:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94c805039a00/0x3d2d1916761d7346 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.39@tcp remote: 0x375c010249035bc0 expref: 64 pid: 5755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869456.072409:0:5755:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff94c803990b00) 00010000:00010000:2.0:1788869456.072412:0:5755:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788869456.072414:0:5755:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94c805039a00, rc 0) 00000100:00100000:2.0:1788869456.072463:0:5755:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c703415500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2125b9b3-626e-4cbe-be83-fb446e976ce2+64:11547:x1875765413109760:12345-192.168.201.39@tcp:101:lhsmtool_posix.0 Request processed in 260us (451us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869456.072470:0:5755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 225 00000100:00100000:1.0:1788869456.080828:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1788869456.080888:0:6547:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765413109888 00000100:00100000:0.0:1788869456.080907:0:6547:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765413109888 00000100:00100000:0.0:1788869456.080968:0:6547:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 62 00000100:00100000:0.0:1788869456.080978:0:6547:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c703417100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2125b9b3-626e-4cbe-be83-fb446e976ce2+9:2347:x1875765413109888:12345-192.168.201.39@tcp:2:lhsmtool_posix.0 00000100:00100000:0.0:1788869456.081283:0:6547:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c703417100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2125b9b3-626e-4cbe-be83-fb446e976ce2+10:2347:x1875765413109888:12345-192.168.201.39@tcp:2:lhsmtool_posix.0 Request processed in 301us (456us total) trans 4294967319 rc 0/0 00000100:00100000:0.0:1788869456.081293:0:6547:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 62 00000100:00100000:1.0:1788869456.082963:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1788869456.083017:0:11820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765413110144 00000100:00100000:2.0:1788869456.083025:0:11820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765413110144 00000100:00100000:2.0:1788869456.083065:0:11820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 60 00000100:00100000:2.0:1788869456.083072:0:11820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c703414700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:2125b9b3-626e-4cbe-be83-fb446e976ce2+64:11547:x1875765413110144:12345-192.168.201.39@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1788869456.083305:0:11820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c703414700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:2125b9b3-626e-4cbe-be83-fb446e976ce2+65:11547:x1875765413110144:12345-192.168.201.39@tcp:35:lhsmtool_posix.0 Request processed in 232us (347us total) trans 4294967506 rc 0/0 00000100:00100000:2.0:1788869456.083310:0:11820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 60 00000100:00100000:1.0:1788869456.086185:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1788869456.086297:0:5757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765413110400 00000100:00100000:2.0:1788869456.086305:0:5757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765413110400 00000100:00100000:2.0:1788869456.086341:0:5757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 226 00000100:00100000:2.0:1788869456.086348:0:5757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c703415180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2125b9b3-626e-4cbe-be83-fb446e976ce2+65:11547:x1875765413110400:12345-192.168.201.39@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1788869456.086444:0:5757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c703415180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2125b9b3-626e-4cbe-be83-fb446e976ce2+65:11547:x1875765413110400:12345-192.168.201.39@tcp:57:lhsmtool_posix.0 Request processed in 96us (268us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869456.086460:0:5757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 226 00000100:00100000:1.0:1788869456.088977:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1788869456.089060:0:5755:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765413110528 00000100:00100000:2.0:1788869456.089069:0:5755:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765413110528 00000100:00100000:2.0:1788869456.089123:0:5755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 227 00000100:00100000:2.0:1788869456.089133:0:5755:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c703417b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2125b9b3-626e-4cbe-be83-fb446e976ce2+65:11547:x1875765413110528:12345-192.168.201.39@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788869456.089151:0:5755:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788869456.089172:0:5755:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94c805038400/0x3d2d1916761d734d lrc: 2/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x375c010249035bc7 expref: -99 pid: 5755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869456.089241:0:5755:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94c805039800/0x3d2d1916761d7354 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869456.089286:0:5755:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94c805039800/0x3d2d1916761d7354 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869456.089299:0:5755:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94c805039800/0x3d2d1916761d7354 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788869456.089347:0:5755:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1788869456.089367:0:5755:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff94c805039800/0x3d2d1916761d7354 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869456.089392:0:5755:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94c805038400/0x3d2d1916761d734d lrc: 0/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0x375c010249035bc7 expref: 67 pid: 5755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869456.089410:0:5755:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94c805039800/0x3d2d1916761d7354 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0x375c010249035bc7 expref: 66 pid: 5755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869456.089418:0:5755:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff94c803990b00) 00010000:00010000:2.0:1788869456.089444:0:5755:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1788869456.089449:0:5755:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94c805039800, rc 0) 00000100:00100000:2.0:1788869456.089501:0:5755:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c703417b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2125b9b3-626e-4cbe-be83-fb446e976ce2+66:11547:x1875765413110528:12345-192.168.201.39@tcp:101:lhsmtool_posix.0 Request processed in 370us (532us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869456.089508:0:5755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 227 00000100:00100000:1.0:1788869456.096639:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1788869456.096734:0:7884:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765413110656 00000100:00100000:2.0:1788869456.096745:0:7884:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765413110656 00000100:00100000:2.0:1788869456.096808:0:7884:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 63 00000100:00100000:2.0:1788869456.096820:0:7884:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c703414a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:2125b9b3-626e-4cbe-be83-fb446e976ce2+10:2348:x1875765413110656:12345-192.168.201.39@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788869456.096840:0:7884:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788869456.096858:0:7884:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e2b6a638/0x3d2d1916761d735b lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x375c010249035bce expref: -99 pid: 7884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788869456.096885:0:7884:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a9ffb4e, blocks: 0x1 00010000:00010000:2.0:1788869456.096903:0:7884:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=204s v=(0 0) 00010000:00010000:2.0:1788869456.096907:0:7884:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788869456.096917:0:7884:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e2b6a638/0x3d2d1916761d735b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.39@tcp remote: 0x375c010249035bce expref: 11 pid: 7884 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869456.096935:0:7884:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000e2b6a638/0x3d2d1916761d735b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.39@tcp remote: 0x375c010249035bce expref: 11 pid: 7884 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869456.096949:0:7884:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94c805038400, rc 0) 00000100:00100000:2.0:1788869456.097002:0:7884:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c703414a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:2125b9b3-626e-4cbe-be83-fb446e976ce2+11:2348:x1875765413110656:12345-192.168.201.39@tcp:101:lhsmtool_posix.0 Request processed in 184us (371us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869456.097010:0:7884:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 63 00000100:00100000:1.0:1788869456.101432:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1788869456.101506:0:5757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765413110912 00000100:00100000:2.0:1788869456.101514:0:5757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765413110912 00000100:00100000:2.0:1788869456.101564:0:5757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 228 00000100:00100000:2.0:1788869456.101574:0:5757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c703414e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2125b9b3-626e-4cbe-be83-fb446e976ce2+66:11547:x1875765413110912:12345-192.168.201.39@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1788869456.101673:0:5757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c703414e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2125b9b3-626e-4cbe-be83-fb446e976ce2+66:11547:x1875765413110912:12345-192.168.201.39@tcp:57:lhsmtool_posix.0 Request processed in 100us (288us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869456.101681:0:5757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 228 00000100:00100000:1.0:1788869456.103363:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1788869456.103526:0:11822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765413111040 00000100:00100000:0.0:1788869456.103535:0:11822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765413111040 00000100:00100000:0.0:1788869456.103584:0:11822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 64 00000100:00100000:0.0:1788869456.103594:0:11822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c702217480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:2125b9b3-626e-4cbe-be83-fb446e976ce2+11:11547:x1875765413111040:12345-192.168.201.39@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788869456.103608:0:11822:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788869456.103625:0:11822:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000081575a94/0x3d2d1916761d7362 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x375c010249035bd5 expref: -99 pid: 11822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869456.103658:0:11822:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000e2b6a638/0x3d2d1916761d735b lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.39@tcp remote: 0x375c010249035bce expref: 12 pid: 7884 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869456.103667:0:11822:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788869456.103672:0:11822:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788869456.103677:0:11822:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000081575a94/0x3d2d1916761d7362 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.201.39@tcp remote: 0x375c010249035bd5 expref: 12 pid: 11822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869456.103708:0:11822:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000e2b6a638/0x3d2d1916761d735b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.39@tcp remote: 0x375c010249035bce expref: 12 pid: 7884 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869456.103721:0:11822:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000e2b6a638/0x3d2d1916761d735b lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.39@tcp remote: 0x375c010249035bce expref: 12 pid: 7884 timeout: 304 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788869456.103736:0:11822:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94c808f51880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:11822:1875765421472384:192.168.201.39@tcp:104: 00000100:00100000:0.0:1788869456.103848:0:11822:0:(client.c:2702:ptlrpc_set_wait()) set ffff94c81075ab40 going to sleep for 11 seconds 00000100:00100000:0.0:1788869456.105742:0:11822:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94c808f51880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:11822:1875765421472384:192.168.201.39@tcp:104: 00010000:00010000:0.0:1788869456.105765:0:11822:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000081575a94/0x3d2d1916761d7362 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.39@tcp remote: 0x375c010249035bd5 expref: 12 pid: 11822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869456.105782:0:11822:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94c818d1f600, rc 0) 00000100:00100000:0.0:1788869456.105836:0:11822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c702217480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:2125b9b3-626e-4cbe-be83-fb446e976ce2+12:11547:x1875765413111040:12345-192.168.201.39@tcp:101:lhsmtool_posix.0 Request processed in 2243us (2477us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869456.105845:0:11822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 64 00000100:00100000:1.0:1788869456.106157:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1788869456.106196:0:5741:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765413111168 00000100:00100000:0.0:1788869456.106202:0:5741:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765413111168 00010000:00010000:0.0:1788869456.106224:0:5741:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000e2b6a638/0x3d2d1916761d735b lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.39@tcp remote: 0x375c010249035bce expref: 12 pid: 7884 timeout: 304 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788869456.106276:0:5741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 85 00000100:00100000:0.0:1788869456.106285:0:5741:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c702215c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2125b9b3-626e-4cbe-be83-fb446e976ce2+12:2348:x1875765413111168:12345-192.168.201.39@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788869456.106297:0:5741:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788869456.106317:0:5741:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000e2b6a638/0x3d2d1916761d735b lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.39@tcp remote: 0x375c010249035bce expref: 12 pid: 7884 timeout: 304 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869456.106339:0:5741:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000e2b6a638/0x3d2d1916761d735b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.39@tcp remote: 0x375c010249035bce expref: 12 pid: 7884 timeout: 304 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869456.106359:0:5741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e2b6a638/0x3d2d1916761d735b lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.39@tcp remote: 0x375c010249035bce expref: 12 pid: 7884 timeout: 304 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869456.106373:0:5741:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788869456.106377:0:5741:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788869456.106385:0:5741:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000081575a94/0x3d2d1916761d7362 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.39@tcp remote: 0x375c010249035bd5 expref: 11 pid: 11822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869456.106403:0:5741:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000081575a94/0x3d2d1916761d7362 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.39@tcp remote: 0x375c010249035bd5 expref: 11 pid: 11822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869456.106432:0:5741:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 0000000081575a94/0x3d2d1916761d7362 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.39@tcp remote: 0x375c010249035bd5 expref: 11 pid: 11822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788869456.106453:0:5741:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94c808f51880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5741:1875765421472512:192.168.201.39@tcp:105: 00000100:00100000:0.0:1788869456.106518:0:5741:0:(client.c:2702:ptlrpc_set_wait()) set ffff94c81075ab40 going to sleep for 11 seconds 00000100:00100000:0.0:1788869456.109802:0:5741:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94c808f51880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5741:1875765421472512:192.168.201.39@tcp:105: 00010000:00010000:0.0:1788869456.109840:0:5741:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788869456.109899:0:5741:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c702215c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2125b9b3-626e-4cbe-be83-fb446e976ce2+11:2348:x1875765413111168:12345-192.168.201.39@tcp:103:ldlm_bl.0 Request processed in 3615us (3740us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869456.109910:0:5741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 85 00000100:00100000:1.0:1788869456.110522:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1788869456.110625:0:11821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765413111296 00000100:00100000:2.0:1788869456.110632:0:11821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765413111296 00002000:00100000:2.0:1788869456.110672:0:11821:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x6:0x0] (0->12) req@ffff94c702216d80 x1875765413111296/t0(0) o4->2125b9b3-626e-4cbe-be83-fb446e976ce2@192.168.201.39@tcp:402/0 lens 504/0 e 0 to 0 dl 1788869467 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788869456.110683:0:11821:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff94c702216d80 with x1875765413111296 ext(0->12) 00002000:00010000:2.0:1788869456.110688:0:11821:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff94c702216d80 00000100:00100000:2.0:1788869456.110755:0:11821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 6 00000100:00100000:2.0:1788869456.110765:0:11821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c702216d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:2125b9b3-626e-4cbe-be83-fb446e976ce2+11:2348:x1875765413111296:12345-192.168.201.39@tcp:4:lhsmtool_posix.0 00000100:00100000:2.0:1788869456.111179:0:11821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c702216d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:2125b9b3-626e-4cbe-be83-fb446e976ce2+13:2348:x1875765413111296:12345-192.168.201.39@tcp:4:lhsmtool_posix.0 Request processed in 415us (658us total) trans 4294967320 rc 0/0 00000100:00100000:2.0:1788869456.111187:0:11821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 6 00002000:00100000:2.0:1788869456.111192:0:11821:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x6:0x0] (0->12) req@ffff94c702216d80 x1875765413111296/t4294967320(0) o4->2125b9b3-626e-4cbe-be83-fb446e976ce2@192.168.201.39@tcp:402/0 lens 504/448 e 0 to 0 dl 1788869467 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788869456.111199:0:11821:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff94c702216d80 with x1875765413111296 ext(0->12) 00002000:00010000:2.0:1788869456.111202:0:11821:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff94c702216d80 00000100:00100000:1.0:1788869456.114497:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1788869456.114589:0:5755:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765413111424 00000100:00100000:2.0:1788869456.114599:0:5755:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765413111424 00000100:00100000:2.0:1788869456.114654:0:5755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 229 00000100:00100000:2.0:1788869456.114673:0:5755:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c702215500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2125b9b3-626e-4cbe-be83-fb446e976ce2+66:11547:x1875765413111424:12345-192.168.201.39@tcp:44:lhsmtool_posix.0 00000001:00080000:1.0:1788869456.132516:0:5777:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967505 is committed 00000020:00080000:1.0:1788869456.132571:0:5777:0:(update_trans.c:58:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff94c818e67540 refcount 2 committed 0 result 0 batchid 6 00000020:00080000:1.0:1788869456.132575:0:5777:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff94c8105bee00 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff94c818e67b40 00000020:00080000:1.0:1788869456.132578:0:5777:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff94c8105be700 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff94c82ce9ac00 00000020:00080000:1.0:1788869456.132594:0:5777:0:(update_trans.c:1348:distribute_txn_batchid_cb()) lustre-MDT0000: 5 batchid updated 00000001:00080000:1.0:1788869456.132599:0:5777:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967506 is committed 00000004:00080000:1.0:1788869456.132622:0:5777:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 5 committed 00000020:00080000:1.0:1788869456.132646:0:5777:0:(update_trans.c:58:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff94c805068480 refcount 2 committed 0 result 0 batchid 7 00000020:00080000:1.0:1788869456.132648:0:5777:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff94c820719c00 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff94c805068300 00000020:00080000:1.0:1788869456.132650:0:5777:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff94c820719300 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff94c8354ecc00 00000004:00080000:1.0:1788869456.132679:0:5777:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 7 committed 00000020:00080000:1.0:1788869456.132711:0:5791:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 7 committed batchid 5 00000100:00100000:0.0:1788869456.132818:0:3284:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94c808f51880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3284:1875765421472640:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1788869456.132884:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00080000:1.0:1788869456.132892:0:5791:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000100:00100000:0.0:1788869456.132940:0:6547:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765421472640 00000100:00100000:0.0:1788869456.132945:0:6547:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765421472640 00000100:00100000:1.0:1788869456.132951:0:3285:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94c702217100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3285:1875765421472768:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1788869456.132980:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869456.132990:0:6547:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765421472768 00000100:00100000:0.0:1788869456.132994:0:6547:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765421472768 00000100:00100000:1.0:1788869456.133169:0:7884:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1788869456.133180:0:7884:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c808f50a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3284:x1875765421472640:12345-0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1788869456.133200:0:5755:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c702215500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2125b9b3-626e-4cbe-be83-fb446e976ce2+20:11547:x1875765413111424:12345-192.168.201.39@tcp:44:lhsmtool_posix.0 Request processed in 18525us (18729us total) trans 0 rc 0/0 00002000:00080000:1.0:1788869456.133205:0:7884:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:5 count 1 00000100:00100000:2.0:1788869456.133210:0:5755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 229 00010000:00010000:1.0:1788869456.133226:0:7884:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000aadcd0a/0x3d2d1916761d7369 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 7884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788869456.133234:0:6546:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1788869456.133244:0:6546:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c702214700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+8:3285:x1875765421472768:12345-0@lo:6:osp-syn-0-0.0 00010000:00010000:1.0:1788869456.133268:0:7884:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000546e452a/0x3d2d1916761d7124 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.39@tcp remote: 0x375c010249035b2d expref: 12 pid: 11822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00080000:2.0:1788869456.133276:0:6546:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:5 count 1 00010000:00010000:1.0:1788869456.133277:0:7884:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x5:0x0].0x0 since=1s v=(0 0) 00010000:00010000:1.0:1788869456.133295:0:7884:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00002000:00010000:2.0:1788869456.133300:0:6546:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 9, mtime: 0x6a9ffb4e, atime: 0x6a9ffb4e, ctime: 0x6a9ffb4e, blocks: 0x1 00010000:00010000:1.0:1788869456.133300:0:7884:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000aadcd0a/0x3d2d1916761d7369 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 7884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869456.133311:0:6546:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000052cb237f/0x3d2d1916761d7370 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6546 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869456.133323:0:6546:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=204s v=(0 0) 00010000:00010000:1.0:1788869456.133334:0:7884:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000546e452a/0x3d2d1916761d7124 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.39@tcp remote: 0x375c010249035b2d expref: 12 pid: 11822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869456.133338:0:6546:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788869456.133348:0:6546:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000052cb237f/0x3d2d1916761d7370 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6546 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869456.133351:0:7884:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000546e452a/0x3d2d1916761d7124 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.39@tcp remote: 0x375c010249035b2d expref: 12 pid: 11822 timeout: 304 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869456.133366:0:6546:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000052cb237f/0x3d2d1916761d7370 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6546 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788869456.133366:0:7884:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94c702215180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:7884:1875765421472896:192.168.201.39@tcp:104: 00010000:00010000:2.0:1788869456.133379:0:6546:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000052cb237f/0x3d2d1916761d7370 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6546 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869456.133384:0:6546:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000052cb237f/0x3d2d1916761d7370 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6546 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869456.133398:0:6546:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1788869456.133406:0:7884:0:(client.c:2702:ptlrpc_set_wait()) set ffff94c818e67900 going to sleep for 11 seconds 00000100:00080000:0.0:1788869456.133670:0:5751:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788869456.133826:0:6546:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c702214700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+9:3285:x1875765421472768:12345-0@lo:6:osp-syn-0-0.0 Request processed in 582us (844us total) trans 4294967310 rc 0/0 00000100:00100000:2.0:1788869456.133833:0:6546:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00010000:00010000:2.0:1788869456.133853:0:5742:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788869456.133859:0:5742:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000052cb237f/0x3d2d1916761d7370 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6546 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869456.133866:0:5742:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94c805038600 already unused, calling callback (ffffffffc1703220) 00010000:00010000:2.0:1788869456.133870:0:5742:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000052cb237f/0x3d2d1916761d7370 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6546 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1788869456.133875:0:3285:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94c702217100/2, rc 0, transno 4294967310 00010000:00010000:2.0:1788869456.133879:0:5742:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000052cb237f/0x3d2d1916761d7370 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6546 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788869456.133880:0:3285:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94c702217100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3285:1875765421472768:0@lo:6:osp-syn-0-0.0 00010000:00010000:2.0:1788869456.133894:0:5742:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000052cb237f/0x3d2d1916761d7370 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6546 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869456.133901:0:5742:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000052cb237f/0x3d2d1916761d7370 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6546 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869456.133918:0:5742:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788869456.133920:0:5742:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788869456.133922:0:5742:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788869456.137167:0:7884:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94c702215180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:7884:1875765421472896:192.168.201.39@tcp:104: 00010000:00010000:1.0:1788869456.137191:0:7884:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000000aadcd0a/0x3d2d1916761d7369 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 7884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788869456.138026:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1788869456.138197:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765413111680 00000100:00100000:2.0:1788869456.138207:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765413111680 00010000:00010000:2.0:1788869456.138247:0:5788:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000546e452a/0x3d2d1916761d7124 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.39@tcp remote: 0x375c010249035b2d expref: 13 pid: 11822 timeout: 304 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788869456.138343:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 86 00000100:00100000:2.0:1788869456.138353:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c702215180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2125b9b3-626e-4cbe-be83-fb446e976ce2+13:2347:x1875765413111680:12345-192.168.201.39@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788869456.138366:0:5788:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788869456.138371:0:5788:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000546e452a/0x3d2d1916761d7124 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.39@tcp remote: 0x375c010249035b2d expref: 13 pid: 11822 timeout: 304 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869456.138382:0:5788:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000546e452a/0x3d2d1916761d7124 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.39@tcp remote: 0x375c010249035b2d expref: 13 pid: 11822 timeout: 304 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869456.138403:0:5788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000546e452a/0x3d2d1916761d7124 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.39@tcp remote: 0x375c010249035b2d expref: 13 pid: 11822 timeout: 304 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869456.138419:0:5788:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788869456.138424:0:5788:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788869456.138429:0:5788:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000000aadcd0a/0x3d2d1916761d7369 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 7884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869456.138438:0:5788:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000aadcd0a/0x3d2d1916761d7369 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 7884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869456.138464:0:5788:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788869456.138522:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c702215180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2125b9b3-626e-4cbe-be83-fb446e976ce2+12:2347:x1875765413111680:12345-192.168.201.39@tcp:103:ldlm_bl.0 Request processed in 170us (498us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869456.138529:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 86 00010000:00010000:3.0:1788869456.138868:0:7884:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000000aadcd0a/0x3d2d1916761d7369 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 7884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869456.138878:0:7884:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000aadcd0a/0x3d2d1916761d7369 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 7884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869456.138888:0:7884:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000aadcd0a/0x3d2d1916761d7369 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 7884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869456.138897:0:7884:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000aadcd0a/0x3d2d1916761d7369 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 7884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869456.138928:0:7884:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1788869456.139460:0:7884:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c808f50a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3284:x1875765421472640:12345-0@lo:6:osp-syn-1-0.0 Request processed in 6282us (6576us total) trans 4294967321 rc 0/0 00000100:00100000:3.0:1788869456.139470:0:7884:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00010000:00010000:0.0:1788869456.139641:0:7447:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788869456.139648:0:7447:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000aadcd0a/0x3d2d1916761d7369 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 7884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869456.139657:0:7447:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94c83fde6800 already unused, calling callback (ffffffffc1703220) 00010000:00010000:0.0:1788869456.139661:0:7447:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000aadcd0a/0x3d2d1916761d7369 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 7884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869456.139669:0:7447:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000aadcd0a/0x3d2d1916761d7369 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 7884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788869456.139685:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00010000:00010000:0.0:1788869456.139687:0:7447:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000aadcd0a/0x3d2d1916761d7369 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 7884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869456.139693:0:7447:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000aadcd0a/0x3d2d1916761d7369 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 7884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869456.139710:0:7447:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788869456.139711:0:7447:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788869456.139713:0:7447:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788869456.139747:0:11822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765413111552 00000100:00100000:2.0:1788869456.139753:0:11822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765413111552 00000100:00100000:2.0:1788869456.139784:0:11822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 67 00000100:00100000:2.0:1788869456.139790:0:11822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c82c840000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:2125b9b3-626e-4cbe-be83-fb446e976ce2+12:2347:x1875765413111552:12345-192.168.201.39@tcp:16:lhsmtool_posix.0 00000004:00080000:1.0:1788869456.139958:0:3284:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94c808f51880/2, rc 0, transno 4294967321 00000100:00100000:1.0:1788869456.139978:0:3284:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94c808f51880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3284:1875765421472640:0@lo:6:osp-syn-1-0.0 00000001:00080000:1.0:1788869456.188284:0:7458:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967319 is committed 00000001:00080000:1.0:1788869456.188307:0:7458:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967320 is committed 00000001:00080000:1.0:1788869456.188320:0:7458:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967321 is committed 00000100:00100000:2.0:1788869456.188466:0:11822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c82c840000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:2125b9b3-626e-4cbe-be83-fb446e976ce2+7:2347:x1875765413111552:12345-192.168.201.39@tcp:16:lhsmtool_posix.0 Request processed in 48669us (48777us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869456.188479:0:11822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 67 00000100:00100000:2.0:1788869456.194446:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1788869456.194815:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765413111936 00000100:00100000:0.0:1788869456.194826:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765413111936 00000100:00100000:0.0:1788869456.194893:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 230 00000100:00100000:0.0:1788869456.194903:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c83fae9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2125b9b3-626e-4cbe-be83-fb446e976ce2+20:11547:x1875765413111936:12345-192.168.201.39@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1788869456.194955:0:5786:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788869456.194982:0:5786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94c805039800/0x3d2d1916761d7354 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.39@tcp remote: 0x375c010249035bc7 expref: 20 pid: 5755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869456.195001:0:5786:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff94c803990b00) 00010000:00010000:0.0:1788869456.195006:0:5786:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788869456.195031:0:5786:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94c818d1e200/0x3d2d1916761d7377 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869456.195045:0:5786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94c818d1e200/0x3d2d1916761d7377 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869456.195053:0:5786:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94c818d1e200/0x3d2d1916761d7377 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788869456.195292:0:5786:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000aa3b24d9 reply state 00000000831cd74d transno 4294967507 ns: mdt-lustre-MDT0000_UUID lock: ffff94c818d1e200/0x3d2d1916761d7377 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788869456.195302:0:5786:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788869456.195710:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c83fae9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2125b9b3-626e-4cbe-be83-fb446e976ce2+21:11547:x1875765413111936:12345-192.168.201.39@tcp:36:lhsmtool_posix.0 Request processed in 808us (1273us total) trans 4294967507 rc 0/0 00000100:00100000:0.0:1788869456.195716:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 230 00010000:00010000:2.0:1788869456.199555:0:3270:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94c818d1e200/0x3d2d1916761d7377 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869456.199573:0:3270:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94c818d1e200/0x3d2d1916761d7377 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869456.199582:0:3270:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94c818d1e200/0x3d2d1916761d7377 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869456.199589:0:3270:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94c818d1e200 already unused, calling callback (ffffffffc21124f0) 00010000:00010000:2.0:1788869456.199595:0:3270:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94c818d1e200/0x3d2d1916761d7377 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869456.199603:0:3270:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94c818d1e200/0x3d2d1916761d7377 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869456.199621:0:3270:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff94c803990b00) 00010000:00010000:2.0:1788869456.199624:0:3270:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788869456.199629:0:3270:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94c818d1e200/0x3d2d1916761d7377 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869456.199636:0:3270:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94c818d1e200/0x3d2d1916761d7377 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788869456.200292:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1788869456.200420:0:6547:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765413112064 00000100:00100000:0.0:1788869456.200430:0:6547:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765413112064 00000100:00100000:0.0:1788869456.200502:0:6547:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 68 00000100:00100000:0.0:1788869456.200512:0:6547:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c83fae8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2125b9b3-626e-4cbe-be83-fb446e976ce2+7:2348:x1875765413112064:12345-192.168.201.39@tcp:2:lhsmtool_posix.0 00002000:00010000:0.0:1788869456.200744:0:6547:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:0.0:1788869456.200748:0:6547:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb mtime from disk: 0 -> 1788869454 00002000:00010000:0.0:1788869456.200750:0:6547:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb atime from disk: 0 -> 1788869454 00002000:00010000:0.0:1788869456.200752:0:6547:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb ctime from disk: 1788869454 -> 1788869454 00002000:00010000:0.0:1788869456.200755:0:6547:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:0.0:1788869456.200811:0:6547:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c83fae8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2125b9b3-626e-4cbe-be83-fb446e976ce2+8:2348:x1875765413112064:12345-192.168.201.39@tcp:2:lhsmtool_posix.0 Request processed in 301us (563us total) trans 4294967322 rc 0/0 00000100:00100000:0.0:1788869456.200820:0:6547:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 68 00000100:00100000:1.0:1788869456.202940:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1788869456.203054:0:5756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765413112320 00000100:00100000:0.0:1788869456.203064:0:5756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765413112320 00000100:00100000:0.0:1788869456.203151:0:5756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 231 00000100:00100000:0.0:1788869456.203162:0:5756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c702214e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2125b9b3-626e-4cbe-be83-fb446e976ce2+20:11547:x1875765413112320:12345-192.168.201.39@tcp:55:lhsmtool_posix.0 00010000:00010000:0.0:1788869456.203222:0:5756:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94c818d1ec00/0x3d2d1916761d737e lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869456.203380:0:5756:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff94c818d1e600/0x3d2d1916761d7338 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0x375c010249035bb9 expref: 20 pid: 5756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869456.203390:0:5756:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff94c818d1ec00/0x3d2d1916761d737e lrc: 4/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869456.203424:0:5756:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff94c818d1e600/0x3d2d1916761d7338 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.39@tcp remote: 0x375c010249035bb9 expref: 20 pid: 5756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869456.203436:0:5756:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff94c818d1e600/0x3d2d1916761d7338 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.39@tcp remote: 0x375c010249035bb9 expref: 20 pid: 5756 timeout: 304 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788869456.203451:0:5756:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94c808f51c00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5756:1875765421473024:192.168.201.39@tcp:104: 00000100:00100000:0.0:1788869456.203541:0:5756:0:(client.c:2702:ptlrpc_set_wait()) set ffff94c81075ab40 going to sleep for 11 seconds 00000100:00100000:0.0:1788869456.205470:0:5756:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94c808f51c00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5756:1875765421473024:192.168.201.39@tcp:104: 00010000:00010000:0.0:1788869456.205504:0:5756:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff94c818d1ec00/0x3d2d1916761d737e lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788869456.206029:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1788869456.206098:0:5739:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765413112448 00000100:00100000:2.0:1788869456.206106:0:5739:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765413112448 00010000:00010000:2.0:1788869456.206141:0:5739:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff94c818d1e600/0x3d2d1916761d7338 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.39@tcp remote: 0x375c010249035bb9 expref: 21 pid: 5756 timeout: 304 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788869456.206179:0:5739:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 87 00000100:00100000:2.0:1788869456.206189:0:5739:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c702215f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2125b9b3-626e-4cbe-be83-fb446e976ce2+21:2348:x1875765413112448:12345-192.168.201.39@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788869456.206202:0:5739:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788869456.206209:0:5739:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff94c818d1e600/0x3d2d1916761d7338 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.39@tcp remote: 0x375c010249035bb9 expref: 21 pid: 5756 timeout: 304 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869456.206222:0:5739:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff94c818d1e600/0x3d2d1916761d7338 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.39@tcp remote: 0x375c010249035bb9 expref: 21 pid: 5756 timeout: 304 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869456.206244:0:5739:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94c818d1e600/0x3d2d1916761d7338 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.39@tcp remote: 0x375c010249035bb9 expref: 21 pid: 5756 timeout: 304 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869456.206296:0:5739:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff94c803990b00) 00010000:00010000:2.0:1788869456.206301:0:5739:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff94c818d1ec00/0x3d2d1916761d737e lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869456.206311:0:5739:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff94c818d1ec00/0x3d2d1916761d737e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869456.206318:0:5739:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94c818d1ec00/0x3d2d1916761d737e lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869456.206355:0:5739:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788869456.206400:0:5739:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c702215f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2125b9b3-626e-4cbe-be83-fb446e976ce2+20:2348:x1875765413112448:12345-192.168.201.39@tcp:103:ldlm_bl.0 Request processed in 213us (372us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869456.206408:0:5739:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 87 00010000:00010000:0.0:1788869456.206578:0:5756:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff94c818d1ec00/0x3d2d1916761d737e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869456.206587:0:5756:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94c818d1ec00/0x3d2d1916761d737e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869456.206615:0:5756:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94c818d1ec00/0x3d2d1916761d737e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869456.206622:0:5756:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94c818d1ec00/0x3d2d1916761d737e lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869456.206636:0:5756:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94c818d1ec00/0x3d2d1916761d737e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869456.206642:0:5756:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94c818d1ec00 already unused, calling callback (ffffffffc21124f0) 00010000:00010000:0.0:1788869456.206647:0:5756:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94c818d1ec00/0x3d2d1916761d737e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869456.206654:0:5756:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94c818d1ec00/0x3d2d1916761d737e lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869456.206663:0:5756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff94c803990b00) 00010000:00010000:0.0:1788869456.206666:0:5756:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:0.0:1788869456.206670:0:5756:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94c818d1ec00/0x3d2d1916761d737e lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869456.206676:0:5756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94c818d1ec00/0x3d2d1916761d737e lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788869456.206715:0:5756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c702214e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2125b9b3-626e-4cbe-be83-fb446e976ce2+19:11547:x1875765413112320:12345-192.168.201.39@tcp:55:lhsmtool_posix.0 Request processed in 3555us (3782us total) trans 0 rc -22/-22 00000100:00100000:0.0:1788869456.206723:0:5756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 231 00000100:00100000:3.0:1788869456.209756:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1788869456.209914:0:7884:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765413112576 00000100:00100000:1.0:1788869456.209923:0:7884:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765413112576 00000100:00100000:1.0:1788869456.210019:0:7884:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 69 00000100:00100000:1.0:1788869456.210029:0:7884:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c82c841500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:2125b9b3-626e-4cbe-be83-fb446e976ce2+8:2347:x1875765413112576:12345-192.168.201.39@tcp:1:lhsmtool_posix.0 00010000:00010000:1.0:1788869456.210072:0:7884:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000db05d9ff/0x3d2d1916761d7385 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 7884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869456.210091:0:7884:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000081575a94/0x3d2d1916761d7362 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.39@tcp remote: 0x375c010249035bd5 expref: 8 pid: 11822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869456.210100:0:7884:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788869456.210104:0:7884:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788869456.210108:0:7884:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000db05d9ff/0x3d2d1916761d7385 lrc: 4/1,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 7884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869456.210140:0:7884:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000081575a94/0x3d2d1916761d7362 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.201.39@tcp remote: 0x375c010249035bd5 expref: 8 pid: 11822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869456.210153:0:7884:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000081575a94/0x3d2d1916761d7362 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.201.39@tcp remote: 0x375c010249035bd5 expref: 8 pid: 11822 timeout: 304 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788869456.210167:0:7884:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94c702216680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:7884:1875765421473152:192.168.201.39@tcp:104: 00000100:00100000:1.0:1788869456.210245:0:7884:0:(client.c:2702:ptlrpc_set_wait()) set ffff94c818e67180 going to sleep for 11 seconds 00000100:00100000:1.0:1788869456.213215:0:7884:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94c702216680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:7884:1875765421473152:192.168.201.39@tcp:104: 00010000:00010000:1.0:1788869456.213242:0:7884:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000db05d9ff/0x3d2d1916761d7385 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 7884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788869456.214632:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1788869456.214704:0:5741:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765413112704 00000100:00100000:0.0:1788869456.214713:0:5741:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765413112704 00010000:00010000:0.0:1788869456.214751:0:5741:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000081575a94/0x3d2d1916761d7362 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.39@tcp remote: 0x375c010249035bd5 expref: 9 pid: 11822 timeout: 304 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788869456.214791:0:5741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 88 00000100:00100000:0.0:1788869456.214801:0:5741:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c82c841880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2125b9b3-626e-4cbe-be83-fb446e976ce2+9:2348:x1875765413112704:12345-192.168.201.39@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788869456.214833:0:5741:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788869456.214855:0:5741:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000081575a94/0x3d2d1916761d7362 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.39@tcp remote: 0x375c010249035bd5 expref: 9 pid: 11822 timeout: 304 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869456.214868:0:5741:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000081575a94/0x3d2d1916761d7362 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.201.39@tcp remote: 0x375c010249035bd5 expref: 9 pid: 11822 timeout: 304 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869456.214892:0:5741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000081575a94/0x3d2d1916761d7362 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.201.39@tcp remote: 0x375c010249035bd5 expref: 9 pid: 11822 timeout: 304 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869456.214909:0:5741:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788869456.214913:0:5741:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788869456.214919:0:5741:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000db05d9ff/0x3d2d1916761d7385 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 7884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869456.214930:0:5741:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000db05d9ff/0x3d2d1916761d7385 lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 7884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869456.215004:0:5741:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788869456.215055:0:5741:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c82c841880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2125b9b3-626e-4cbe-be83-fb446e976ce2+8:2348:x1875765413112704:12345-192.168.201.39@tcp:103:ldlm_bl.0 Request processed in 254us (427us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869456.215063:0:5741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 88 00010000:00010000:1.0:1788869456.215686:0:7884:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000db05d9ff/0x3d2d1916761d7385 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 7884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869456.215706:0:7884:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000db05d9ff/0x3d2d1916761d7385 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 7884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869456.215730:0:7884:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000db05d9ff/0x3d2d1916761d7385 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 7884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869456.215739:0:7884:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000db05d9ff/0x3d2d1916761d7385 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 7884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869456.215748:0:7884:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000db05d9ff/0x3d2d1916761d7385 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 7884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869456.215755:0:7884:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94c83fde6a00 already unused, calling callback (ffffffffc1703220) 00010000:00010000:1.0:1788869456.215760:0:7884:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000db05d9ff/0x3d2d1916761d7385 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 7884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869456.215769:0:7884:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000db05d9ff/0x3d2d1916761d7385 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 7884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869456.215783:0:7884:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000db05d9ff/0x3d2d1916761d7385 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 7884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869456.215791:0:7884:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000db05d9ff/0x3d2d1916761d7385 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 7884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788869456.215904:0:7884:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c82c841500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:2125b9b3-626e-4cbe-be83-fb446e976ce2+7:2347:x1875765413112576:12345-192.168.201.39@tcp:1:lhsmtool_posix.0 Request processed in 5875us (6154us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869456.215914:0:7884:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 69 00000100:00100000:3.0:1788869456.217603:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1788869456.217653:0:5757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765413112960 00000100:00100000:2.0:1788869456.217663:0:5757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765413112960 00000100:00100000:2.0:1788869456.217821:0:5757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 232 00000100:00100000:2.0:1788869456.217833:0:5757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c83513c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2125b9b3-626e-4cbe-be83-fb446e976ce2+19:11547:x1875765413112960:12345-192.168.201.39@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1788869456.218210:0:5757:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94c805038600/0x3d2d1916761d738c lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869456.218229:0:5757:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94c805038600/0x3d2d1916761d738c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869456.218241:0:5757:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94c805038600/0x3d2d1916761d738c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869456.218634:0:5757:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94c805038800/0x3d2d1916761d7393 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869456.218654:0:5757:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff94c805039a00/0x3d2d1916761d7346 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.39@tcp remote: 0x375c010249035bc0 expref: 20 pid: 5755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869456.218663:0:5757:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff94c805038800/0x3d2d1916761d7393 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869456.218698:0:5757:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff94c805039a00/0x3d2d1916761d7346 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.201.39@tcp remote: 0x375c010249035bc0 expref: 20 pid: 5755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869456.218730:0:5757:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff94c805039a00/0x3d2d1916761d7346 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.201.39@tcp remote: 0x375c010249035bc0 expref: 20 pid: 5755 timeout: 304 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788869456.218745:0:5757:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94c83fae9180 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5757:1875765421473280:192.168.201.39@tcp:104: 00000100:00100000:2.0:1788869456.218822:0:5757:0:(client.c:2702:ptlrpc_set_wait()) set ffff94c8038e2300 going to sleep for 11 seconds 00000100:00100000:2.0:1788869456.221884:0:5757:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94c83fae9180 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5757:1875765421473280:192.168.201.39@tcp:104: 00010000:00010000:2.0:1788869456.221917:0:5757:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff94c805038800/0x3d2d1916761d7393 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5757 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788869456.223663:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1788869456.223862:0:5740:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765413113088 00000100:00100000:0.0:1788869456.223872:0:5740:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765413113088 00010000:00010000:0.0:1788869456.223913:0:5740:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff94c805039a00/0x3d2d1916761d7346 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.39@tcp remote: 0x375c010249035bc0 expref: 21 pid: 5755 timeout: 304 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788869456.223967:0:5740:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 89 00000100:00100000:0.0:1788869456.223977:0:5740:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c808ee7850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2125b9b3-626e-4cbe-be83-fb446e976ce2+21:2348:x1875765413113088:12345-192.168.201.39@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788869456.223993:0:5740:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788869456.224001:0:5740:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff94c805039a00/0x3d2d1916761d7346 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.39@tcp remote: 0x375c010249035bc0 expref: 21 pid: 5755 timeout: 304 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869456.224015:0:5740:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff94c805039a00/0x3d2d1916761d7346 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.201.39@tcp remote: 0x375c010249035bc0 expref: 21 pid: 5755 timeout: 304 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869456.224040:0:5740:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94c805039a00/0x3d2d1916761d7346 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.201.39@tcp remote: 0x375c010249035bc0 expref: 21 pid: 5755 timeout: 304 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869456.224346:0:5740:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff94c803990b00) 00010000:00010000:0.0:1788869456.224353:0:5740:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff94c805038800/0x3d2d1916761d7393 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869456.224362:0:5740:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff94c805038800/0x3d2d1916761d7393 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869456.224369:0:5740:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94c805038800/0x3d2d1916761d7393 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869456.224445:0:5740:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788869456.224515:0:5740:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c808ee7850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2125b9b3-626e-4cbe-be83-fb446e976ce2+20:2348:x1875765413113088:12345-192.168.201.39@tcp:103:ldlm_bl.0 Request processed in 538us (859us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869456.224524:0:5740:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 89 00010000:00010000:3.0:1788869456.224708:0:5757:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff94c805038800/0x3d2d1916761d7393 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869456.224717:0:5757:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94c805038800/0x3d2d1916761d7393 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5757 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788869456.224956:0:5757:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967508 00000001:00080000:3.0:1788869456.225210:0:5757:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967509 00000001:00080000:3.0:1788869456.225409:0:5757:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967510 00000100:00100000:2.0:1788869456.225631:0:5757:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94c83fae9180 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5757:1875765421473408:0@lo:1000:mdt00_002.0 00000100:00100000:2.0:1788869456.225681:0:5757:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869456.225714:0:5757:0:(client.c:2702:ptlrpc_set_wait()) set ffff94c8050683c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788869456.225729:0:5760:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765421473408 00000100:00100000:1.0:1788869456.225737:0:5760:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765421473408 00000100:00100000:1.0:1788869456.225814:0:5760:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788869456.225824:0:5760:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c83faeb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5757:x1875765421473408:12345-0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1788869456.225905:0:5760:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c83faeb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5757:x1875765421473408:12345-0@lo:1000:mdt00_002.0 Request processed in 82us (224us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869456.225913:0:5760:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788869456.225954:0:5757:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967321 gen 2 00000004:00080000:2.0:1788869456.225960:0:5757:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967317 committed transno 4294967321 00000004:00080000:2.0:1788869456.225976:0:5757:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94c808f51880, transno 4294967321 00000100:00100000:2.0:1788869456.225998:0:5757:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94c83fae9180 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5757:1875765421473408:0@lo:1000:mdt00_002.0 00000001:00080000:2.0:1788869456.226526:0:5757:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967511 00000100:00100000:2.0:1788869456.226582:0:5757:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94c83fae9180 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5757:1875765421473536:0@lo:1000:mdt00_002.0 00000100:00100000:2.0:1788869456.226612:0:5757:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869456.226634:0:5757:0:(client.c:2702:ptlrpc_set_wait()) set ffff94c8038e2300 going to sleep for 11 seconds 00000100:00100000:3.0:1788869456.226650:0:5761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765421473536 00000100:00100000:3.0:1788869456.226658:0:5761:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765421473536 00000100:00100000:2.0:1788869456.226756:0:5761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788869456.226766:0:5761:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c835156680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5757:x1875765421473536:12345-0@lo:1000:mdt00_002.0 00000100:00100000:2.0:1788869456.226932:0:5761:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c835156680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5757:x1875765421473536:12345-0@lo:1000:mdt00_002.0 Request processed in 168us (319us total) trans 4294967323 rc 0/0 00000100:00100000:2.0:1788869456.226949:0:5761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788869456.226970:0:5757:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94c83fae9180 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5757:1875765421473536:0@lo:1000:mdt00_002.0 00010000:00010000:0.0:1788869456.227007:0:5757:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94c805038800/0x3d2d1916761d7393 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869456.227017:0:5757:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94c805038800/0x3d2d1916761d7393 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869456.227025:0:5757:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94c805038800/0x3d2d1916761d7393 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869456.227031:0:5757:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94c805038800 already unused, calling callback (ffffffffc21124f0) 00010000:00010000:0.0:1788869456.227035:0:5757:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94c805038800/0x3d2d1916761d7393 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869456.227042:0:5757:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94c805038800/0x3d2d1916761d7393 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869456.227157:0:5757:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff94c803990b00) 00010000:00010000:0.0:1788869456.227162:0:5757:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788869456.227167:0:5757:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94c805038800/0x3d2d1916761d7393 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869456.227173:0:5757:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94c805038800/0x3d2d1916761d7393 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869456.227203:0:5757:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94c818d1fa00/0x3d2d1916761d72d6 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869456.227210:0:5757:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94c818d1fa00/0x3d2d1916761d72d6 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869456.227217:0:5757:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94c818d1fa00/0x3d2d1916761d72d6 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869456.227233:0:5757:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94c818d1fa00 already unused, calling callback (ffffffffc21124f0) 00010000:00010000:0.0:1788869456.227237:0:5757:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94c818d1fa00/0x3d2d1916761d72d6 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869456.227243:0:5757:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94c818d1fa00/0x3d2d1916761d72d6 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869456.227358:0:5757:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff94c81a585c00) 00010000:00010000:0.0:1788869456.227361:0:5757:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788869456.227368:0:5757:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff94c83fde6e00/0x3d2d1916761d72dd lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.39@tcp remote: 0x375c010249035ba4 expref: 23 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869456.227378:0:5757:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff94c83fde6e00/0x3d2d1916761d72dd lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.201.39@tcp remote: 0x375c010249035ba4 expref: 23 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869456.227388:0:5757:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94c83fde6e00/0x3d2d1916761d72dd lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.201.39@tcp remote: 0x375c010249035ba4 expref: 23 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869456.227416:0:5757:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff94c83fde6e00/0x3d2d1916761d72dd lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.39@tcp remote: 0x375c010249035ba4 expref: 23 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788869456.227429:0:5757:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94c808f51880 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5757:1875765421473664:192.168.201.39@tcp:105: 00000100:00100000:0.0:1788869456.227537:0:5757:0:(client.c:2702:ptlrpc_set_wait()) set ffff94c81075af00 going to sleep for 11 seconds 00000100:00100000:0.0:1788869456.230085:0:5757:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94c808f51880 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5757:1875765421473664:192.168.201.39@tcp:105: 00010000:00010000:0.0:1788869456.230113:0:5757:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94c818d1fa00/0x3d2d1916761d72d6 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869456.230139:0:5757:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94c818d1fa00/0x3d2d1916761d72d6 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869456.230167:0:5757:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94c818d1f600/0x3d2d1916761d739a lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869456.230180:0:5757:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94c818d1f600/0x3d2d1916761d739a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869456.230190:0:5757:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94c818d1f600/0x3d2d1916761d739a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869456.230201:0:5757:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94c818d1f600/0x3d2d1916761d739a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869456.230207:0:5757:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94c818d1f600/0x3d2d1916761d739a lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869456.230214:0:5757:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94c818d1f600/0x3d2d1916761d739a lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869456.230220:0:5757:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94c818d1f600 already unused, calling callback (ffffffffc21124f0) 00010000:00010000:0.0:1788869456.230224:0:5757:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94c818d1f600/0x3d2d1916761d739a lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869456.230231:0:5757:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94c818d1f600/0x3d2d1916761d739a lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869456.230239:0:5757:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff94c81a585c00) 00010000:00010000:0.0:1788869456.230242:0:5757:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788869456.230245:0:5757:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94c818d1f600/0x3d2d1916761d739a lrc: 2/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5757 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788869456.230556:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1788869456.230661:0:5759:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765413113216 00000100:00100000:3.0:1788869456.230670:0:5759:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765413113216 00000100:00100000:3.0:1788869456.230715:0:5759:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 61 00000100:00100000:3.0:1788869456.230724:0:5759:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c702216680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2125b9b3-626e-4cbe-be83-fb446e976ce2+24:11546:x1875765413113216:12345-192.168.201.39@tcp:49:lfs.0 00000100:00100000:3.0:1788869456.230838:0:5759:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c702216680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2125b9b3-626e-4cbe-be83-fb446e976ce2+24:11546:x1875765413113216:12345-192.168.201.39@tcp:49:lfs.0 Request processed in 114us (283us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869456.230846:0:5759:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 61 00010000:00010000:0.0:1788869456.230945:0:5757:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94c818d1f600/0x3d2d1916761d739a lrc: 0/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869456.230957:0:5757:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94c805038600/0x3d2d1916761d738c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869456.230962:0:5757:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94c805038600/0x3d2d1916761d738c lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869456.230968:0:5757:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94c805038600/0x3d2d1916761d738c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869456.230973:0:5757:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94c805038600 already unused, calling callback (ffffffffc21124f0) 00010000:00010000:0.0:1788869456.230976:0:5757:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94c805038600/0x3d2d1916761d738c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869456.230981:0:5757:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94c805038600/0x3d2d1916761d738c lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869456.230990:0:5757:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff94c81a585c00) 00010000:00010000:0.0:1788869456.230992:0:5757:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1788869456.230995:0:5757:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94c805038600/0x3d2d1916761d738c lrc: 2/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869456.231000:0:5757:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94c805038600/0x3d2d1916761d738c lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5757 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788869456.231275:0:5757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c83513c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2125b9b3-626e-4cbe-be83-fb446e976ce2+23:11547:x1875765413112960:12345-192.168.201.39@tcp:57:lhsmtool_posix.0 Request processed in 13444us (13677us total) trans 4294967512 rc 0/0 00000100:00100000:0.0:1788869456.231283:0:5757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 232 00000020:00080000:0.0:1788869456.231292:0:5757:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000100:00100000:1.0:1788869456.235153:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1788869456.235202:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1788869456.235315:0:5755:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765413113728 00000040:00080000:2.0:1788869456.235322:0:11485:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788869456.235325:0:11485:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000100:00100000:0.0:1788869456.235326:0:5755:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765413113728 00000100:00100000:0.0:1788869456.235371:0:5755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 233 00000100:00100000:0.0:1788869456.235378:0:5755:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c702216a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2125b9b3-626e-4cbe-be83-fb446e976ce2+23:11546:x1875765413113728:12345-192.168.201.39@tcp:58:lfs.0 00000100:00100000:3.0:1788869456.235585:0:11820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765413113472 00000100:00100000:3.0:1788869456.235590:0:11820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765413113472 00000100:00100000:3.0:1788869456.235624:0:11820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 62 00000100:00100000:3.0:1788869456.235631:0:11820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c81876ac50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:2125b9b3-626e-4cbe-be83-fb446e976ce2+24:11547:x1875765413113472:12345-192.168.201.39@tcp:35:lhsmtool_posix.0 00000040:00080000:0.0:1788869456.235689:0:5755:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].6, 136 off9008 00000100:00100000:0.0:1788869456.235766:0:5755:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c702216a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2125b9b3-626e-4cbe-be83-fb446e976ce2+25:11546:x1875765413113728:12345-192.168.201.39@tcp:58:lfs.0 Request processed in 388us (563us total) trans 0 rc 0/0 00000040:00080000:2.0:1788869456.235772:0:11485:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 7 00000100:00100000:0.0:1788869456.235774:0:5755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 233 00000040:00080000:2.0:1788869456.235784:0:11485:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000004:00080000:2.0:1788869456.236181:0:11820:0:(mdd_object.c:4016:mdd_close()) Object [0x200000401:0x10:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:2.0:1788869456.236318:0:11820:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967513 00010000:00010000:2.0:1788869456.236366:0:11820:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94c805038400/0x3d2d1916761d73a1 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869456.236382:0:11820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94c805038400/0x3d2d1916761d73a1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 11820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869456.236394:0:11820:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94c805038400/0x3d2d1916761d73a1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 11820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869456.236402:0:11820:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94c805038400/0x3d2d1916761d73a1 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 11820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869456.236408:0:11820:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94c805038400/0x3d2d1916761d73a1 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 11820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869456.236415:0:11820:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94c805038400/0x3d2d1916761d73a1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 11820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869456.236431:0:11820:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1788869456.236499:0:11820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c81876ac50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:2125b9b3-626e-4cbe-be83-fb446e976ce2+25:11547:x1875765413113472:12345-192.168.201.39@tcp:35:lhsmtool_posix.0 Request processed in 867us (1354us total) trans 4294967514 rc 0/0 00000100:00100000:2.0:1788869456.236508:0:11820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 62 00000020:00080000:2.0:1788869456.236512:0:11820:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1788869456.236569:0:5743:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788869456.236576:0:5743:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94c805038400/0x3d2d1916761d73a1 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 11820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869456.236584:0:5743:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94c805038400 already unused, calling callback (ffffffffc1703220) 00010000:00010000:3.0:1788869456.236588:0:5743:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94c805038400/0x3d2d1916761d73a1 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 11820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869456.236596:0:5743:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94c805038400/0x3d2d1916761d73a1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 11820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869456.236608:0:5743:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff94c802f3f300) 00010000:00010000:3.0:1788869456.236611:0:5743:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1788869456.236615:0:5743:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94c805038400/0x3d2d1916761d73a1 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 11820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869456.236621:0:5743:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94c805038400/0x3d2d1916761d73a1 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 11820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869456.236638:0:5743:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788869456.236640:0:5743:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788869456.236642:0:5743:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788869456.258210:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1788869456.258313:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765413113856 00000100:00100000:0.0:1788869456.258325:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765413113856 00000100:00100000:0.0:1788869456.258386:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 234 00000100:00100000:0.0:1788869456.258395:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c702214a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2125b9b3-626e-4cbe-be83-fb446e976ce2+25:11549:x1875765413113856:12345-192.168.201.39@tcp:101:lfs.0 00010000:00010000:0.0:1788869456.258417:0:5786:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788869456.258436:0:5786:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94c818d1f600/0x3d2d1916761d73a8 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x375c010249035bdc expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869456.258516:0:5786:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff94c818d1fa00/0x3d2d1916761d73af lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869456.258532:0:5786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94c818d1fa00/0x3d2d1916761d73af lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869456.258543:0:5786:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94c818d1fa00/0x3d2d1916761d73af lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869456.258556:0:5786:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94c818d1ec00/0x3d2d1916761d73b6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869456.258563:0:5786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94c818d1ec00/0x3d2d1916761d73b6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869456.258582:0:5786:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94c818d1ec00/0x3d2d1916761d73b6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869456.258872:0:5786:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94c818d1f000/0x3d2d1916761d73bd lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869456.258883:0:5786:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff94c805039e00/0x3d2d1916761d72c8 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0x375c010249035b9d expref: 26 pid: 5757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869456.258890:0:5786:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff94c818d1f000/0x3d2d1916761d73bd lrc: 4/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869456.258922:0:5786:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff94c805039e00/0x3d2d1916761d72c8 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.39@tcp remote: 0x375c010249035b9d expref: 26 pid: 5757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869456.258935:0:5786:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff94c805039e00/0x3d2d1916761d72c8 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.39@tcp remote: 0x375c010249035b9d expref: 26 pid: 5757 timeout: 304 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788869456.258947:0:5786:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94c808f51880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:5786:1875765421473792:192.168.201.39@tcp:104: 00000100:00100000:0.0:1788869456.259032:0:5786:0:(client.c:2702:ptlrpc_set_wait()) set ffff94c81075a300 going to sleep for 11 seconds 00000100:00100000:1.0:1788869456.262310:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1788869456.262398:0:5786:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94c808f51880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:5786:1875765421473792:192.168.201.39@tcp:104: 00000100:00100000:3.0:1788869456.262400:0:5759:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765413114112 00000100:00100000:3.0:1788869456.262410:0:5759:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765413114112 00010000:00010000:0.0:1788869456.262427:0:5786:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff94c818d1f000/0x3d2d1916761d73bd lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788869456.262471:0:5759:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 63 00000100:00100000:3.0:1788869456.262492:0:5759:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c702217800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2125b9b3-626e-4cbe-be83-fb446e976ce2+27:5552:x1875765413114112:12345-192.168.201.39@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1788869456.262737:0:5759:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c702217800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2125b9b3-626e-4cbe-be83-fb446e976ce2+28:5552:x1875765413114112:12345-192.168.201.39@tcp:35:ldlm_bl.0 Request processed in 255us (446us total) trans 4294967515 rc 0/0 00000100:00100000:3.0:1788869456.262746:0:5759:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 63 00000100:00100000:1.0:1788869456.264898:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1788869456.265208:0:7448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765413114240 00000100:00100000:2.0:1788869456.265217:0:7448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765413114240 00010000:00010000:2.0:1788869456.265275:0:7448:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff94c805039e00/0x3d2d1916761d72c8 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.39@tcp remote: 0x375c010249035b9d expref: 28 pid: 5757 timeout: 304 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788869456.265312:0:7448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 90 00000100:00100000:2.0:1788869456.265322:0:7448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c702216300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:2125b9b3-626e-4cbe-be83-fb446e976ce2+28:2348:x1875765413114240:12345-192.168.201.39@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788869456.265337:0:7448:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788869456.265344:0:7448:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff94c805039e00/0x3d2d1916761d72c8 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.39@tcp remote: 0x375c010249035b9d expref: 28 pid: 5757 timeout: 304 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869456.265358:0:7448:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff94c805039e00/0x3d2d1916761d72c8 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.39@tcp remote: 0x375c010249035b9d expref: 28 pid: 5757 timeout: 304 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869456.265381:0:7448:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94c805039e00/0x3d2d1916761d72c8 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.39@tcp remote: 0x375c010249035b9d expref: 28 pid: 5757 timeout: 304 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869456.265396:0:7448:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff94c81a585c00) 00010000:00010000:2.0:1788869456.265402:0:7448:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff94c818d1f000/0x3d2d1916761d73bd lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869456.265412:0:7448:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff94c818d1f000/0x3d2d1916761d73bd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869456.265420:0:7448:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94c818d1f000/0x3d2d1916761d73bd lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869456.265457:0:7448:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788869456.265529:0:7448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c702216300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:2125b9b3-626e-4cbe-be83-fb446e976ce2+27:2348:x1875765413114240:12345-192.168.201.39@tcp:103:ldlm_bl.0 Request processed in 206us (636us total) trans 0 rc 0/0 00010000:00010000:1.0:1788869456.265530:0:5786:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff94c818d1f000/0x3d2d1916761d73bd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869456.265542:0:5786:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94c818d1f000/0x3d2d1916761d73bd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788869456.265561:0:7448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 90 00000004:00200000:1.0:1788869456.265591:0:5786:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:1.0:1788869456.265597:0:5786:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1788869456.265616:0:5786:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff94c818d1f000/0x3d2d1916761d73bd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869456.265640:0:5786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94c818d1f000/0x3d2d1916761d73bd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869456.265651:0:5786:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff94c818d1fa00/0x3d2d1916761d73af lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869456.265657:0:5786:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94c818d1fa00/0x3d2d1916761d73af lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869456.265664:0:5786:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94c818d1fa00/0x3d2d1916761d73af lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869456.265670:0:5786:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94c818d1fa00 already unused, calling callback (ffffffffc21124f0) 00010000:00010000:1.0:1788869456.265674:0:5786:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94c818d1fa00/0x3d2d1916761d73af lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869456.265682:0:5786:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94c818d1fa00/0x3d2d1916761d73af lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869456.265691:0:5786:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff94c802f3fd00) 00010000:00010000:1.0:1788869456.265694:0:5786:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788869456.265698:0:5786:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94c818d1fa00/0x3d2d1916761d73af lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869456.265705:0:5786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94c818d1fa00/0x3d2d1916761d73af lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869456.265717:0:5786:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94c818d1ec00/0x3d2d1916761d73b6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869456.265723:0:5786:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94c818d1ec00/0x3d2d1916761d73b6 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869456.265735:0:5786:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94c818d1ec00/0x3d2d1916761d73b6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869456.265740:0:5786:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94c818d1ec00 already unused, calling callback (ffffffffc21124f0) 00010000:00010000:1.0:1788869456.265744:0:5786:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94c818d1ec00/0x3d2d1916761d73b6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869456.265750:0:5786:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94c818d1ec00/0x3d2d1916761d73b6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869456.265759:0:5786:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff94c803990b00) 00010000:00010000:1.0:1788869456.265761:0:5786:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788869456.265764:0:5786:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94c818d1ec00/0x3d2d1916761d73b6 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869456.265770:0:5786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94c818d1ec00/0x3d2d1916761d73b6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869456.265805:0:5786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94c818d1f600/0x3d2d1916761d73a8 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0x375c010249035bdc expref: 27 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869456.265820:0:5786:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94c818d1f000/0x3d2d1916761d73bd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0x375c010249035bdc expref: 26 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869456.265827:0:5786:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff94c81a585c00) 00010000:00010000:1.0:1788869456.265829:0:5786:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788869456.265832:0:5786:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94c818d1f000, rc 0) 00000100:00100000:1.0:1788869456.265859:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c702214a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2125b9b3-626e-4cbe-be83-fb446e976ce2+26:11549:x1875765413113856:12345-192.168.201.39@tcp:101:lfs.0 Request processed in 7465us (7658us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869456.265875:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 234 00010000:00010000:2.0:1788869456.283415:0:5742:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1788869456.521122:0:6571:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967307 is committed 00000001:00080000:0.0:1788869456.521146:0:6571:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967305 is committed 00000001:00080000:0.0:1788869456.521156:0:6571:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967310 is committed 00000001:00080000:0.0:1788869456.521161:0:6571:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967308 is committed 00000040:00080000:0.0:1788869456.730272:0:12367:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788869456.730280:0:12367:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788869456.730316:0:12367:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 7 00000040:00080000:0.0:1788869456.730320:0:12367:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1788869456.992184:0:3284:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94c702214380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3284:1875765421474176:0@lo:400:kworker.0 00000100:00100000:1.0:1788869456.992275:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869456.992339:0:3284:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1788869456.992346:0:3284:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94c702217b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3284:1875765421474048:0@lo:400:kworker.0 00000100:00100000:1.0:1788869456.992369:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869456.992385:0:3284:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94c702215c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3284:1875765421474560:0@lo:400:kworker.0 00000100:00100000:0.0:1788869456.992415:0:3285:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94c702214000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3285:1875765421474304:0@lo:400:kworker.0 00000100:00100000:1.0:1788869456.992425:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869456.992448:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869456.992484:0:3285:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1788869456.992489:0:3285:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94c702215880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:121cd5bc-7f07-4cf7-8e2e-4356c89c0696:3285:1875765421473920:0@lo:400:kworker.0 00000100:00100000:1.0:1788869456.992495:0:5756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765421474176 00000100:00100000:1.0:1788869456.992503:0:5756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765421474176 00000100:00100000:0.0:1788869456.992514:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869456.992543:0:6547:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765421474560 00000100:00100000:0.0:1788869456.992545:0:3285:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94c702216680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3285:1875765421474432:0@lo:400:kworker.0 00000100:00100000:3.0:1788869456.992548:0:6547:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765421474560 00000100:00100000:0.0:1788869456.992566:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869456.992593:0:6547:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765421474304 00000100:00100000:3.0:1788869456.992596:0:6547:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765421474304 00000100:00100000:0.0:1788869456.992605:0:5748:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765421473920 00000100:00100000:0.0:1788869456.992609:0:5748:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765421473920 00000100:00100000:3.0:1788869456.992618:0:6547:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000004:00080000:2.0:1788869456.992626:0:7878:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 205284374692ns, next at 206284371781ns, rc = 0 00000100:00100000:0.0:1788869456.992637:0:5748:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 271 00000100:00100000:0.0:1788869456.992644:0:5748:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c81f148050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:121cd5bc-7f07-4cf7-8e2e-4356c89c0696+19:3285:x1875765421473920:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788869456.992663:0:5757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765421474048 00000100:00100000:2.0:1788869456.992669:0:5757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765421474048 00000100:00100000:0.0:1788869456.992683:0:5748:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c81f148050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:121cd5bc-7f07-4cf7-8e2e-4356c89c0696+19:3285:x1875765421473920:12345-0@lo:400:kworker.0 Request processed in 38us (166us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869456.992684:0:6547:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c83c688e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3284:x1875765421474560:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788869456.992693:0:5748:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 271 00000100:00100000:2.0:1788869456.992710:0:5757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765421474432 00000100:00100000:2.0:1788869456.992715:0:5757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765421474432 00000100:00100000:3.0:1788869456.992731:0:6547:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c83c688e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3284:x1875765421474560:12345-0@lo:400:kworker.0 Request processed in 53us (307us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869456.992737:0:6547:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1788869456.992740:0:3285:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94c702215880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:121cd5bc-7f07-4cf7-8e2e-4356c89c0696:3285:1875765421473920:0@lo:400:kworker.0 00000100:00100000:3.0:1788869456.992753:0:6547:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1788869456.992759:0:6547:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c808f51880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3285:x1875765421474304:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788869456.992786:0:6547:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c808f51880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3285:x1875765421474304:12345-0@lo:400:kworker.0 Request processed in 28us (338us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869456.992792:0:6547:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1788869456.992811:0:5755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:3.0:1788869456.992817:0:5755:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c702215f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3284:x1875765421474048:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788869456.992841:0:5755:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c702215f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3284:x1875765421474048:12345-0@lo:400:kworker.0 Request processed in 24us (471us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869456.992847:0:5755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:3.0:1788869456.992863:0:3283:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788869456.992871:0:3283:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94c835154000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3283:1875765421474688:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788869456.992892:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869456.992917:0:6548:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765421474688 00000100:00100000:3.0:1788869456.992924:0:6548:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765421474688 00000100:00100000:3.0:1788869456.992941:0:6548:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1788869456.992945:0:6548:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c83513ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3283:x1875765421474688:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788869456.992955:0:6548:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3856662528 00000100:00100000:3.0:1788869456.992977:0:6548:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c83513ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3283:x1875765421474688:12345-0@lo:13:osp-pre-1-0.0 Request processed in 32us (84us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869456.992981:0:6548:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1788869456.993003:0:3283:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94c835154000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3283:1875765421474688:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788869456.993040:0:3284:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94c702217b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3284:1875765421474048:0@lo:400:kworker.0 00000100:00100000:3.0:1788869456.993045:0:3284:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94c702215c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3284:1875765421474560:0@lo:400:kworker.0 00000100:00100000:0.0:1788869456.993213:0:3285:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967310 gen 2 00000004:00080000:0.0:1788869456.993218:0:3285:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967306 committed transno 4294967310 00000004:00080000:0.0:1788869456.993229:0:3285:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94c8354d3100, transno 4294967307 00000004:00080000:0.0:1788869456.993237:0:3285:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967309 committed transno 4294967310 00000004:00080000:0.0:1788869456.993244:0:3285:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94c702217100, transno 4294967310 00000100:00100000:0.0:1788869456.993266:0:3285:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94c702214000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3285:1875765421474304:0@lo:400:kworker.0 00000100:00100000:1.0:1788869456.993989:0:5756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:1.0:1788869456.993999:0:5756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c702215180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3284:x1875765421474176:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788869456.994052:0:5756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c702215180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3284:x1875765421474176:12345-0@lo:400:kworker.0 Request processed in 55us (1778us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869456.994059:0:5756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:3.0:1788869456.994094:0:3284:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94c702214380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3284:1875765421474176:0@lo:400:kworker.0 00000100:00080000:0.0:1788869456.994119:0:5751:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788869456.994246:0:5757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:3.0:1788869456.994278:0:5757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c808f51c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3285:x1875765421474432:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788869456.994317:0:5757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c808f51c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3285:x1875765421474432:12345-0@lo:400:kworker.0 Request processed in 42us (1751us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869456.994324:0:5757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:0.0:1788869456.994345:0:3285:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94c702216680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3285:1875765421474432:0@lo:400:kworker.0 00000040:00080000:2.0:1788869457.243527:0:11485:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788869457.243536:0:11485:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788869457.243577:0:11485:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 7 00000040:00080000:2.0:1788869457.243584:0:11485:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1788869457.243717:0:11485:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94c835154380 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11485:1875765421474816:192.168.201.39@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1788869457.243832:0:11485:0:(client.c:2702:ptlrpc_set_wait()) set ffff94c818e67f00 going to sleep for 11 seconds 00000100:00100000:1.0:1788869457.249145:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1788869457.249291:0:11485:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94c835154380 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11485:1875765421474816:192.168.201.39@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1788869457.249503:0:5755:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765413114368 00000100:00100000:3.0:1788869457.249511:0:5755:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765413114368 00000100:00080000:0.0:1788869457.249582:0:5751:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788869457.249590:0:5755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 235 00000100:00100000:3.0:1788869457.249602:0:5755:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c83c689f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2125b9b3-626e-4cbe-be83-fb446e976ce2+26:11561:x1875765413114368:12345-192.168.201.39@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1788869457.249659:0:5755:0:(mdt_handler.c:8041:mdt_fid2path()) path get [0x200000401:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1788869457.249771:0:5755:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c83c689f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2125b9b3-626e-4cbe-be83-fb446e976ce2+26:11561:x1875765413114368:12345-192.168.201.39@tcp:53:lhsmtool_posix.0 Request processed in 171us (636us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869457.249779:0:5755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 235 00000100:00100000:1.0:1788869457.251841:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1788869457.252007:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765413114624 00000100:00100000:0.0:1788869457.252017:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765413114624 00000100:00100000:0.0:1788869457.252069:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 236 00000100:00100000:0.0:1788869457.252079:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c83c68a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2125b9b3-626e-4cbe-be83-fb446e976ce2+26:11561:x1875765413114624:12345-192.168.201.39@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788869457.252100:0:5786:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788869457.252120:0:5786:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94c818d1e600/0x3d2d1916761d73c4 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x375c010249035be3 expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869457.252219:0:5786:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94c818d1e200/0x3d2d1916761d73cb lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869457.252234:0:5786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94c818d1e200/0x3d2d1916761d73cb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869457.252246:0:5786:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94c818d1e200/0x3d2d1916761d73cb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788869457.252287:0:5786:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:0.0:1788869457.252397:0:5786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94c818d1e600/0x3d2d1916761d73c4 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0x375c010249035be3 expref: 29 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869457.252414:0:5786:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94c818d1e200/0x3d2d1916761d73cb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0x375c010249035be3 expref: 28 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869457.252423:0:5786:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff94c81a585c00) 00010000:00010000:0.0:1788869457.252426:0:5786:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788869457.252429:0:5786:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94c818d1e200, rc 0) 00000100:00100000:0.0:1788869457.252516:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c83c68a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2125b9b3-626e-4cbe-be83-fb446e976ce2+28:11561:x1875765413114624:12345-192.168.201.39@tcp:101:lhsmtool_posix.0 Request processed in 438us (679us total) trans 4294967516 rc 0/0 00000100:00100000:0.0:1788869457.252523:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 236 00000100:00100000:0.0:1788869457.256905:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1788869457.256951:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1788869457.256966:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765413114752 00000100:00100000:2.0:1788869457.256975:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765413114752 00000100:00100000:3.0:1788869457.256993:0:5755:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765413115008 00000100:00100000:3.0:1788869457.256999:0:5755:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765413115008 00000100:00100000:2.0:1788869457.257036:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 15 00000100:00100000:3.0:1788869457.257041:0:5755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 237 00000100:00100000:2.0:1788869457.257046:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c808f51500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2125b9b3-626e-4cbe-be83-fb446e976ce2+29:2347:x1875765413114752:12345-192.168.201.39@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1788869457.257054:0:5755:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c808f50700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2125b9b3-626e-4cbe-be83-fb446e976ce2+29:11561:x1875765413115008:12345-192.168.201.39@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1788869457.257061:0:5788:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788869457.257085:0:5788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94c818d1e200/0x3d2d1916761d73cb lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.39@tcp remote: 0x375c010249035be3 expref: 29 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869457.257099:0:5788:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff94c81a585c00) 00010000:00010000:2.0:1788869457.257103:0:5788:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788869457.257124:0:5755:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504d800/0x3d2d1916761d73d9 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869457.257140:0:5755:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504d800/0x3d2d1916761d73d9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788869457.257148:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c808f51500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2125b9b3-626e-4cbe-be83-fb446e976ce2+28:2347:x1875765413114752:12345-192.168.201.39@tcp:103:ldlm_bl.0 Request processed in 104us (254us total) trans 0 rc 0/0 00010000:00010000:3.0:1788869457.257153:0:5755:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504d800/0x3d2d1916761d73d9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788869457.257175:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 15 00010000:00010000:3.0:1788869457.257414:0:5755:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504d800/0x3d2d1916761d73d9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869457.257423:0:5755:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504d800/0x3d2d1916761d73d9 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869457.257429:0:5755:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504d800/0x3d2d1916761d73d9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869457.257435:0:5755:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94c83504d800 already unused, calling callback (ffffffffc21124f0) 00010000:00010000:3.0:1788869457.257439:0:5755:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504d800/0x3d2d1916761d73d9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869457.257447:0:5755:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504d800/0x3d2d1916761d73d9 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869457.257455:0:5755:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff94c81a585c00) 00010000:00010000:3.0:1788869457.257458:0:5755:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1788869457.257481:0:5755:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504d800/0x3d2d1916761d73d9 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869457.257488:0:5755:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504d800/0x3d2d1916761d73d9 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5755 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788869457.257592:0:5755:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c808f50700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2125b9b3-626e-4cbe-be83-fb446e976ce2+28:11561:x1875765413115008:12345-192.168.201.39@tcp:57:lhsmtool_posix.0 Request processed in 542us (640us total) trans 4294967517 rc 0/0 00000100:00100000:3.0:1788869457.257599:0:5755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 237 00000040:00080000:2.0:1788869457.257658:0:11485:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788869457.257663:0:11485:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788869457.258090:0:11485:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 7 00000040:00080000:2.0:1788869457.258096:0:11485:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1788869457.261233:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1788869457.261310:0:11820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765413115264 00000100:00100000:2.0:1788869457.261325:0:11820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765413115264 00000100:00100000:2.0:1788869457.261379:0:11820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 64 00000100:00100000:2.0:1788869457.261390:0:11820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c808f50e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:2125b9b3-626e-4cbe-be83-fb446e976ce2+28:11561:x1875765413115264:12345-192.168.201.39@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1788869457.261632:0:11820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c808f50e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:2125b9b3-626e-4cbe-be83-fb446e976ce2+29:11561:x1875765413115264:12345-192.168.201.39@tcp:35:lhsmtool_posix.0 Request processed in 244us (406us total) trans 4294967518 rc 0/0 00000100:00100000:2.0:1788869457.261639:0:11820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 64 00010000:00010000:0.0:1788869457.307455:0:7447:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788869458.154630:0:12419:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788869458.154640:0:12419:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788869458.154712:0:12419:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 7 00000040:00080000:2.0:1788869458.154717:0:12419:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1788869458.244348:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1788869458.244395:0:5757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765413115520 00000100:00100000:0.0:1788869458.244404:0:5757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765413115520 00000100:00100000:0.0:1788869458.244475:0:5757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 238 00000100:00100000:0.0:1788869458.244488:0:5757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c808f51180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2125b9b3-626e-4cbe-be83-fb446e976ce2+29:11582:x1875765413115520:12345-192.168.201.39@tcp:101:lfs.0 00010000:00010000:0.0:1788869458.244511:0:5757:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788869458.244535:0:5757:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94c818d1fe00/0x3d2d1916761d73e0 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x375c010249035bea expref: -99 pid: 5757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869458.244634:0:5757:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff94c818d1e000/0x3d2d1916761d73e7 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869458.244645:0:5757:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94c818d1e000/0x3d2d1916761d73e7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869458.244655:0:5757:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94c818d1e000/0x3d2d1916761d73e7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5757 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788869458.244665:0:5757:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:0.0:1788869458.244782:0:5757:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94c818d1fe00/0x3d2d1916761d73e0 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0x375c010249035bea expref: 32 pid: 5757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869458.244822:0:5757:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94c818d1e000/0x3d2d1916761d73e7 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0x375c010249035bea expref: 31 pid: 5757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869458.244834:0:5757:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff94c81a585c00) 00010000:00010000:0.0:1788869458.244838:0:5757:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:0.0:1788869458.244842:0:5757:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94c818d1e000, rc 0) 00000100:00100000:0.0:1788869458.244898:0:5757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c808f51180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2125b9b3-626e-4cbe-be83-fb446e976ce2+31:11582:x1875765413115520:12345-192.168.201.39@tcp:101:lfs.0 Request processed in 413us (566us total) trans 4294967519 rc 0/0 00000100:00100000:0.0:1788869458.244907:0:5757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 238 00000100:00100000:0.0:1788869458.249797:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1788869458.249853:0:5756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765413115648 00000100:00100000:1.0:1788869458.249864:0:5756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765413115648 00000100:00100000:1.0:1788869458.249935:0:5756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 239 00000100:00100000:1.0:1788869458.249946:0:5756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c8354d3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2125b9b3-626e-4cbe-be83-fb446e976ce2+31:11582:x1875765413115648:12345-192.168.201.39@tcp:54:lfs.0 00010000:00010000:1.0:1788869458.250015:0:5756:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94c83fde7200/0x3d2d1916761d73f5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869458.250032:0:5756:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94c83fde7200/0x3d2d1916761d73f5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869458.250056:0:5756:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94c83fde7200/0x3d2d1916761d73f5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869458.250084:0:5756:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94c83fde7200/0x3d2d1916761d73f5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869458.250091:0:5756:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94c83fde7200/0x3d2d1916761d73f5 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869458.250098:0:5756:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94c83fde7200/0x3d2d1916761d73f5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869458.250104:0:5756:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94c83fde7200 already unused, calling callback (ffffffffc21124f0) 00010000:00010000:1.0:1788869458.250109:0:5756:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94c83fde7200/0x3d2d1916761d73f5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869458.250117:0:5756:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94c83fde7200/0x3d2d1916761d73f5 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869458.250129:0:5756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff94c81a585c00) 00010000:00010000:1.0:1788869458.250132:0:5756:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788869458.250137:0:5756:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94c83fde7200/0x3d2d1916761d73f5 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869458.250145:0:5756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94c83fde7200/0x3d2d1916761d73f5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5756 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788869458.250224:0:5756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c8354d3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2125b9b3-626e-4cbe-be83-fb446e976ce2+31:11582:x1875765413115648:12345-192.168.201.39@tcp:54:lfs.0 Request processed in 279us (435us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869458.250234:0:5756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 239 00000100:00100000:0.0:1788869458.301784:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1788869458.303535:0:7884:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765413115776 00000100:00100000:1.0:1788869458.303565:0:7884:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765413115776 00000100:00080000:0.0:1788869458.303625:0:5751:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788869458.303645:0:7884:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 70 00000100:00100000:1.0:1788869458.303656:0:7884:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c83fae8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:2125b9b3-626e-4cbe-be83-fb446e976ce2+7:2345:x1875765413115776:12345-192.168.201.39@tcp:101:cat.0 00010000:00010000:1.0:1788869458.303674:0:7884:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788869458.303694:0:7884:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008c0ee66d/0x3d2d1916761d73fc lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x375c010249035bf1 expref: -99 pid: 7884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788869458.303724:0:7884:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x6:0x0] initial LVB size: 13, mtime: 0x6a9ffb4e, atime: 0x6a9ffb4e, ctime: 0x6a9ffb4e, blocks: 0xb 00010000:00010000:1.0:1788869458.303747:0:7884:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=206s v=(0 0) 00010000:00010000:1.0:1788869458.303752:0:7884:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788869458.303762:0:7884:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008c0ee66d/0x3d2d1916761d73fc lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.39@tcp remote: 0x375c010249035bf1 expref: 8 pid: 7884 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869458.303783:0:7884:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000008c0ee66d/0x3d2d1916761d73fc lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.39@tcp remote: 0x375c010249035bf1 expref: 8 pid: 7884 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869458.303820:0:7884:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94c83fde7200, rc 0) 00000100:00100000:1.0:1788869458.303918:0:7884:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c83fae8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:2125b9b3-626e-4cbe-be83-fb446e976ce2+8:2345:x1875765413115776:12345-192.168.201.39@tcp:101:cat.0 Request processed in 263us (2140us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869458.303934:0:7884:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 70 00000100:00100000:0.0:1788869458.306366:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1788869458.306481:0:6550:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765413115904 00000100:00100000:2.0:1788869458.306488:0:6550:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765413115904 00002000:00100000:2.0:1788869458.306534:0:6550:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x6:0x0] (0->4095) req@ffff94c702216680 x1875765413115904/t0(0) o3->2125b9b3-626e-4cbe-be83-fb446e976ce2@192.168.201.39@tcp:404/0 lens 488/0 e 0 to 0 dl 1788869469 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788869458.306554:0:6550:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff94c702216680 with x1875765413115904 ext(0->4095) 00002000:00010000:2.0:1788869458.306559:0:6550:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff94c702216680 00000100:00100000:2.0:1788869458.306612:0:6550:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 7 00000100:00100000:2.0:1788869458.306665:0:6550:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c702216680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:2125b9b3-626e-4cbe-be83-fb446e976ce2+8:2348:x1875765413115904:12345-192.168.201.39@tcp:3:cat.0 00000100:00100000:2.0:1788869458.307195:0:6550:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c702216680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:2125b9b3-626e-4cbe-be83-fb446e976ce2+8:2348:x1875765413115904:12345-192.168.201.39@tcp:3:cat.0 Request processed in 549us (853us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1788869458.307231:0:6550:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 7 00002000:00100000:2.0:1788869458.307237:0:6550:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x6:0x0] (0->4095) req@ffff94c702216680 x1875765413115904/t0(0) o3->2125b9b3-626e-4cbe-be83-fb446e976ce2@192.168.201.39@tcp:404/0 lens 488/4536 e 0 to 0 dl 1788869469 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788869458.307243:0:6550:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff94c702216680 with x1875765413115904 ext(0->4095) 00002000:00010000:2.0:1788869458.307282:0:6550:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff94c702216680 00010000:00010000:3.0:1788869458.331848:0:5743:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788869458.349951:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1788869458.351050:0:6546:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765413116160 00000100:00100000:3.0:1788869458.351070:0:6546:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765413116160 00000100:00100000:3.0:1788869458.351230:0:6546:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 50 00000100:00100000:3.0:1788869458.351240:0:6546:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c702214380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2125b9b3-626e-4cbe-be83-fb446e976ce2+5:2348:x1875765413116160:12345-192.168.201.39@tcp:400:kworker.0 00000100:00080000:1.0:1788869458.351407:0:5751:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788869458.351555:0:6546:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c702214380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2125b9b3-626e-4cbe-be83-fb446e976ce2+5:2348:x1875765413116160:12345-192.168.201.39@tcp:400:kworker.0 Request processed in 316us (1622us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869458.351563:0:6546:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 50 00000100:00100000:0.0:1788869458.351797:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1788869458.351977:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1788869458.352032:0:5757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765413116288 00000100:00100000:3.0:1788869458.352038:0:5757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765413116288 00000100:00100000:3.0:1788869458.352089:0:5757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 98 00000100:00100000:3.0:1788869458.352099:0:5757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c702215c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:10cd6f3c-009b-4acc-9ca5-e50cb17e412c+5:2348:x1875765413116288:12345-192.168.201.39@tcp:400:kworker.0 00000100:00100000:2.0:1788869458.352099:0:5750:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765413116032 00000100:00100000:2.0:1788869458.352114:0:5750:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765413116032 00000100:00100000:3.0:1788869458.352139:0:5757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c702215c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:10cd6f3c-009b-4acc-9ca5-e50cb17e412c+5:2348:x1875765413116288:12345-192.168.201.39@tcp:400:kworker.0 Request processed in 42us (161us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869458.352147:0:5757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 98 00000100:00100000:2.0:1788869458.352157:0:5750:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 272 00000100:00100000:2.0:1788869458.352166:0:5750:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c81f149050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3cca3acf-4935-4d0d-9982-d5d931f1c86b+13:2348:x1875765413116032:12345-192.168.201.39@tcp:400:kworker.0 00000100:00100000:2.0:1788869458.352213:0:5750:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c81f149050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3cca3acf-4935-4d0d-9982-d5d931f1c86b+13:2348:x1875765413116032:12345-192.168.201.39@tcp:400:kworker.0 Request processed in 38us (406us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869458.352219:0:5750:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 272 00000100:00080000:0.0:1788869458.352330:0:5751:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788869459.036293:0:3286:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788869459.036318:0:3286:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94c83513dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3286:1875765421474944:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788869459.036385:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869459.036465:0:6548:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765421474944 00000100:00100000:0.0:1788869459.036474:0:6548:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765421474944 00000100:00100000:0.0:1788869459.036535:0:6548:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1788869459.036544:0:6548:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c82ccfed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3286:x1875765421474944:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788869459.036579:0:6548:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788869459.036628:0:6548:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c82ccfed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3286:x1875765421474944:12345-0@lo:13:osp-pre-0-0.0 Request processed in 85us (243us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869459.036635:0:6548:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1788869459.036697:0:3286:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94c83513dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3286:1875765421474944:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1788869459.036780:0:5751:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000040:00080000:2.0:1788869459.291521:0:11485:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788869459.291532:0:11485:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788869459.291757:0:11485:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:2.0:1788869459.291767:0:11485:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:2.0:1788869459.355391:0:5742:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788869460.379441:0:7447:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788869460.760984:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1788869460.761230:0:5756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765413116416 00000100:00100000:1.0:1788869460.761241:0:5756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765413116416 00000100:00080000:3.0:1788869460.761508:0:5751:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788869460.761621:0:5756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 240 00000100:00100000:1.0:1788869460.761634:0:5756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c702217b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2125b9b3-626e-4cbe-be83-fb446e976ce2+31:11227:x1875765413116416:12345-192.168.201.39@tcp:60:lhsmtool_posix.0 00000100:00100000:1.0:1788869460.761763:0:5756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c702217b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2125b9b3-626e-4cbe-be83-fb446e976ce2+31:11227:x1875765413116416:12345-192.168.201.39@tcp:60:lhsmtool_posix.0 Request processed in 127us (782us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869460.761785:0:5756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 240 00000100:00100000:1.0:1788869460.763018:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1788869460.763126:0:5758:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765413116672 00000100:00100000:2.0:1788869460.763134:0:5758:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765413116672 00000100:00100000:2.0:1788869460.763178:0:5758:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 65 00000100:00100000:2.0:1788869460.763189:0:5758:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c83c68aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2125b9b3-626e-4cbe-be83-fb446e976ce2+31:11227:x1875765413116672:12345-192.168.201.39@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1788869460.763667:0:5758:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c83c68aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2125b9b3-626e-4cbe-be83-fb446e976ce2+32:11227:x1875765413116672:12345-192.168.201.39@tcp:35:lhsmtool_posix.0 Request processed in 479us (649us total) trans 4294967520 rc 0/0 00000100:00100000:2.0:1788869460.763677:0:5758:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 65 00000100:00100000:3.0:1788869460.845678:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1788869460.845763:0:5757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765413116800 00000100:00100000:0.0:1788869460.845773:0:5757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765413116800 00000100:00080000:3.0:1788869460.845825:0:5751:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788869460.845852:0:5757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 241 00000100:00100000:0.0:1788869460.845865:0:5757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c82ccff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:10cd6f3c-009b-4acc-9ca5-e50cb17e412c+5:12032:x1875765413116800:12345-192.168.201.39@tcp:101:lsof.0 00010000:00010000:0.0:1788869460.845888:0:5757:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788869460.845923:0:5757:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94c818d1fe00/0x3d2d1916761d7403 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x375c010249035bf8 expref: -99 pid: 5757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869460.845996:0:5757:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94c818d1fc00/0x3d2d1916761d740a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869460.846010:0:5757:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94c818d1fc00/0x3d2d1916761d740a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869460.846022:0:5757:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94c818d1fc00/0x3d2d1916761d740a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5757 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788869460.846245:0:5757:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:0.0:1788869460.846277:0:5757:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 3 stripe count 1 MDT count 1 00000004:00010000:0.0:1788869460.846362:0:5757:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff94c818d1fc00/0x3d2d1916761d740a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869460.846401:0:5757:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94c818d1fe00/0x3d2d1916761d7403 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0x375c010249035bf8 expref: 7 pid: 5757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869460.846420:0:5757:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94c818d1fc00/0x3d2d1916761d740a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0x375c010249035bf8 expref: 6 pid: 5757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869460.846441:0:5757:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff94c819394300) 00010000:00010000:0.0:1788869460.846444:0:5757:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788869460.846448:0:5757:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94c818d1fc00, rc 0) 00000100:00100000:0.0:1788869460.846513:0:5757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c82ccff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:10cd6f3c-009b-4acc-9ca5-e50cb17e412c+6:12032:x1875765413116800:12345-192.168.201.39@tcp:101:lsof.0 Request processed in 651us (842us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869460.846520:0:5757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 241 00010000:00010000:3.0:1788869461.404034:0:5743:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1788869461.642312:0:7458:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967322 is committed 00000001:00080000:1.0:1788869461.642341:0:7458:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967323 is committed 00000001:00080000:0.0:1788869461.644841:0:12326:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967519 is committed 00000020:00080000:1.0:1788869461.645045:0:5777:0:(update_trans.c:1348:distribute_txn_batchid_cb()) lustre-MDT0000: 7 batchid updated 00000001:00080000:1.0:1788869461.645067:0:5777:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967520 is committed 00000004:00080000:1.0:1788869461.645085:0:5777:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 8 committed 00000020:00080000:2.0:1788869461.645086:0:5791:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 7 00000020:00080000:1.0:1788869461.645107:0:5777:0:(update_trans.c:58:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff94c805068e40 refcount 2 committed 0 result 0 batchid 8 00000020:00080000:1.0:1788869461.645112:0:5777:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff94c820719200 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff94c8050683c0 00000020:00080000:2.0:1788869461.645116:0:5791:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 7 00000020:00080000:1.0:1788869461.645116:0:5777:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff94c820719700 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff94c70218f400 00000020:00080000:2.0:1788869461.645125:0:5791:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 8 committed batchid 7 00000020:00080000:2.0:1788869461.645341:0:5791:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 7 00000100:00100000:1.0:1788869461.645496:0:3286:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94c702217100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3286:1875765421475072:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1788869461.645564:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869461.645609:0:11822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765421475072 00000100:00100000:0.0:1788869461.645617:0:11822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765421475072 00000100:00080000:1.0:1788869461.645651:0:5751:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788869461.645678:0:11822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1788869461.645688:0:11822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c83c688a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3286:x1875765421475072:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1788869461.645846:0:11822:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb size from disk: 13 -> 13 00002000:00010000:0.0:1788869461.645850:0:11822:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb mtime from disk: 1788869454 -> 1788869454 00002000:00010000:0.0:1788869461.645853:0:11822:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb atime from disk: 1788869454 -> 1788869454 00002000:00010000:0.0:1788869461.645855:0:11822:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb ctime from disk: 1788869454 -> 1788869454 00002000:00010000:0.0:1788869461.645857:0:11822:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb blocks from disk: 11 -> 11 00000100:00100000:0.0:1788869461.645900:0:11822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c83c688a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+6:3286:x1875765421475072:12345-0@lo:2:osp-syn-1-0.0 Request processed in 212us (335us total) trans 4294967324 rc 0/0 00000100:00100000:0.0:1788869461.645907:0:11822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1788869461.645918:0:3286:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967323 gen 2 00000004:00080000:1.0:1788869461.645925:0:3286:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967323 committed transno 4294967323 00000100:00100000:1.0:1788869461.645947:0:3286:0:(client.c:3156:ptlrpc_free_committed()) @@@ stopping search req@ffff94c702217100 x1875765421475072/t4294967324(4294967324) o2->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 440/432 e 0 to 0 dl 1788869477 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-1-0.0' uid:0 gid:0 projid:4294967295 00000004:00080000:1.0:1788869461.645958:0:3286:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94c702217100/2, rc 0, transno 4294967324 00000100:00100000:1.0:1788869461.645964:0:3286:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94c702217100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3286:1875765421475072:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1788869462.107393:0:3284:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788869462.107416:0:3284:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94c82ccfc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3284:1875765421475200:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788869462.107484:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869462.107547:0:6548:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765421475200 00000100:00100000:3.0:1788869462.107555:0:6548:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765421475200 00000100:00100000:3.0:1788869462.107602:0:6548:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1788869462.107611:0:6548:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c82ccfdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3284:x1875765421475200:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788869462.107647:0:6548:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788869462.107692:0:6548:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c82ccfdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3284:x1875765421475200:12345-0@lo:13:osp-pre-1-0.0 Request processed in 81us (208us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869462.107699:0:6548:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1788869462.107744:0:3284:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94c82ccfc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3284:1875765421475200:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788869462.108456:0:3285:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94c82ccfe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3285:1875765421475456:0@lo:400:kworker.0 00000100:00100000:3.0:1788869462.108490:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869462.108516:0:3285:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788869462.108522:0:3285:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94c82ccff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3285:1875765421475584:0@lo:400:kworker.0 00000100:00100000:3.0:1788869462.108545:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869462.108591:0:3284:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94c82ccfc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:121cd5bc-7f07-4cf7-8e2e-4356c89c0696:3284:1875765421475328:0@lo:400:kworker.0 00000100:00100000:3.0:1788869462.108637:0:3283:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94c82ced8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3283:1875765421475712:0@lo:400:kworker.0 00000100:00100000:0.0:1788869462.108859:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869462.108887:0:3284:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94c82ced9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3284:1875765421475840:0@lo:400:kworker.0 00000100:00100000:0.0:1788869462.108909:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869462.108945:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869462.110688:0:5749:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765421475328 00000100:00100000:3.0:1788869462.110701:0:5749:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765421475328 00000100:00100000:3.0:1788869462.110760:0:5749:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 273 00000100:00100000:3.0:1788869462.110779:0:5749:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c81f148450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:121cd5bc-7f07-4cf7-8e2e-4356c89c0696+19:3284:x1875765421475328:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788869462.110849:0:5749:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c81f148450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:121cd5bc-7f07-4cf7-8e2e-4356c89c0696+19:3284:x1875765421475328:12345-0@lo:400:kworker.0 Request processed in 71us (1988us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869462.110856:0:5749:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 273 00000100:00100000:2.0:1788869462.112741:0:5755:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765421475456 00000100:00100000:2.0:1788869462.112753:0:5755:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765421475456 00000100:00100000:2.0:1788869462.112881:0:5755:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765421475584 00000100:00100000:2.0:1788869462.112885:0:5755:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765421475584 00000100:00100000:2.0:1788869462.112904:0:5755:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765421475840 00000100:00100000:2.0:1788869462.112907:0:5755:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765421475840 00000100:00100000:2.0:1788869462.112922:0:5755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:2.0:1788869462.112930:0:5755:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c82ceda300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3285:x1875765421475456:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788869462.113001:0:5755:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c82ceda300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3285:x1875765421475456:12345-0@lo:400:kworker.0 Request processed in 72us (4510us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869462.113009:0:5755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:2.0:1788869462.113021:0:5755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:2.0:1788869462.113026:0:5755:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c835a17b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3285:x1875765421475584:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788869462.113051:0:5755:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c835a17b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3285:x1875765421475584:12345-0@lo:400:kworker.0 Request processed in 25us (4506us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869462.113057:0:5755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:2.0:1788869462.113069:0:5755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:2.0:1788869462.113074:0:5755:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c702214000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3284:x1875765421475840:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788869462.113099:0:5755:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c702214000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3284:x1875765421475840:12345-0@lo:400:kworker.0 Request processed in 25us (4189us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869462.113105:0:5755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00080000:2.0:1788869462.113121:0:5751:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788869462.113151:0:3285:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94c82ccff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3285:1875765421475584:0@lo:400:kworker.0 00000100:00100000:2.0:1788869462.113162:0:3285:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94c82ccfe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3285:1875765421475456:0@lo:400:kworker.0 00000100:00100000:2.0:1788869462.113210:0:7884:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765421475712 00000100:00100000:2.0:1788869462.113214:0:7884:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765421475712 00000100:00100000:2.0:1788869462.113246:0:7884:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1788869462.113337:0:7884:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c835a14380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3283:x1875765421475712:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788869462.113384:0:7884:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c835a14380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3283:x1875765421475712:12345-0@lo:400:kworker.0 Request processed in 49us (4438us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869462.113390:0:7884:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1788869462.113417:0:3283:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94c82ced8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3283:1875765421475712:0@lo:400:kworker.0 00000100:00080000:2.0:1788869462.113431:0:5751:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788869462.115733:0:3284:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94c82ced9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3284:1875765421475840:0@lo:400:kworker.0 00000100:00100000:0.0:1788869462.115775:0:3284:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94c82ccfc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:121cd5bc-7f07-4cf7-8e2e-4356c89c0696:3284:1875765421475328:0@lo:400:kworker.0 00000001:02000400:3.0:1788869462.166189:0:12618:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1c: Test automated attach using Project ID with manual HSM restore ========================================================== 08:11:00 (1788869460) 00010000:00010000:2.0:1788869462.427392:0:5742:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788869463.451669:0:7447:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788869463.469586:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1788869463.469634:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1788869463.469666:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1788869463.469742:0:5748:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765413116928 00000100:00100000:2.0:1788869463.469752:0:5748:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765413116928 00000100:00100000:2.0:1788869463.469801:0:5748:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 274 00000100:00100000:2.0:1788869463.469810:0:5748:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c81f149450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3cca3acf-4935-4d0d-9982-d5d931f1c86b+13:2348:x1875765413116928:12345-192.168.201.39@tcp:400:kworker.0 00000100:00100000:2.0:1788869463.469885:0:5748:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c81f149450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3cca3acf-4935-4d0d-9982-d5d931f1c86b+13:2348:x1875765413116928:12345-192.168.201.39@tcp:400:kworker.0 Request processed in 76us (309us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869463.469891:0:5748:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 274 00000100:00100000:3.0:1788869463.470049:0:6546:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765413117184 00000100:00100000:3.0:1788869463.470053:0:6546:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765413117184 00000100:00100000:3.0:1788869463.470105:0:6546:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 52 00000100:00100000:3.0:1788869463.470156:0:6546:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c702215880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2125b9b3-626e-4cbe-be83-fb446e976ce2+5:2348:x1875765413117184:12345-192.168.201.39@tcp:400:kworker.0 00000100:00100000:3.0:1788869463.470196:0:6546:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c702215880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2125b9b3-626e-4cbe-be83-fb446e976ce2+5:2348:x1875765413117184:12345-192.168.201.39@tcp:400:kworker.0 Request processed in 84us (561us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869463.470203:0:6546:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 52 00000100:00100000:0.0:1788869463.470373:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00080000:2.0:1788869463.470416:0:5751:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788869463.470688:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1788869463.470771:0:6547:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765413117312 00000100:00100000:3.0:1788869463.470775:0:6547:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765413117312 00000100:00100000:3.0:1788869463.470817:0:6547:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 53 00000100:00100000:3.0:1788869463.470824:0:6547:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c82cdc4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2125b9b3-626e-4cbe-be83-fb446e976ce2+7:2348:x1875765413117312:12345-192.168.201.39@tcp:400:kworker.0 00000100:00100000:3.0:1788869463.470867:0:6547:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c82cdc4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2125b9b3-626e-4cbe-be83-fb446e976ce2+7:2348:x1875765413117312:12345-192.168.201.39@tcp:400:kworker.0 Request processed in 44us (181us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869463.470874:0:6547:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 53 00000100:00080000:0.0:1788869463.470969:0:5751:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788869463.471038:0:5755:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765413117440 00000100:00100000:1.0:1788869463.471043:0:5755:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765413117440 00000100:00100000:0.0:1788869463.471138:0:5755:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765413117056 00000100:00100000:0.0:1788869463.471142:0:5755:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765413117056 00000100:00100000:0.0:1788869463.471164:0:5755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 102 00000100:00100000:0.0:1788869463.471170:0:5755:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c83513dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:10cd6f3c-009b-4acc-9ca5-e50cb17e412c+6:2348:x1875765413117440:12345-192.168.201.39@tcp:400:kworker.0 00000100:00100000:0.0:1788869463.471200:0:5755:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c83513dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:10cd6f3c-009b-4acc-9ca5-e50cb17e412c+6:2348:x1875765413117440:12345-192.168.201.39@tcp:400:kworker.0 Request processed in 31us (1533us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869463.471206:0:5755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 102 00000100:00100000:0.0:1788869463.471218:0:5755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 103 00000100:00100000:0.0:1788869463.471225:0:5755:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c702349500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2125b9b3-626e-4cbe-be83-fb446e976ce2+18:2348:x1875765413117056:12345-192.168.201.39@tcp:400:kworker.0 00000100:00100000:0.0:1788869463.471276:0:5755:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c702349500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2125b9b3-626e-4cbe-be83-fb446e976ce2+18:2348:x1875765413117056:12345-192.168.201.39@tcp:400:kworker.0 Request processed in 51us (903us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869463.471283:0:5755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 103 00000100:00080000:1.0:1788869463.471657:0:5751:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788869463.823135:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1788869463.823385:0:11820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765413117696 00000100:00100000:2.0:1788869463.823396:0:11820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765413117696 00000100:00100000:2.0:1788869463.823506:0:11820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 66 00000100:00100000:2.0:1788869463.823518:0:11820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c82c841880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:2125b9b3-626e-4cbe-be83-fb446e976ce2+18:12253:x1875765413117696:12345-192.168.201.39@tcp:35:umount.0 00000100:00100000:2.0:1788869463.824028:0:11820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c82c841880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:2125b9b3-626e-4cbe-be83-fb446e976ce2+19:12253:x1875765413117696:12345-192.168.201.39@tcp:35:umount.0 Request processed in 511us (900us total) trans 4294967521 rc 0/0 00000100:00100000:2.0:1788869463.824037:0:11820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 66 00000100:00100000:0.0:1788869463.826576:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1788869463.826633:0:5758:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765413117952 00000100:00100000:2.0:1788869463.826653:0:5758:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765413117952 00000100:00100000:2.0:1788869463.826711:0:5758:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 67 00000100:00100000:2.0:1788869463.826722:0:5758:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c83fbb2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2125b9b3-626e-4cbe-be83-fb446e976ce2+19:12253:x1875765413117952:12345-192.168.201.39@tcp:35:umount.0 00000100:00100000:2.0:1788869463.827269:0:5758:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c83fbb2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2125b9b3-626e-4cbe-be83-fb446e976ce2+20:12253:x1875765413117952:12345-192.168.201.39@tcp:35:umount.0 Request processed in 526us (675us total) trans 4294967522 rc 0/0 00000100:00100000:2.0:1788869463.827280:0:5758:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 67 00000100:00100000:0.0:1788869463.829941:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1788869463.830285:0:11820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765413118208 00000100:00100000:2.0:1788869463.830295:0:11820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765413118208 00000100:00100000:2.0:1788869463.830408:0:11820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 68 00000100:00100000:2.0:1788869463.830420:0:11820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c81876b450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:2125b9b3-626e-4cbe-be83-fb446e976ce2+20:12253:x1875765413118208:12345-192.168.201.39@tcp:35:umount.0 00000100:00100000:2.0:1788869463.830837:0:11820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c81876b450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:2125b9b3-626e-4cbe-be83-fb446e976ce2+21:12253:x1875765413118208:12345-192.168.201.39@tcp:35:umount.0 Request processed in 417us (902us total) trans 4294967523 rc 0/0 00000100:00100000:2.0:1788869463.830846:0:11820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 68 00000100:00100000:0.0:1788869463.833125:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1788869463.834361:0:5758:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765413118464 00000100:00100000:2.0:1788869463.834372:0:5758:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765413118464 00000100:00100000:2.0:1788869463.834434:0:5758:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 69 00000100:00100000:2.0:1788869463.834445:0:5758:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c83fbb3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2125b9b3-626e-4cbe-be83-fb446e976ce2+21:12253:x1875765413118464:12345-192.168.201.39@tcp:35:umount.0 00000100:00100000:2.0:1788869463.834756:0:5758:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c83fbb3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2125b9b3-626e-4cbe-be83-fb446e976ce2+22:12253:x1875765413118464:12345-192.168.201.39@tcp:35:umount.0 Request processed in 312us (1637us total) trans 4294967524 rc 0/0 00000100:00100000:2.0:1788869463.834765:0:5758:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 69 00000100:00100000:0.0:1788869463.838202:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1788869463.838366:0:7448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765413118592 00000100:00100000:2.0:1788869463.838377:0:7448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765413118592 00000100:00100000:0.0:1788869463.838387:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1788869463.838484:0:7448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765413118848 00000100:00100000:2.0:1788869463.838488:0:7448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765413118848 00000100:00100000:0.0:1788869463.838498:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1788869463.838585:0:7448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765413118720 00000100:00100000:2.0:1788869463.838589:0:7448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765413118720 00000100:00100000:2.0:1788869463.838609:0:7448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 16 00000100:00100000:0.0:1788869463.838610:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1788869463.838624:0:7448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c83fbb2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:3cca3acf-4935-4d0d-9982-d5d931f1c86b+15:2347:x1875765413118592:12345-192.168.201.39@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1788869463.838633:0:6544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765413119232 00000100:00100000:0.0:1788869463.838636:0:6544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765413119232 00010000:00010000:2.0:1788869463.838639:0:7448:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788869463.838658:0:7448:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff94c818d1e800/0x3d2d1916761d640b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801000000000 nid: 192.168.201.39@tcp remote: 0x375c01024903576e expref: 15 pid: 5748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788869463.838664:0:6544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 72 00000100:00100000:0.0:1788869463.838669:0:6544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c83661d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2125b9b3-626e-4cbe-be83-fb446e976ce2+7:2344:x1875765413119232:12345-192.168.201.39@tcp:9:umount.0 00010000:00010000:2.0:1788869463.838676:0:7448:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000020:00000080:0.0:1788869463.838691:0:6544:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x3d2d1916761d69ad 00000020:00010000:0.0:1788869463.838699:0:6544:0:(genops.c:1942:obd_stale_export_put()) Put export ffff94c834d63000: total 0 00000100:00080000:0.0:1788869463.838703:0:6544:0:(import.c:65:import_set_state_nolock()) ffff94c834d60000 : changing import state from FULL to CLOSED 00000100:00100000:2.0:1788869463.838733:0:7448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c83fbb2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:3cca3acf-4935-4d0d-9982-d5d931f1c86b+14:2347:x1875765413118592:12345-192.168.201.39@tcp:103:ldlm_bl.0 Request processed in 111us (540us total) trans 0 rc 0/0 00000001:00000004:0.0:1788869463.838736:0:6544:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967324 00000100:00100000:2.0:1788869463.838740:0:7448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 16 00000100:00100000:2.0:1788869463.838755:0:7448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 17 00000100:00100000:2.0:1788869463.838761:0:7448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c810e6b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:3cca3acf-4935-4d0d-9982-d5d931f1c86b+13:2347:x1875765413118848:12345-192.168.201.39@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788869463.838768:0:7448:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788869463.838777:0:7448:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff94c805038e00/0x3d2d1916761d6650 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 192.168.201.39@tcp remote: 0x375c010249035839 expref: 13 pid: 5749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869463.838785:0:7448:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788869463.838801:0:7448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c810e6b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:3cca3acf-4935-4d0d-9982-d5d931f1c86b+12:2347:x1875765413118848:12345-192.168.201.39@tcp:103:ldlm_bl.0 Request processed in 41us (415us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869463.838807:0:7448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 17 00000100:00100000:2.0:1788869463.838818:0:7448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 18 00000100:00100000:2.0:1788869463.838824:0:7448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c83661c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:3cca3acf-4935-4d0d-9982-d5d931f1c86b+11:2347:x1875765413118720:12345-192.168.201.39@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788869463.838832:0:7448:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788869463.838839:0:7448:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff94c800031000/0x3d2d1916761d63d3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 192.168.201.39@tcp remote: 0x375c010249035736 expref: 11 pid: 5750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869463.838848:0:7448:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788869463.838869:0:7448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c83661c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:3cca3acf-4935-4d0d-9982-d5d931f1c86b+10:2347:x1875765413118720:12345-192.168.201.39@tcp:103:ldlm_bl.0 Request processed in 45us (371us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869463.838875:0:7448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 18 00000020:00010000:2.0:1788869463.838913:0:5743:0:(genops.c:1928:obd_stale_export_get()) Get export ffff94c834d63000: total 0 00010000:00010000:2.0:1788869463.838941:0:5743:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff94c834d63000, canceled 0 locks, left on hash table 2. 00000100:00100000:0.0:1788869463.838979:0:6544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c83661d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2125b9b3-626e-4cbe-be83-fb446e976ce2+5:2344:x1875765413119232:12345-192.168.201.39@tcp:9:umount.0 Request processed in 308us (367us total) trans 0 rc 0/0 00010000:00010000:2.0:1788869463.838981:0:5743:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a046f8e3/0x3d2d1916761d6d57 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.201.39@tcp remote: 0x375c010249035a1c expref: 5 pid: 6544 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788869463.838986:0:6544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 72 00010000:00010000:2.0:1788869463.839009:0:5743:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008c0ee66d/0x3d2d1916761d73fc lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.201.39@tcp remote: 0x375c010249035bf1 expref: 3 pid: 7884 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869463.839039:0:5743:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff94c834d63000, canceled 2 locks, left on hash table 0. 00010000:00010000:2.0:1788869463.839050:0:5743:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788869463.839052:0:5743:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788869463.839053:0:5743:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788869463.842138:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1788869463.842265:0:11822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765413119360 00000100:00100000:3.0:1788869463.842275:0:11822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765413119360 00000100:00100000:3.0:1788869463.842387:0:11822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 73 00000100:00100000:3.0:1788869463.842399:0:11822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c83661ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:2125b9b3-626e-4cbe-be83-fb446e976ce2+5:2344:x1875765413119360:12345-192.168.201.39@tcp:9:umount.0 00000020:00000080:3.0:1788869463.842429:0:11822:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x3d2d1916761d6745 00000100:00080000:3.0:1788869463.842439:0:11822:0:(import.c:65:import_set_state_nolock()) ffff94c810db1800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1788869463.842529:0:11822:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967310 00000100:00100000:3.0:1788869463.842772:0:11822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c83661ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:2125b9b3-626e-4cbe-be83-fb446e976ce2+2:2344:x1875765413119360:12345-192.168.201.39@tcp:9:umount.0 Request processed in 376us (641us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869463.842780:0:11822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 73 00010000:00010000:2.0:1788869463.845837:0:5742:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788869463.850911:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1788869463.850988:0:5755:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765413120384 00000100:00100000:2.0:1788869463.850998:0:5755:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765413120384 00000100:00100000:2.0:1788869463.851059:0:5755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 242 00000100:00100000:2.0:1788869463.851069:0:5755:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c83661df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2125b9b3-626e-4cbe-be83-fb446e976ce2+22:2344:x1875765413120384:12345-192.168.201.39@tcp:39:umount.0 00000020:00000080:2.0:1788869463.851102:0:5755:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x3d2d1916761d63e1 00000020:00010000:2.0:1788869463.851115:0:5755:0:(genops.c:1942:obd_stale_export_put()) Put export ffff94c83cbf4000: total 0 00000100:00080000:2.0:1788869463.851119:0:5755:0:(import.c:65:import_set_state_nolock()) ffff94c834da8800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1788869463.851147:0:5755:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967524 00000100:00100000:2.0:1788869463.851528:0:5755:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c83661df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2125b9b3-626e-4cbe-be83-fb446e976ce2+21:2344:x1875765413120384:12345-192.168.201.39@tcp:39:umount.0 Request processed in 461us (627us total) trans 4294967525 rc 0/0 00000100:00100000:2.0:1788869463.851534:0:5755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 242 00000020:00010000:0.0:1788869463.851612:0:7447:0:(genops.c:1928:obd_stale_export_get()) Get export ffff94c83cbf4000: total 0 00010000:00010000:0.0:1788869463.851647:0:7447:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff94c83cbf4000, canceled 0 locks, left on hash table 13. 00010000:00010000:0.0:1788869463.851671:0:7447:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff94c81a585400) 00010000:00010000:0.0:1788869463.851673:0:7447:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1788869463.851679:0:7447:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94c8421f3a00/0x3d2d1916761d671b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.39@tcp remote: 0x375c010249035863 expref: 20 pid: 5756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869463.851692:0:7447:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff94c803990500) 00010000:00010000:0.0:1788869463.851694:0:7447:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788869463.851696:0:7447:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94c805038a00/0x3d2d1916761d6c38 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.39@tcp remote: 0x375c0102490359cf expref: 19 pid: 5757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869463.851713:0:7447:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff94c81a585c00) 00010000:00010000:0.0:1788869463.851715:0:7447:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788869463.851717:0:7447:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94c818d1f000/0x3d2d1916761d73bd lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.39@tcp remote: 0x375c010249035bdc expref: 18 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869463.851726:0:7447:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff94c802f3fd00) 00010000:00010000:0.0:1788869463.851727:0:7447:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1788869463.851729:0:7447:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94c805039600/0x3d2d1916761d6dd5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.39@tcp remote: 0x375c010249035a3f expref: 17 pid: 5757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869463.851736:0:7447:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff94c819394200) 00010000:00010000:0.0:1788869463.851738:0:7447:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788869463.851740:0:7447:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504cc00/0x3d2d1916761d66c7 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.39@tcp remote: 0x375c01024903584e expref: 16 pid: 5757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869463.851750:0:7447:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff94c81a585400) 00010000:00010000:0.0:1788869463.851751:0:7447:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1788869463.851753:0:7447:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94c805039c00/0x3d2d1916761d6a0f lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.39@tcp remote: 0x375c01024903593c expref: 15 pid: 5757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869463.851760:0:7447:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff94c81a585c00) 00010000:00010000:0.0:1788869463.851762:0:7447:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:0.0:1788869463.851764:0:7447:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94c818d1e000/0x3d2d1916761d73e7 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.39@tcp remote: 0x375c010249035bea expref: 14 pid: 5757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869463.851770:0:7447:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff94c819394300) 00010000:00010000:0.0:1788869463.851771:0:7447:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788869463.851776:0:7447:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504d200/0x3d2d1916761d6db9 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.39@tcp remote: 0x375c010249035a38 expref: 13 pid: 5756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869463.851784:0:7447:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff94c803990500) 00010000:00010000:0.0:1788869463.851786:0:7447:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788869463.851788:0:7447:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94c83fde6600/0x3d2d1916761d6d18 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.39@tcp remote: 0x375c010249035a07 expref: 12 pid: 5757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869463.851795:0:7447:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff94c802f3fd00) 00010000:00010000:0.0:1788869463.851796:0:7447:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1788869463.851798:0:7447:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94c805039400/0x3d2d1916761d70b4 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.39@tcp remote: 0x375c010249035b11 expref: 11 pid: 5757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869463.851805:0:7447:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff94c81a585c00) 00010000:00010000:0.0:1788869463.851807:0:7447:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788869463.851809:0:7447:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94c83fde6e00/0x3d2d1916761d72dd lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.39@tcp remote: 0x375c010249035ba4 expref: 10 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869463.851816:0:7447:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff94c819394f00) 00010000:00010000:0.0:1788869463.851818:0:7447:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788869463.851820:0:7447:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504dc00/0x3d2d1916761d66ab lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.39@tcp remote: 0x375c010249035847 expref: 9 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869463.851827:0:7447:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff94c803990500) 00010000:00010000:0.0:1788869463.851829:0:7447:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:0.0:1788869463.851831:0:7447:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94c81a583e00/0x3d2d1916761d6d42 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.39@tcp remote: 0x375c010249035a15 expref: 8 pid: 5757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869463.851838:0:7447:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff94c83cbf4000, canceled 13 locks, left on hash table 0. 00010000:00010000:0.0:1788869463.851849:0:7447:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788869463.851850:0:7447:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788869463.851852:0:7447:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788869464.155684:0:3286:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788869464.155709:0:3286:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94c835a15180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3286:1875765421475968:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788869464.155776:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869464.155891:0:6548:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765421475968 00000100:00100000:3.0:1788869464.155898:0:6548:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765421475968 00000100:00100000:3.0:1788869464.155959:0:6548:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1788869464.155968:0:6548:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c83c68b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3286:x1875765421475968:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788869464.156011:0:6548:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788869464.156059:0:6548:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c83c68b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3286:x1875765421475968:12345-0@lo:13:osp-pre-0-0.0 Request processed in 91us (281us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869464.156066:0:6548:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1788869464.156107:0:3286:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94c835a15180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3286:1875765421475968:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1788869464.156336:0:5751:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788869464.342899:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1788869464.342946:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1788869464.342993:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1788869464.343499:0:5740:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765413120512 00000100:00100000:1.0:1788869464.343568:0:5740:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765413120512 00000100:00100000:1.0:1788869464.343749:0:5740:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765413120640 00000100:00100000:1.0:1788869464.343753:0:5740:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765413120640 00000100:00100000:0.0:1788869464.345624:0:5741:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765413120768 00000100:00100000:0.0:1788869464.345634:0:5741:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765413120768 00000100:00100000:0.0:1788869464.345686:0:5741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 19 00000100:00100000:0.0:1788869464.345696:0:5741:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c83661e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3cca3acf-4935-4d0d-9982-d5d931f1c86b+12:2346:x1875765413120512:12345-192.168.201.39@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788869464.345713:0:5741:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788869464.345734:0:5741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff94c80153ae00/0x3d2d1916761d64b3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 192.168.201.39@tcp remote: 0x375c010249035783 expref: 12 pid: 5748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869464.345753:0:5741:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788869464.345809:0:5741:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c83661e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3cca3acf-4935-4d0d-9982-d5d931f1c86b+11:2346:x1875765413120512:12345-192.168.201.39@tcp:103:ldlm_bl.0 Request processed in 115us (2918us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869464.345829:0:5741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 19 00000100:00100000:0.0:1788869464.345847:0:5741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 20 00000100:00100000:0.0:1788869464.345854:0:5741:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c808ee5c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3cca3acf-4935-4d0d-9982-d5d931f1c86b+10:2345:x1875765413120640:12345-192.168.201.39@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788869464.345864:0:5741:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788869464.345874:0:5741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff94c80153be00/0x3d2d1916761d64ba lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 192.168.201.39@tcp remote: 0x375c0102490357ad expref: 10 pid: 5749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869464.345883:0:5741:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788869464.345901:0:5741:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c808ee5c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3cca3acf-4935-4d0d-9982-d5d931f1c86b+9:2345:x1875765413120640:12345-192.168.201.39@tcp:103:ldlm_bl.0 Request processed in 48us (2955us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869464.345926:0:5741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 20 00000100:00100000:0.0:1788869464.345972:0:5741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 21 00000100:00100000:0.0:1788869464.345979:0:5741:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c83661ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3cca3acf-4935-4d0d-9982-d5d931f1c86b+8:2345:x1875765413120768:12345-192.168.201.39@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788869464.345987:0:5741:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788869464.345997:0:5741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff94c81a582c00/0x3d2d1916761d6649 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 192.168.201.39@tcp remote: 0x375c010249035832 expref: 8 pid: 5748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869464.346006:0:5741:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788869464.346024:0:5741:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c83661ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3cca3acf-4935-4d0d-9982-d5d931f1c86b+7:2345:x1875765413120768:12345-192.168.201.39@tcp:103:ldlm_bl.0 Request processed in 46us (3031us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869464.346031:0:5741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 21 00000100:00100000:0.0:1788869464.355238:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1788869464.355392:0:5756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765413121024 00000100:00100000:1.0:1788869464.355403:0:5756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765413121024 00000100:00100000:1.0:1788869464.355580:0:5756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 243 00000100:00100000:1.0:1788869464.355591:0:5756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c83661c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:10cd6f3c-009b-4acc-9ca5-e50cb17e412c+6:2344:x1875765413121024:12345-192.168.201.39@tcp:39:umount.0 00000020:00000080:1.0:1788869464.355632:0:5756:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x3d2d1916761d64c8 00000020:00010000:1.0:1788869464.355643:0:5756:0:(genops.c:1942:obd_stale_export_put()) Put export ffff94c83c6a2000: total 0 00000100:00080000:1.0:1788869464.355647:0:5756:0:(import.c:65:import_set_state_nolock()) ffff94c83c6a0800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1788869464.355678:0:5756:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967525 00000020:00010000:2.0:1788869464.355920:0:5743:0:(genops.c:1928:obd_stale_export_get()) Get export ffff94c83c6a2000: total 0 00010000:00010000:2.0:1788869464.355924:0:5743:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788869464.355962:0:5743:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff94c83c6a2000, canceled 0 locks, left on hash table 1. 00010000:00010000:2.0:1788869464.355995:0:5743:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff94c819394300) 00010000:00010000:2.0:1788869464.355999:0:5743:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788869464.356007:0:5743:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94c818d1fc00/0x3d2d1916761d740a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.39@tcp remote: 0x375c010249035bf8 expref: 6 pid: 5757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869464.356031:0:5743:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff94c83c6a2000, canceled 1 locks, left on hash table 0. 00010000:00010000:2.0:1788869464.356041:0:5743:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788869464.356043:0:5743:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788869464.356045:0:5743:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788869464.357225:0:5756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c83661c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:10cd6f3c-009b-4acc-9ca5-e50cb17e412c+3:2344:x1875765413121024:12345-192.168.201.39@tcp:39:umount.0 Request processed in 1633us (1992us total) trans 4294967526 rc 0/0 00000100:00100000:1.0:1788869464.357236:0:5756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 243 00000100:00100000:0.0:1788869464.376140:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1788869464.376398:0:5750:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765413121280 00000100:00100000:2.0:1788869464.376409:0:5750:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765413121280 00000100:00100000:2.0:1788869464.376520:0:5750:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 275 00000100:00100000:2.0:1788869464.376531:0:5750:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c81f148850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3cca3acf-4935-4d0d-9982-d5d931f1c86b+7:2344:x1875765413121280:12345-192.168.201.39@tcp:251:umount.0 00000020:00000080:2.0:1788869464.376579:0:5750:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x3d2d1916761d63be 00000020:00010000:2.0:1788869464.376586:0:5750:0:(genops.c:1942:obd_stale_export_put()) Put export ffff94c810e51000: total 0 00000100:00080000:2.0:1788869464.376591:0:5750:0:(import.c:65:import_set_state_nolock()) ffff94c810e53000 : changing import state from FULL to CLOSED 00000100:00100000:2.0:1788869464.376671:0:5750:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c81f148850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3cca3acf-4935-4d0d-9982-d5d931f1c86b+3:2344:x1875765413121280:12345-192.168.201.39@tcp:251:umount.0 Request processed in 141us (538us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869464.376679:0:5750:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 275 00000020:00010000:3.0:1788869464.376739:0:5742:0:(genops.c:1928:obd_stale_export_get()) Get export ffff94c810e51000: total 0 00010000:00010000:3.0:1788869464.376786:0:5742:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff94c810e51000, canceled 0 locks, left on hash table 1. 00010000:00010000:3.0:1788869464.376827:0:5742:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff94c800031400/0x3d2d1916761d6412 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801000000000 nid: 192.168.201.39@tcp remote: 0x375c010249035775 expref: 2 pid: 5748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869464.376845:0:5742:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff94c810e51000, canceled 1 locks, left on hash table 0. 00000020:00000080:3.0:1788869464.376856:0:5742:0:(genops.c:906:class_export_put()) final put ffff94c810e51000/3cca3acf-4935-4d0d-9982-d5d931f1c86b 00010000:00010000:3.0:1788869464.376868:0:5742:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788869464.376870:0:5742:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788869464.376872:0:5742:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1788869464.377124:0:472:0:(genops.c:865:class_export_destroy()) destroying export ffff94c810e51000/3cca3acf-4935-4d0d-9982-d5d931f1c86b for MGS 00000020:00000080:1.0:1788869464.377164:0:472:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff94c810e53000 for MGS 00010000:00010000:3.0:1788869464.475442:0:7447:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1788869465.392851:0:12814:0:(tgt_mount.c:2192:server_umount_begin()) umount -f 00000020:01000004:3.0:1788869465.407475:0:12814:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-MDT0000 00010000:00010000:3.0:1788869465.407523:0:12814:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.139@tcp lock: ffff94c83504da00/0x3d2d1916761d647b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x3d2d1916761d6482 expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869465.407556:0:12814:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.139@tcp lock: ffff94c83504da00/0x3d2d1916761d647b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x3d2d1916761d6482 expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869465.407563:0:12814:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.139@tcp lock: ffff94c83504da00/0x3d2d1916761d647b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x3d2d1916761d6482 expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869465.407571:0:12814:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.139@tcp lock: ffff94c83504da00/0x3d2d1916761d647b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x3d2d1916761d6482 expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869465.407593:0:12814:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1788869465.407599:0:12814:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:3.0:1788869465.407624:0:12814:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1788869465.407628:0:12814:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 3 00000100:00080000:3.0:1788869465.407633:0:12814:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00080000:3.0:1788869465.407658:0:12814:0:(import.c:65:import_set_state_nolock()) ffff94c81f218000 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00010000:00010000:2.0:1788869465.407875:0:5743:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788869465.407882:0:5743:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.139@tcp lock: ffff94c83504da00/0x3d2d1916761d647b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0x3d2d1916761d6482 expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869465.407890:0:5743:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94c83504da00 already unused, calling callback (ffffffffc1ce9c20) 10000000:00010000:2.0:1788869465.407893:0:5743:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.139@tcp lock: ffff94c83504da00/0x3d2d1916761d647b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0x3d2d1916761d6482 expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869465.407911:0:5743:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.139@tcp lock: ffff94c83504da00/0x3d2d1916761d647b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1008400000000 nid: local remote: 0x3d2d1916761d6482 expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788869465.407918:0:5743:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.139@tcp lock: ffff94c83504da00/0x3d2d1916761d647b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1009400000000 nid: local remote: 0x3d2d1916761d6482 expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788869465.407923:0:5743:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1788869465.407925:0:5743:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:2.0:1788869465.407927:0:5743:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:2.0:1788869465.407951:0:5743:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.139@tcp lock: ffff94c83504da00/0x3d2d1916761d647b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x3d2d1916761d6482 expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869465.407958:0:5743:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788869465.407987:0:5743:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.139@tcp lock: ffff94c83504da00/0x3d2d1916761d647b lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x3d2d1916761d6482 expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869465.407995:0:5743:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.139@tcp lock: ffff94c83504da00/0x3d2d1916761d647b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x3d2d1916761d6482 expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869465.408006:0:5743:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788869465.408008:0:5743:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788869465.408010:0:5743:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788869465.408050:0:3286:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94c835154380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:121cd5bc-7f07-4cf7-8e2e-4356c89c0696:3286:1875765421476224:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788869465.408110:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869465.408244:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765421476224 00000100:00100000:2.0:1788869465.408282:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765421476224 00000100:00100000:2.0:1788869465.408342:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1788869465.408351:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c835a15500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:121cd5bc-7f07-4cf7-8e2e-4356c89c0696+19:3286:x1875765421476224:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788869465.408363:0:5788:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788869465.408377:0:5788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff94c80153a800/0x3d2d1916761d6482 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x3d2d1916761d647b expref: 19 pid: 5748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869465.408399:0:5788:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788869465.408527:0:3286:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94c835154380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:121cd5bc-7f07-4cf7-8e2e-4356c89c0696:3286:1875765421476224:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788869465.408632:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c835a15500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:121cd5bc-7f07-4cf7-8e2e-4356c89c0696+18:3286:x1875765421476224:12345-0@lo:103:ldlm_bl.0 Request processed in 225us (463us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869465.408642:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1788869465.408761:0:3282:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94c835a15180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3282:1875765421476096:0@lo:39:umount.0 00000100:00100000:1.0:1788869465.408794:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869465.408859:0:5755:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765421476096 00000100:00100000:2.0:1788869465.408863:0:5755:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765421476096 00000100:00100000:2.0:1788869465.408927:0:5755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 244 00000100:00100000:2.0:1788869465.408935:0:5755:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c83c68a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3282:x1875765421476096:12345-0@lo:39:umount.0 00000020:00000080:2.0:1788869465.408955:0:5755:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x3d2d1916761d61cd 00000100:00080000:2.0:1788869465.408963:0:5755:0:(import.c:65:import_set_state_nolock()) ffff94c8349db800 : changing import state from FULL to CLOSED 00000100:00100000:2.0:1788869465.409020:0:5755:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c83c68a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+1:3282:x1875765421476096:12345-0@lo:39:umount.0 Request processed in 86us (225us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869465.409027:0:5755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 244 00000020:00000080:2.0:1788869465.409032:0:5755:0:(genops.c:906:class_export_put()) final put ffff94c8349df800/lustre-MDT0000-lwp-MDT0000_UUID 00010000:00010000:0.0:1788869465.409076:0:5742:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1788869465.409084:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff94c8349df800/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000 00000020:00000080:0.0:1788869465.409123:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff94c8349db800 for lustre-MDT0000 00000100:00080000:1.0:1788869465.409172:0:3282:0:(import.c:65:import_set_state_nolock()) ffff94c81f218000 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:1.0:1788869465.409189:0:3282:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94c835a15180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3282:1875765421476096:0@lo:39:umount.0 00000100:00080000:0.0:1788869465.409238:0:12814:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1788869465.409241:0:12814:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:0.0:1788869465.409245:0:12814:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:0.0:1788869465.410131:0:12814:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.139@tcp lock: ffff94c818d1ea00/0x3d2d1916761d6489 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x3d2d1916761d6490 expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869465.410141:0:12814:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.139@tcp lock: ffff94c818d1ea00/0x3d2d1916761d6489 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x3d2d1916761d6490 expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869465.410159:0:12814:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.139@tcp lock: ffff94c818d1ea00/0x3d2d1916761d6489 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0x3d2d1916761d6490 expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869465.410166:0:12814:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.139@tcp lock: ffff94c818d1ea00/0x3d2d1916761d6489 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0x3d2d1916761d6490 expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869465.410181:0:12814:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788869465.410186:0:12814:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.139@tcp lock: ffff94c81a583800/0x3d2d1916761d6378 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3d2d1916761d637f expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869465.410193:0:12814:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.139@tcp lock: ffff94c81a583800/0x3d2d1916761d6378 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x3d2d1916761d637f expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869465.410200:0:12814:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.139@tcp lock: ffff94c81a583800/0x3d2d1916761d6378 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x3d2d1916761d637f expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869465.410206:0:12814:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.139@tcp lock: ffff94c81a583800/0x3d2d1916761d6378 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x3d2d1916761d637f expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869465.410218:0:12814:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1788869465.410224:0:12814:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.139@tcp lock: ffff94c81a583a00/0x3d2d1916761d6673 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x3d2d1916761d667a expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869465.410230:0:12814:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.139@tcp lock: ffff94c81a583a00/0x3d2d1916761d6673 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x3d2d1916761d667a expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869465.410236:0:12814:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.139@tcp lock: ffff94c81a583a00/0x3d2d1916761d6673 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x3d2d1916761d667a expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869465.410268:0:12814:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.139@tcp lock: ffff94c81a583a00/0x3d2d1916761d6673 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x3d2d1916761d667a expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869465.410281:0:12814:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:0.0:1788869465.410299:0:5742:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1788869465.410304:0:5742:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.139@tcp lock: ffff94c818d1ea00/0x3d2d1916761d6489 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0x3d2d1916761d6490 expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869465.410312:0:5742:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94c818d1ea00 already unused, calling callback (ffffffffc1ce9c20) 10000000:00010000:0.0:1788869465.410316:0:5742:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.139@tcp lock: ffff94c818d1ea00/0x3d2d1916761d6489 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0x3d2d1916761d6490 expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869465.410323:0:5742:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.139@tcp lock: ffff94c818d1ea00/0x3d2d1916761d6489 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1008400000000 nid: local remote: 0x3d2d1916761d6490 expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788869465.410330:0:5742:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.139@tcp lock: ffff94c818d1ea00/0x3d2d1916761d6489 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1009400000000 nid: local remote: 0x3d2d1916761d6490 expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788869465.410336:0:5742:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1788869465.410338:0:5742:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0000: stopping, won't requeue 00010000:00010000:0.0:1788869465.410353:0:5742:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.139@tcp lock: ffff94c818d1ea00/0x3d2d1916761d6489 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x3d2d1916761d6490 expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869465.410359:0:5742:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788869465.410376:0:5742:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.139@tcp lock: ffff94c818d1ea00/0x3d2d1916761d6489 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x3d2d1916761d6490 expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869465.410383:0:5742:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.139@tcp lock: ffff94c818d1ea00/0x3d2d1916761d6489 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x3d2d1916761d6490 expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869465.410403:0:5742:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788869465.410407:0:5742:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.139@tcp lock: ffff94c81a583800/0x3d2d1916761d6378 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x3d2d1916761d637f expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869465.410412:0:5742:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94c81a583800 already unused, calling callback (ffffffffc1ce9c20) 10000000:00010000:0.0:1788869465.410415:0:5742:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.139@tcp lock: ffff94c81a583800/0x3d2d1916761d6378 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x3d2d1916761d637f expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869465.410422:0:5742:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.139@tcp lock: ffff94c81a583800/0x3d2d1916761d6378 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x3d2d1916761d637f expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788869465.410427:0:5742:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.139@tcp lock: ffff94c81a583800/0x3d2d1916761d6378 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x3d2d1916761d637f expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788869465.410432:0:5742:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:0.0:1788869465.410434:0:5742:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 10000000:01000000:0.0:1788869465.410436:0:5742:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:0.0:1788869465.410448:0:5742:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.139@tcp lock: ffff94c81a583800/0x3d2d1916761d6378 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x3d2d1916761d637f expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869465.410454:0:5742:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788869465.410460:0:5742:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.139@tcp lock: ffff94c81a583800/0x3d2d1916761d6378 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x3d2d1916761d637f expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869465.410467:0:5742:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.139@tcp lock: ffff94c81a583800/0x3d2d1916761d6378 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x3d2d1916761d637f expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869465.410478:0:5742:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788869465.410481:0:5742:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.139@tcp lock: ffff94c81a583a00/0x3d2d1916761d6673 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x3d2d1916761d667a expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869465.410492:0:5742:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94c81a583a00 already unused, calling callback (ffffffffc1ce9c20) 10000000:00010000:0.0:1788869465.410496:0:5742:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.139@tcp lock: ffff94c81a583a00/0x3d2d1916761d6673 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x3d2d1916761d667a expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869465.410502:0:5742:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.139@tcp lock: ffff94c81a583a00/0x3d2d1916761d6673 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x3d2d1916761d667a expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788869465.410508:0:5742:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.139@tcp lock: ffff94c81a583a00/0x3d2d1916761d6673 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x3d2d1916761d667a expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788869465.410513:0:5742:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:0.0:1788869465.410515:0:5742:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:0.0:1788869465.410517:0:5742:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:0.0:1788869465.410529:0:5742:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.139@tcp lock: ffff94c81a583a00/0x3d2d1916761d6673 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x3d2d1916761d667a expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869465.410535:0:5742:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788869465.410547:0:5742:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.139@tcp lock: ffff94c81a583a00/0x3d2d1916761d6673 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x3d2d1916761d667a expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869465.410555:0:5742:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.139@tcp lock: ffff94c81a583a00/0x3d2d1916761d6673 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x3d2d1916761d667a expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869465.410564:0:5742:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788869465.410565:0:5742:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788869465.410567:0:5742:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788869465.410578:0:3284:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94c83661ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:121cd5bc-7f07-4cf7-8e2e-4356c89c0696:3284:1875765421476480:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788869465.410610:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869465.410639:0:3284:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788869465.410650:0:3284:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94c83661e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:121cd5bc-7f07-4cf7-8e2e-4356c89c0696:3284:1875765421476352:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788869465.410671:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869465.410692:0:3285:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94c83661f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:121cd5bc-7f07-4cf7-8e2e-4356c89c0696:3285:1875765421476608:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788869465.410711:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869465.410737:0:5741:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765421476480 00000100:00100000:0.0:1788869465.410742:0:5741:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765421476480 00000100:00100000:0.0:1788869465.410765:0:5741:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765421476352 00000100:00100000:0.0:1788869465.410768:0:5741:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765421476352 00000100:00100000:0.0:1788869465.410782:0:5741:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765421476608 00000100:00100000:0.0:1788869465.410784:0:5741:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765421476608 00000100:00100000:0.0:1788869465.410797:0:5741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1788869465.410803:0:5741:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c83661e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:121cd5bc-7f07-4cf7-8e2e-4356c89c0696+20:3284:x1875765421476480:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788869465.410812:0:5741:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788869465.410821:0:5741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff94c80153b600/0x3d2d1916761d637f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x3d2d1916761d6378 expref: 20 pid: 5749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869465.410833:0:5741:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788869465.410859:0:5741:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c83661e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:121cd5bc-7f07-4cf7-8e2e-4356c89c0696+19:3284:x1875765421476480:12345-0@lo:103:ldlm_bl.0 Request processed in 55us (249us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869465.410865:0:5741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1788869465.410877:0:5741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1788869465.410882:0:5741:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c83661d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:121cd5bc-7f07-4cf7-8e2e-4356c89c0696+18:3284:x1875765421476352:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788869465.410889:0:5741:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788869465.410897:0:5741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff94c83504de00/0x3d2d1916761d6490 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x3d2d1916761d6489 expref: 18 pid: 5750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869465.410905:0:5741:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788869465.410923:0:5741:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c83661d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:121cd5bc-7f07-4cf7-8e2e-4356c89c0696+17:3284:x1875765421476352:12345-0@lo:103:ldlm_bl.0 Request processed in 41us (251us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869465.410934:0:5741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1788869465.410944:0:5741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1788869465.410950:0:5741:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c83661fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:121cd5bc-7f07-4cf7-8e2e-4356c89c0696+16:3285:x1875765421476608:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788869465.410957:0:5741:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788869465.410964:0:5741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff94c81a582000/0x3d2d1916761d667a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x3d2d1916761d6673 expref: 16 pid: 5749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869465.410973:0:5741:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788869465.410996:0:5741:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c83661fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:121cd5bc-7f07-4cf7-8e2e-4356c89c0696+15:3285:x1875765421476608:12345-0@lo:103:ldlm_bl.0 Request processed in 46us (284us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869465.411002:0:5741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1788869465.411025:0:3285:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94c83661f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:121cd5bc-7f07-4cf7-8e2e-4356c89c0696:3285:1875765421476608:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788869465.411044:0:3284:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94c83661e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:121cd5bc-7f07-4cf7-8e2e-4356c89c0696:3284:1875765421476352:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788869465.411051:0:3284:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94c83661ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:121cd5bc-7f07-4cf7-8e2e-4356c89c0696:3284:1875765421476480:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788869465.411067:0:12814:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.139@tcp lock: ffff94c818d1ee00/0x3d2d1916761d612c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3d2d1916761d6133 expref: -99 pid: 5735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869465.411075:0:12814:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.139@tcp lock: ffff94c818d1ee00/0x3d2d1916761d612c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x3d2d1916761d6133 expref: -99 pid: 5735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869465.411082:0:12814:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.139@tcp lock: ffff94c818d1ee00/0x3d2d1916761d612c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x3d2d1916761d6133 expref: -99 pid: 5735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869465.411088:0:12814:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.139@tcp lock: ffff94c818d1ee00/0x3d2d1916761d612c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x3d2d1916761d6133 expref: -99 pid: 5735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869465.411112:0:12814:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1788869465.411116:0:12814:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0000 10000000:01000000:0.0:1788869465.411118:0:12814:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0000 (0) 00010000:00010000:0.0:1788869465.411137:0:5742:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788869465.411141:0:5742:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.139@tcp lock: ffff94c818d1ee00/0x3d2d1916761d612c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x3d2d1916761d6133 expref: -99 pid: 5735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869465.411147:0:5742:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94c818d1ee00 already unused, calling callback (ffffffffc1ce9c20) 10000000:00010000:0.0:1788869465.411150:0:5742:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.139@tcp lock: ffff94c818d1ee00/0x3d2d1916761d612c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x3d2d1916761d6133 expref: -99 pid: 5735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869465.411156:0:5742:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.139@tcp lock: ffff94c818d1ee00/0x3d2d1916761d612c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x3d2d1916761d6133 expref: -99 pid: 5735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788869465.411163:0:5742:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.139@tcp lock: ffff94c818d1ee00/0x3d2d1916761d612c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x3d2d1916761d6133 expref: -99 pid: 5735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788869465.411168:0:5742:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:0.0:1788869465.411170:0:5742:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:0.0:1788869465.411171:0:5742:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00010000:00010000:0.0:1788869465.411183:0:5742:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.139@tcp lock: ffff94c818d1ee00/0x3d2d1916761d612c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x3d2d1916761d6133 expref: -99 pid: 5735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869465.411190:0:5742:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788869465.411200:0:5742:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.139@tcp lock: ffff94c818d1ee00/0x3d2d1916761d612c lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x3d2d1916761d6133 expref: -99 pid: 5735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869465.411207:0:5742:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.139@tcp lock: ffff94c818d1ee00/0x3d2d1916761d612c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x3d2d1916761d6133 expref: -99 pid: 5735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869465.411226:0:5742:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788869465.411228:0:5742:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788869465.411230:0:5742:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788869465.411239:0:3286:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94c83661ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:121cd5bc-7f07-4cf7-8e2e-4356c89c0696:3286:1875765421476736:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788869465.411279:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869465.411327:0:5741:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765421476736 00000100:00100000:0.0:1788869465.411331:0:5741:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765421476736 00000100:00100000:0.0:1788869465.411350:0:5741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1788869465.411356:0:5741:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c83661e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:121cd5bc-7f07-4cf7-8e2e-4356c89c0696+15:3286:x1875765421476736:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788869465.411365:0:5741:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788869465.411373:0:5741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff94c80153b800/0x3d2d1916761d6133 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x3d2d1916761d612c expref: 15 pid: 5749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869465.411383:0:5741:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788869465.411408:0:5741:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c83661e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:121cd5bc-7f07-4cf7-8e2e-4356c89c0696+14:3286:x1875765421476736:12345-0@lo:103:ldlm_bl.0 Request processed in 52us (128us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869465.411414:0:5741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1788869465.411436:0:3286:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94c83661ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:121cd5bc-7f07-4cf7-8e2e-4356c89c0696:3286:1875765421476736:0@lo:103:ldlm_bl.0 00000020:01000004:0.0:1788869465.411455:0:12814:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-MDT0000 00000020:01000000:0.0:1788869465.411459:0:12814:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000 (flags='F') 00000020:00000080:0.0:1788869465.411463:0:12814:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788869465.411468:0:12814:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000: forcing exports to disconnect: 2/9 00000020:00080000:0.0:1788869465.411472:0:12814:0:(genops.c:1840:print_export_data()) lustre-MDT0000: ACTIVE ffff94c83cbf1800 lustre-MDT0000-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1788869465.411477:0:12814:0:(genops.c:1840:print_export_data()) lustre-MDT0000: ACTIVE ffff94c7012d7800 lustre-MDT0000-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1788869465.411484:0:12814:0:(genops.c:1840:print_export_data()) lustre-MDT0000: UNLINKED ffff94c83c6a2000 10cd6f3c-009b-4acc-9ca5-e50cb17e412c 192.168.201.39@tcp 2 (0 2 0) 1 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1788869465.411496:0:12814:0:(genops.c:1840:print_export_data()) lustre-MDT0000: UNLINKED ffff94c83cbf4000 2125b9b3-626e-4cbe-be83-fb446e976ce2 192.168.201.39@tcp 6 (0 6 0) 1 0 0 0: 0000000000000000 4294967520 stale:0 00000020:00080000:0.0:1788869465.411500:0:12814:0:(genops.c:1574:class_disconnect_exports()) OBD device 5 (ffff94c82d04b380) has exports, disconnecting them 00000020:00080000:0.0:1788869465.411503:0:12814:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff94c83cbf1800), last request at 1788869462 00000020:00000080:0.0:1788869465.411508:0:12814:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x3d2d1916761d6340 00000100:00080000:0.0:1788869465.411522:0:12814:0:(import.c:65:import_set_state_nolock()) ffff94c83cbf5800 : changing import state from FULL to CLOSED 00010000:00010000:0.0:1788869465.411550:0:5742:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:0.0:1788869465.411560:0:12814:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff94c83cbf1800): rc 0 00000020:00000080:0.0:1788869465.411563:0:12814:0:(genops.c:906:class_export_put()) final put ffff94c83cbf1800/lustre-MDT0000-lwp-OST0001_UUID 00000020:00080000:0.0:1788869465.411571:0:12814:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff94c7012d7800), last request at 1788869462 00000020:00000080:0.0:1788869465.411575:0:12814:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x3d2d1916761d6275 00000100:00080000:0.0:1788869465.411580:0:12814:0:(import.c:65:import_set_state_nolock()) ffff94c7012d4000 : changing import state from FULL to CLOSED 00000020:00000080:0.0:1788869465.411591:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff94c83cbf1800/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000 00000020:00000080:0.0:1788869465.411620:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff94c83cbf5800 for lustre-MDT0000 00010000:00010000:0.0:1788869465.411629:0:5742:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:0.0:1788869465.411636:0:12814:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff94c7012d7800): rc 0 00000020:00000080:0.0:1788869465.411639:0:12814:0:(genops.c:906:class_export_put()) final put ffff94c7012d7800/lustre-MDT0000-lwp-OST0000_UUID 00000004:00000080:0.0:1788869465.411648:0:12814:0:(mdd_device.c:2302:mdd_iocontrol()) lustre-MDD0000: cmd=400866e7 len=0 karg=ffffacc1418e3ae0 00000020:00000080:0.0:1788869465.411658:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff94c7012d7800/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000 00000020:00000080:0.0:1788869465.411683:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff94c7012d4000 for lustre-MDT0000 00000100:00080000:0.0:1788869465.411703:0:12814:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:0.0:1788869465.411706:0:12814:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967310 gen 3 00000004:00080000:0.0:1788869465.411718:0:12814:0:(osp_dev.c:1691:osp_import_event()) got inactive 00000100:00080000:0.0:1788869465.411779:0:12814:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:0.0:1788869465.411789:0:12814:0:(import.c:65:import_set_state_nolock()) ffff94c810fde000 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:0.0:1788869465.411799:0:12814:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:0.0:1788869465.411801:0:12814:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967323 gen 3 00000100:00100000:0.0:1788869465.411808:0:12814:0:(client.c:3150:ptlrpc_free_committed()) @@@ free request with old gen req@ffff94c702217100 x1875765421475072/t4294967324(4294967324) o2->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 440/432 e 0 to 0 dl 1788869477 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-1-0.0' uid:0 gid:0 projid:4294967295 00000004:00080000:0.0:1788869465.411823:0:12814:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94c702217100, transno 4294967324 00000004:00080000:0.0:1788869465.411836:0:12814:0:(osp_dev.c:1691:osp_import_event()) got inactive 00000100:00080000:0.0:1788869465.411918:0:12814:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:0.0:1788869465.411927:0:12814:0:(import.c:65:import_set_state_nolock()) ffff94c810e57800 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000020:00080000:0.0:1788869465.411953:0:12814:0:(genops.c:1579:class_disconnect_exports()) OBD device 5 (ffff94c82d04b380) has no exports 00000100:00100000:1.0:1788869465.412038:0:3282:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94c83661ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3282:1875765421476864:0@lo:9:umount.0 00000100:00100000:1.0:1788869465.412071:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869465.412096:0:3282:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94c83661f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3282:1875765421476992:0@lo:9:umount.0 00000100:00100000:1.0:1788869465.412117:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869465.412151:0:6546:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765421476864 00000100:00100000:1.0:1788869465.412155:0:6546:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765421476864 00000100:00100000:1.0:1788869465.412189:0:6546:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765421476992 00000100:00100000:1.0:1788869465.412192:0:6546:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765421476992 00000100:00100000:1.0:1788869465.412220:0:6546:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1788869465.412227:0:6546:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c83c689880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3282:x1875765421476864:12345-0@lo:9:umount.0 00000020:00000080:1.0:1788869465.412242:0:6546:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x3d2d1916761d62c2 00000100:00080000:1.0:1788869465.412265:0:6546:0:(import.c:65:import_set_state_nolock()) ffff94c83e0b4000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1788869465.412303:0:6546:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967310 00000100:00100000:1.0:1788869465.412459:0:6546:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c83c689880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+2:3282:x1875765421476864:12345-0@lo:9:umount.0 Request processed in 232us (386us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869465.412466:0:6546:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1788869465.412478:0:6546:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1788869465.412484:0:6546:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c83c68bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3282:x1875765421476992:12345-0@lo:9:umount.0 00000020:00000080:1.0:1788869465.412494:0:6546:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x3d2d1916761d63b0 00000100:00080000:1.0:1788869465.412499:0:6546:0:(import.c:65:import_set_state_nolock()) ffff94c83cbf0000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1788869465.412512:0:6546:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967324 00000100:00100000:1.0:1788869465.412603:0:6546:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c83c68bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+3:3282:x1875765421476992:12345-0@lo:9:umount.0 Request processed in 119us (484us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869465.412610:0:6546:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00080000:1.0:1788869465.412628:0:5751:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:1.0:1788869465.412637:0:5742:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1788869465.412671:0:3282:0:(import.c:65:import_set_state_nolock()) ffff94c810fde000 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:1.0:1788869465.412675:0:3282:0:(osp_dev.c:1675:osp_import_event()) got disconnected 00000004:00080000:1.0:1788869465.412677:0:3282:0:(osp_dev.c:1691:osp_import_event()) got inactive 00000100:00100000:1.0:1788869465.412680:0:3282:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94c83661ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3282:1875765421476864:0@lo:9:umount.0 00000100:00080000:1.0:1788869465.412689:0:3282:0:(import.c:65:import_set_state_nolock()) ffff94c810e57800 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:1.0:1788869465.412692:0:3282:0:(osp_dev.c:1675:osp_import_event()) got disconnected 00000004:00080000:1.0:1788869465.412694:0:3282:0:(osp_dev.c:1691:osp_import_event()) got inactive 00000100:00100000:1.0:1788869465.412696:0:3282:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94c83661f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3282:1875765421476992:0@lo:9:umount.0 00010000:00010000:3.0:1788869465.412938:0:7447:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788869465.412984:0:5743:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788869465.503281:0:5742:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788869466.526209:0:7447:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1788869466.747595:0:5777:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 10cd6f3c-009b-4acc-9ca5-e50cb17e412c 00000001:00080000:1.0:1788869466.747609:0:5777:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967526 is committed 00000020:00000080:1.0:1788869466.747613:0:5777:0:(genops.c:906:class_export_put()) final put ffff94c83c6a2000/10cd6f3c-009b-4acc-9ca5-e50cb17e412c 00000001:00100000:1.0:1788869466.747654:0:5777:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 2125b9b3-626e-4cbe-be83-fb446e976ce2 00000001:00080000:1.0:1788869466.747659:0:5777:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967525 is committed 00000020:00000080:1.0:1788869466.747666:0:5777:0:(genops.c:906:class_export_put()) final put ffff94c83cbf4000/2125b9b3-626e-4cbe-be83-fb446e976ce2 00000020:00000080:0.0:1788869466.747696:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff94c83c6a2000/10cd6f3c-009b-4acc-9ca5-e50cb17e412c for lustre-MDT0000 00000020:00000080:0.0:1788869466.747825:0:36:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff94c83c6a0800 for lustre-MDT0000 00000020:00080000:1.0:1788869466.747885:0:5777:0:(update_trans.c:1348:distribute_txn_batchid_cb()) lustre-MDT0000: 8 batchid updated 00000020:00080000:1.0:1788869466.747898:0:5791:0:(update_trans.c:58:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff94c805068e40 refcount 1 committed 1 result 0 batchid 8 00000020:00080000:1.0:1788869466.747901:0:5791:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff94c820719200 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff94c8050683c0 00000020:00080000:1.0:1788869466.747904:0:5791:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff94c820719700 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff94c70218f400 00000020:00000080:0.0:1788869466.748178:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff94c83cbf4000/2125b9b3-626e-4cbe-be83-fb446e976ce2 for lustre-MDT0000 00000020:00000080:0.0:1788869466.748389:0:36:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff94c834da8800 for lustre-MDT0000 00000001:00100000:0.0:1788869466.750994:0:7458:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 2125b9b3-626e-4cbe-be83-fb446e976ce2 00000020:00000080:0.0:1788869466.751004:0:7458:0:(genops.c:906:class_export_put()) final put ffff94c834d63000/2125b9b3-626e-4cbe-be83-fb446e976ce2 00000001:00080000:0.0:1788869466.751031:0:7458:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967324 is committed 00000001:00100000:0.0:1788869466.751044:0:7458:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1788869466.751047:0:7458:0:(genops.c:906:class_export_put()) final put ffff94c83cbf7800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1788869466.751075:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff94c834d63000/2125b9b3-626e-4cbe-be83-fb446e976ce2 for lustre-OST0001 00000020:00000080:0.0:1788869466.751122:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff94c83cbf7800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001 00000020:00000080:0.0:1788869466.751221:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff94c834d60000 for lustre-OST0001 00000020:00000080:0.0:1788869466.751229:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff94c83cbf0000 for lustre-OST0001 00000020:00080000:0.0:1788869466.761760:0:12814:0:(genops.c:1579:class_disconnect_exports()) OBD device 5 (ffff94c82d04b380) has no exports 00000001:00100000:2.0:1788869466.771366:0:6571:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1788869466.771376:0:6571:0:(genops.c:906:class_export_put()) final put ffff94c83e0b3800/lustre-MDT0000-mdtlov_UUID 00000001:00100000:2.0:1788869466.771417:0:6571:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 2125b9b3-626e-4cbe-be83-fb446e976ce2 00000020:00000080:2.0:1788869466.771420:0:6571:0:(genops.c:906:class_export_put()) final put ffff94c810db2800/2125b9b3-626e-4cbe-be83-fb446e976ce2 00000020:00000080:1.0:1788869466.772856:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff94c83e0b3800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000 00000020:00000080:1.0:1788869466.772922:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff94c810db2800/2125b9b3-626e-4cbe-be83-fb446e976ce2 for lustre-OST0000 00000020:00000080:1.0:1788869466.772940:0:36:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff94c83e0b4000 for lustre-OST0000 00000020:00000080:1.0:1788869466.772945:0:36:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff94c810db1800 for lustre-OST0000 00000020:00000080:0.0:1788869466.801569:0:12814:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x3d2d1916761d6187 00000020:00000080:0.0:1788869466.801583:0:12814:0:(genops.c:906:class_export_put()) final put ffff94c8349df000/lustre-QMT0000_UUID 00000020:01000000:0.0:1788869466.801665:0:12814:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-QMT0000 (flags='') 00000020:00000080:1.0:1788869466.801750:0:12814:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788869466.801761:0:12814:0:(obd_config.c:955:class_cleanup()) lustre-QMT0000: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1788869466.801765:0:12814:0:(genops.c:1579:class_disconnect_exports()) OBD device 7 (ffff94c82d048000) has no exports 00000020:00000080:1.0:1788869466.802038:0:12814:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x3d2d1916761d6180 00000020:00000080:1.0:1788869466.802043:0:12814:0:(genops.c:906:class_export_put()) final put ffff94c836518800/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1788869466.802069:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff94c8349df000/lustre-QMT0000_UUID for lustre-QMT0000 00000020:00000080:3.0:1788869466.802221:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff94c836518800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1788869466.802505:0:12814:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788869466.802512:0:12814:0:(obd_config.c:883:class_detach()) detach on obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:1.0:1788869466.802515:0:12814:0:(genops.c:906:class_export_put()) final put ffff94c82d05b800/lustre-QMT0000_UUID 00000020:00000080:1.0:1788869466.802517:0:12814:0:(genops.c:865:class_export_destroy()) destroying export ffff94c82d05b800/lustre-QMT0000_UUID for lustre-QMT0000 00000020:01000000:1.0:1788869466.802525:0:12814:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-QMT0000 (lustre-QMT0000_UUID) 00000020:01000000:1.0:1788869466.802642:0:12814:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff94c83f9b0240 - data ffff94c83013ba20/ffff94c836620400 00000020:01000000:1.0:1788869466.802777:0:12814:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff94c806060f00 - data ffff94c8303bf798/ffff94c836516000 00000001:00000004:1.0:1788869466.816380:0:12814:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967526 00000100:00080000:1.0:1788869466.858177:0:12814:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:1.0:1788869466.858186:0:12814:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967310 gen 4 00000004:00080000:1.0:1788869466.858340:0:12814:0:(osp_dev.c:1691:osp_import_event()) got inactive 00000100:00100000:1.0:1788869466.858344:0:12814:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:2.0:1788869466.858674:0:7093:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:2.0:1788869466.858679:0:7093:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x3:0x0] index 5 count 1 00000040:00080000:2.0:1788869466.858689:0:7093:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 1 count 2 00000100:00080000:1.0:1788869466.859686:0:12814:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:1.0:1788869466.859691:0:12814:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967323 gen 4 00000004:00080000:1.0:1788869466.859709:0:12814:0:(osp_dev.c:1691:osp_import_event()) got inactive 00000100:00100000:1.0:1788869466.859711:0:12814:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:2.0:1788869466.860539:0:7877:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:2.0:1788869466.860543:0:7877:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x6:0x0] index 8 count 2 00000040:00080000:2.0:1788869466.860551:0:7877:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 1 count 2 00000020:00000080:2.0:1788869466.897641:0:12814:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x3d2d1916761d614f 00000020:00000080:2.0:1788869466.897654:0:12814:0:(genops.c:906:class_export_put()) final put ffff94c82d03a800/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1788869466.897711:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff94c82d03a800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:2.0:1788869466.898811:0:12814:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x3d2d1916761d6164 00000020:00000080:2.0:1788869466.898818:0:12814:0:(genops.c:906:class_export_put()) final put ffff94c82d05c800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:2.0:1788869466.898866:0:12814:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-mdtlov (flags='') 00000020:00000080:2.0:1788869466.898872:0:12814:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788869466.898880:0:12814:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1788869466.898887:0:12814:0:(genops.c:1579:class_disconnect_exports()) OBD device 4 (ffff94c82d0499c0) has no exports 00000004:01000000:2.0:1788869466.899046:0:12814:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:2.0:1788869466.899053:0:12814:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x3d2d1916761d63a2 00000020:00000080:2.0:1788869466.899057:0:12814:0:(genops.c:906:class_export_put()) final put ffff94c810e55000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1788869466.899092:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff94c82d05c800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:2.0:1788869466.899195:0:12814:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0000 (flags='') 00000020:00000080:2.0:1788869466.899199:0:12814:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788869466.899206:0:12814:0:(obd_config.c:955:class_cleanup()) lustre-OST0001-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:2.0:1788869466.899209:0:12814:0:(genops.c:1579:class_disconnect_exports()) OBD device 17 (ffff94c82c848000) has no exports 00000020:00000080:2.0:1788869466.899213:0:12814:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x3d2d1916761d639b 00000020:00000080:2.0:1788869466.899217:0:12814:0:(genops.c:906:class_export_put()) final put ffff94c810e50000/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1788869466.899234:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff94c810e55000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00010000:01000000:2.0:1788869466.899728:0:12814:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0000: client import never connected 00000100:00080000:2.0:1788869466.899733:0:12814:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:2.0:1788869466.899736:0:12814:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967323 gen 5 00000004:00080000:2.0:1788869466.899740:0:12814:0:(osp_dev.c:1691:osp_import_event()) got inactive 00000100:00100000:2.0:1788869466.899743:0:12814:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1788869466.899771:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff94c810e50000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:2.0:1788869466.899840:0:12814:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788869466.899847:0:12814:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1788869466.899852:0:12814:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x3d2d1916761d62bb 00000020:00000080:2.0:1788869466.899856:0:12814:0:(genops.c:906:class_export_put()) final put ffff94c83e0b3000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1788869466.899875:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff94c810e57800 for lustre-OST0001-osc-MDT0000 00000020:00000080:1.0:1788869466.899879:0:8:0:(genops.c:906:class_export_put()) final put ffff94c835503800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1788869466.899881:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff94c835503800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:01000000:1.0:1788869466.899885:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:01000000:2.0:1788869466.900002:0:12814:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0000 (flags='') 00000020:00000080:2.0:1788869466.900006:0:12814:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788869466.900010:0:12814:0:(obd_config.c:955:class_cleanup()) lustre-OST0000-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:2.0:1788869466.900012:0:12814:0:(genops.c:1579:class_disconnect_exports()) OBD device 13 (ffff94c81f1a8000) has no exports 00000020:00000080:2.0:1788869466.900016:0:12814:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x3d2d1916761d62b4 00000020:00000080:2.0:1788869466.900020:0:12814:0:(genops.c:906:class_export_put()) final put ffff94c810fdd000/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1788869466.900038:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff94c83e0b3000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00010000:01000000:2.0:1788869466.900431:0:12814:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0000: client import never connected 00000100:00080000:2.0:1788869466.900434:0:12814:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:2.0:1788869466.900437:0:12814:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967310 gen 5 00000004:00080000:2.0:1788869466.900440:0:12814:0:(osp_dev.c:1691:osp_import_event()) got inactive 00000100:00100000:2.0:1788869466.900446:0:12814:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1788869466.901746:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff94c810fdd000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:2.0:1788869466.901828:0:12814:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788869466.901837:0:12814:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1788869466.901862:0:12814:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788869466.901864:0:12814:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1788869466.901868:0:12814:0:(genops.c:906:class_export_put()) final put ffff94c82d03f800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1788869466.901871:0:12814:0:(genops.c:865:class_export_destroy()) destroying export ffff94c82d03f800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:2.0:1788869466.901877:0:12814:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-mdtlov (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1788869466.902031:0:12814:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x3d2d1916761d616b 00000020:00000080:2.0:1788869466.902036:0:12814:0:(genops.c:906:class_export_put()) final put ffff94c82d05a800/lustre-MDD0000_UUID 00000020:01000000:2.0:1788869466.902040:0:12814:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDD0000 (flags='') 00000020:00000080:2.0:1788869466.902044:0:12814:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788869466.902047:0:12814:0:(obd_config.c:955:class_cleanup()) lustre-MDD0000: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1788869466.902050:0:12814:0:(genops.c:1579:class_disconnect_exports()) OBD device 6 (ffff94c82d04cd40) has no exports 00000020:00000080:2.0:1788869466.902067:0:12814:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788869466.902069:0:12814:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000020:00000080:2.0:1788869466.902072:0:12814:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x3d2d1916761d6172 00000020:00000080:2.0:1788869466.902075:0:12814:0:(genops.c:906:class_export_put()) final put ffff94c82d05e000/lustre-MDT0000-osd_UUID 00000020:01000004:2.0:1788869466.902081:0:12814:0:(tgt_mount.c:187:server_put_mount()) put mount ffff94c805125000 from lustre-MDT0000, refs=3 00000020:01000004:2.0:1788869466.902083:0:12814:0:(obd_mount.c:710:lustre_put_lsi()) put ffff94c805125000 3 00000020:01000004:2.0:1788869466.902086:0:12814:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff94c805125000 from lustre-MDT0000 00000020:00000080:1.0:1788869466.902192:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff94c810fde000 for lustre-OST0000-osc-MDT0000 00000020:00000080:1.0:1788869466.902198:0:8:0:(genops.c:906:class_export_put()) final put ffff94c8101db000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1788869466.902200:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff94c8101db000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:01000000:1.0:1788869466.902204:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1788869466.902413:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff94c82d05a800/lustre-MDD0000_UUID for lustre-MDD0000 00000020:00000080:1.0:1788869466.902417:0:8:0:(genops.c:906:class_export_put()) final put ffff94c82d038800/lustre-MDD0000_UUID 00000020:00000080:1.0:1788869466.902419:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff94c82d038800/lustre-MDD0000_UUID for lustre-MDD0000 00000020:01000000:1.0:1788869466.902423:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0000 (lustre-MDD0000_UUID) 00000020:00000080:1.0:1788869466.902647:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff94c82d05e000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:3.0:1788869466.902690:0:12814:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788869466.902695:0:12814:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:00000080:3.0:1788869466.902698:0:12814:0:(genops.c:906:class_export_put()) final put ffff94c82d03e000/lustre-MDT0000_UUID 00000020:00000080:3.0:1788869466.902700:0:12814:0:(genops.c:865:class_export_destroy()) destroying export ffff94c82d03e000/lustre-MDT0000_UUID for lustre-MDT0000 00000020:01000000:3.0:1788869466.902709:0:12814:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000 (lustre-MDT0000_UUID) 00000020:01000004:3.0:1788869466.902748:0:12814:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 2 references. 00000020:01000004:3.0:1788869466.902752:0:12814:0:(tgt_mount.c:255:server_stop_mgs()) Stop MGS service MGS 00000020:01000000:3.0:1788869466.902759:0:12814:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGS (flags='F') 00000020:00000080:3.0:1788869466.902762:0:12814:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788869466.902764:0:12814:0:(obd_config.c:955:class_cleanup()) MGS: forcing exports to disconnect: 1/3 00000020:00080000:3.0:1788869466.902770:0:12814:0:(genops.c:1840:print_export_data()) MGS: ACTIVE ffff94c81f19f800 121cd5bc-7f07-4cf7-8e2e-4356c89c0696 0@lo 13 (0 0 8) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1788869466.902776:0:12814:0:(genops.c:1574:class_disconnect_exports()) OBD device 1 (ffff94c808e00000) has exports, disconnecting them 00000020:00080000:3.0:1788869466.902780:0:12814:0:(genops.c:1549:class_disconnect_export_list()) MGS: disconnecting export at 0@lo (ffff94c81f19f800), last request at 1788869329 00000020:00000080:3.0:1788869466.902791:0:12814:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x3d2d1916761d6110 00000020:00010000:3.0:1788869466.902794:0:12814:0:(genops.c:1942:obd_stale_export_put()) Put export ffff94c81f19f800: total 0 00000100:00080000:3.0:1788869466.902797:0:12814:0:(import.c:65:import_set_state_nolock()) ffff94c81f19c000 : changing import state from FULL to CLOSED 00000020:00080000:3.0:1788869466.902806:0:12814:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff94c81f19f800): rc 0 00000020:00080000:3.0:1788869466.902810:0:12814:0:(genops.c:1579:class_disconnect_exports()) OBD device 1 (ffff94c808e00000) has no exports 00000020:00010000:2.0:1788869466.902847:0:5743:0:(genops.c:1928:obd_stale_export_get()) Get export ffff94c81f19f800: total 0 00010000:00010000:2.0:1788869466.902868:0:5743:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff94c81f19f800, canceled 0 locks, left on hash table 8. 00010000:00010000:2.0:1788869466.902890:0:5743:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff94c818d1f800/0x3d2d1916761d64ac lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x3d2d1916761d64a5 expref: 9 pid: 5749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869466.902905:0:5743:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff94c80153ba00/0x3d2d1916761d643c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x3d2d1916761d6435 expref: 8 pid: 5748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869466.902914:0:5743:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff94c80153ac00/0x3d2d1916761d642e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x3d2d1916761d6427 expref: 7 pid: 5749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869466.902933:0:5743:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff94c800030200/0x3d2d1916761d6466 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x3d2d1916761d645f expref: 6 pid: 5750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869466.902942:0:5743:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff94c8421f2a00/0x3d2d1916761d6458 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x3d2d1916761d6451 expref: 5 pid: 5749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869466.902954:0:5743:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff94c81a583600/0x3d2d1916761d6228 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x3d2d1916761d6221 expref: 4 pid: 5749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869466.902964:0:5743:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff94c81a582600/0x3d2d1916761d666c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x3d2d1916761d6665 expref: 3 pid: 5748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869466.902973:0:5743:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff94c8421f2800/0x3d2d1916761d665e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x3d2d1916761d6657 expref: 2 pid: 5750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869466.902981:0:5743:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff94c81f19f800, canceled 8 locks, left on hash table 0. 00000020:00000080:2.0:1788869466.902990:0:5743:0:(genops.c:906:class_export_put()) final put ffff94c81f19f800/121cd5bc-7f07-4cf7-8e2e-4356c89c0696 00010000:00010000:2.0:1788869466.902998:0:5743:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788869466.903000:0:5743:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788869466.903001:0:5743:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1788869466.903006:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff94c81f19f800/121cd5bc-7f07-4cf7-8e2e-4356c89c0696 for MGS 00000020:00000080:2.0:1788869466.903022:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff94c81f19c000 for MGS 00000100:00100000:1.0:1788869466.903181:0:5749:0:(service.c:3183:ptlrpc_main()) ll_mgs_0001: service thread [ffff94c810e36000:5749] 1 exiting: rc = 0 00000100:00100000:2.0:1788869466.903370:0:5750:0:(service.c:3183:ptlrpc_main()) ll_mgs_0002: service thread [ffff94c810e37800:5750] 2 exiting: rc = 0 00000100:00100000:0.0:1788869466.903416:0:5748:0:(service.c:3183:ptlrpc_main()) ll_mgs_0000: service thread [ffff94c810e36c00:5748] 0 exiting: rc = 1 00000100:00100000:1.0:1788869466.903475:0:12814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788869466.903481:0:12814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788869466.903487:0:12814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788869466.903492:0:12814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788869466.903498:0:12814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788869466.903503:0:12814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788869466.903508:0:12814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788869466.903513:0:12814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788869466.903518:0:12814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788869466.903524:0:12814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788869466.903529:0:12814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788869466.903535:0:12814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788869466.903540:0:12814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788869466.903544:0:12814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788869466.903549:0:12814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788869466.903554:0:12814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788869466.903558:0:12814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788869466.903563:0:12814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788869466.903568:0:12814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788869466.903573:0:12814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788869466.903578:0:12814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788869466.903583:0:12814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788869466.903588:0:12814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788869466.903598:0:12814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788869466.903604:0:12814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788869466.903636:0:12814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788869466.903642:0:12814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788869466.903648:0:12814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788869466.903653:0:12814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788869466.903657:0:12814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788869466.903662:0:12814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788869466.903667:0:12814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788869466.903672:0:12814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788869466.903677:0:12814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788869466.903681:0:12814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788869466.903692:0:12814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788869466.903697:0:12814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788869466.903701:0:12814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788869466.903707:0:12814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788869466.903711:0:12814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788869466.903716:0:12814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788869466.903720:0:12814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788869466.903725:0:12814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788869466.903730:0:12814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788869466.903735:0:12814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788869466.903740:0:12814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788869466.903745:0:12814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788869466.903750:0:12814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788869466.903755:0:12814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788869466.903760:0:12814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788869466.903765:0:12814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788869466.903770:0:12814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788869466.903774:0:12814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788869466.903779:0:12814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788869466.903784:0:12814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788869466.903789:0:12814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788869466.903793:0:12814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788869466.903802:0:12814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788869466.903809:0:12814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788869466.903815:0:12814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788869466.903820:0:12814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788869466.903825:0:12814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788869466.903831:0:12814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788869466.903835:0:12814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 20000000:01000000:1.0:1788869466.904497:0:12814:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:1.0:1788869466.904501:0:12814:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 00000020:01000000:1.0:1788869466.905513:0:12814:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff94c8181f9840 - data ffff94c83036caf8/ffff94c83547ac00 00000020:01000000:1.0:1788869466.905615:0:12814:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff94c80311e6c0 - data ffff94c830378798/ffff94c81f074400 00000020:00000080:1.0:1788869466.906072:0:12814:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x3d2d1916761d60f4 00000020:00000080:1.0:1788869466.906080:0:12814:0:(genops.c:906:class_export_put()) final put ffff94c80f9b7800/lustre-MDT0000-osd_UUID 00000020:01000004:1.0:1788869466.906157:0:12814:0:(tgt_mount.c:187:server_put_mount()) put mount ffff94c805125000 from MGS, refs=2 00000020:01000004:1.0:1788869466.906161:0:12814:0:(obd_mount.c:710:lustre_put_lsi()) put ffff94c805125000 2 00000020:01000004:1.0:1788869466.906164:0:12814:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff94c805125000 from MGS 00000020:00000080:1.0:1788869466.906184:0:12814:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788869466.906189:0:12814:0:(obd_config.c:883:class_detach()) detach on obd MGS (uuid MGS) 00000020:00000080:1.0:1788869466.906191:0:12814:0:(genops.c:906:class_export_put()) final put ffff94c820388800/MGS 00000020:00000080:1.0:1788869466.906194:0:12814:0:(genops.c:865:class_export_destroy()) destroying export ffff94c820388800/MGS for MGS 00000020:01000000:1.0:1788869466.906199:0:12814:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGS (MGS) 00000020:01000000:1.0:1788869466.906365:0:12814:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0000 (flags='F') 00000020:00000080:2.0:1788869466.906369:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff94c80f9b7800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1788869466.906370:0:12814:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788869466.906375:0:12814:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-lwp-MDT0000: forcing exports to disconnect: 1/3 00000020:00080000:1.0:1788869466.906380:0:12814:0:(genops.c:1840:print_export_data()) lustre-MDT0000-lwp-MDT0000: ACTIVE ffff94c81f21b800 lustre-MDT0000-lwp-MDT0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1788869466.906386:0:12814:0:(genops.c:1574:class_disconnect_exports()) OBD device 8 (ffff94c8356c8000) has exports, disconnecting them 00000020:00080000:1.0:1788869466.906391:0:12814:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0000: disconnecting export at 0@lo (ffff94c81f21b800), last request at 1788869329 00000020:00000080:1.0:1788869466.906395:0:12814:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x3d2d1916761d61bf 00000020:00080000:1.0:1788869466.906404:0:12814:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff94c81f21b800): rc 0 00000020:00000080:1.0:1788869466.906409:0:12814:0:(genops.c:906:class_export_put()) final put ffff94c81f21b800/lustre-MDT0000-lwp-MDT0000 00000020:00000080:3.0:1788869466.907093:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff94c81f21b800/lustre-MDT0000-lwp-MDT0000 for lustre-MDT0000-lwp-MDT0000 00010000:01000000:2.0:1788869466.908295:0:12814:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0000: client import never connected 00000100:00080000:2.0:1788869466.908301:0:12814:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1788869466.908305:0:12814:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:2.0:1788869466.908310:0:12814:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1788869466.908343:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff94c81f218000 for lustre-MDT0000-lwp-MDT0000 00000020:00000080:2.0:1788869466.908424:0:12814:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788869466.908430:0:12814:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000020:00000080:2.0:1788869466.908433:0:12814:0:(genops.c:906:class_export_put()) final put ffff94c83651c800/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:2.0:1788869466.908436:0:12814:0:(genops.c:865:class_export_destroy()) destroying export ffff94c83651c800/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000-lwp-MDT0000 00000020:01000000:2.0:1788869466.908440:0:12814:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0000 (lustre-MDT0000-lwp-MDT0000_UUID) 00000020:01000004:2.0:1788869466.908486:0:12814:0:(obd_mount.c:710:lustre_put_lsi()) put ffff94c805125000 1 00000020:00000080:2.0:1788869466.908491:0:12814:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x3d2d1916761d60e6 00000020:00000080:2.0:1788869466.908495:0:12814:0:(genops.c:906:class_export_put()) final put ffff94c82038c800/lustre-MDT0000-osd_UUID 00000020:01000000:2.0:1788869466.908509:0:12814:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osd (flags='') 00000020:00000080:2.0:1788869466.908512:0:12814:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788869466.908520:0:12814:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1788869466.908523:0:12814:0:(genops.c:1579:class_disconnect_exports()) OBD device 0 (ffff94c8060ab380) has no exports 00000020:00000080:3.0:1788869466.908535:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff94c82038c800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:2.0:1788869466.920159:0:12814:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788869466.920172:0:12814:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00000020:00000080:2.0:1788869466.920177:0:12814:0:(genops.c:906:class_export_put()) final put ffff94c805122800/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1788869466.920182:0:12814:0:(genops.c:865:class_export_destroy()) destroying export ffff94c805122800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:2.0:1788869466.920192:0:12814:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osd (lustre-MDT0000-osd_UUID) 00000020:01000004:2.0:1788869466.920329:0:12814:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff94c805127800 00000020:01000000:2.0:1788869466.920351:0:12814:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MDS (flags='F') 00000020:00000080:2.0:1788869466.920354:0:12814:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788869466.920359:0:12814:0:(obd_config.c:955:class_cleanup()) MDS: forcing exports to disconnect: 0/1 00000020:00080000:2.0:1788869466.920362:0:12814:0:(genops.c:1579:class_disconnect_exports()) OBD device 3 (ffff94c81f1ab380) has no exports 00000100:00100000:2.0:1788869466.920428:0:5786:0:(service.c:3183:ptlrpc_main()) mdt00_003: service thread [ffff94c8089b0800:5786] 3 exiting: rc = 0 00000100:00100000:2.0:1788869466.920516:0:5755:0:(service.c:3183:ptlrpc_main()) mdt00_000: service thread [ffff94c810e37e00:5755] 0 exiting: rc = 1 00000100:00100000:1.0:1788869466.920711:0:5757:0:(service.c:3183:ptlrpc_main()) mdt00_002: service thread [ffff94c806117000:5757] 2 exiting: rc = 0 00000100:00100000:1.0:1788869466.920782:0:5756:0:(service.c:3183:ptlrpc_main()) mdt00_001: service thread [ffff94c806116200:5756] 1 exiting: rc = 0 00000100:00100000:2.0:1788869466.920966:0:12814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869466.920974:0:12814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869466.920980:0:12814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869466.920984:0:12814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869466.920989:0:12814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869466.921001:0:12814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869466.921006:0:12814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869466.921011:0:12814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869466.921024:0:12814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869466.921029:0:12814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869466.921035:0:12814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869466.921039:0:12814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869466.921044:0:12814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869466.921049:0:12814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869466.921053:0:12814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869466.921113:0:12814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869466.921118:0:12814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869466.921124:0:12814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869466.921129:0:12814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869466.921134:0:12814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869466.921139:0:12814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869466.921143:0:12814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869466.921148:0:12814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869466.921153:0:12814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869466.921157:0:12814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869466.921162:0:12814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869466.921166:0:12814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869466.921171:0:12814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869466.921176:0:12814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869466.921180:0:12814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869466.921185:0:12814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869466.921190:0:12814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869466.921194:0:12814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869466.921198:0:12814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869466.921203:0:12814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869466.921207:0:12814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869466.921212:0:12814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869466.921216:0:12814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869466.921230:0:12814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869466.921236:0:12814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869466.921242:0:12814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869466.921247:0:12814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869466.921279:0:12814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869466.921291:0:12814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869466.921297:0:12814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869466.921302:0:12814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869466.921308:0:12814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869466.921313:0:12814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869466.921319:0:12814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869466.921324:0:12814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869466.921329:0:12814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869466.921335:0:12814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869466.921341:0:12814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869466.921346:0:12814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869466.921351:0:12814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869466.921357:0:12814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869466.921362:0:12814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869466.921371:0:12814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869466.921377:0:12814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869466.921382:0:12814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869466.921387:0:12814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869466.921392:0:12814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869466.921398:0:12814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869466.921404:0:12814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788869466.927668:0:5758:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_000: service thread [ffff94c806116c00:5758] 0 exiting: rc = 1 00000100:00100000:3.0:1788869466.927781:0:5759:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_001: service thread [ffff94c81f0e2800:5759] 1 exiting: rc = 0 00000100:00100000:2.0:1788869466.928461:0:11820:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_002: service thread [ffff94c835a74e00:11820] 2 exiting: rc = 0 00000100:00100000:3.0:1788869466.928511:0:12814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869466.928518:0:12814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869466.928524:0:12814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869466.928530:0:12814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869466.928535:0:12814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869466.928541:0:12814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869466.928547:0:12814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869466.928553:0:12814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869466.928558:0:12814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869466.928563:0:12814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869466.928567:0:12814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869466.928572:0:12814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869466.928578:0:12814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869466.928583:0:12814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869466.928588:0:12814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869466.928593:0:12814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869466.928607:0:12814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869466.928611:0:12814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869466.928616:0:12814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869466.928621:0:12814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869466.928625:0:12814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869466.928630:0:12814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869466.928634:0:12814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869466.928638:0:12814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869466.928643:0:12814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869466.928647:0:12814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869466.928651:0:12814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869466.928656:0:12814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869466.928661:0:12814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869466.928666:0:12814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869466.928671:0:12814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869466.928677:0:12814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869466.928682:0:12814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869466.928687:0:12814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869466.928693:0:12814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869466.928698:0:12814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869466.928733:0:12814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869466.928740:0:12814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869466.928745:0:12814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869466.928750:0:12814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869466.928754:0:12814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869466.928758:0:12814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869466.928763:0:12814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869466.928768:0:12814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869466.928772:0:12814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869466.928777:0:12814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869466.928781:0:12814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869466.928786:0:12814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869466.928791:0:12814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869466.928796:0:12814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869466.928801:0:12814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869466.928810:0:12814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869466.928815:0:12814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869466.928820:0:12814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869466.928824:0:12814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869466.928829:0:12814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869466.928833:0:12814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869466.928838:0:12814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869466.928842:0:12814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869466.928847:0:12814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869466.928851:0:12814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869466.928856:0:12814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869466.928861:0:12814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869466.928866:0:12814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788869466.929413:0:5760:0:(service.c:3183:ptlrpc_main()) mdt_out00_000: service thread [ffff94c817078000:5760] 0 exiting: rc = 1 00000100:00100000:2.0:1788869466.929414:0:5761:0:(service.c:3183:ptlrpc_main()) mdt_out00_001: service thread [ffff94c817079800:5761] 1 exiting: rc = 0 00000100:00100000:3.0:1788869466.929483:0:12814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869466.929490:0:12814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869466.929497:0:12814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869466.929502:0:12814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869466.929508:0:12814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869466.929513:0:12814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869466.929519:0:12814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869466.929525:0:12814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869466.929530:0:12814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869466.929536:0:12814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869466.929541:0:12814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869466.929546:0:12814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869466.929551:0:12814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869466.929556:0:12814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869466.929574:0:12814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869466.929581:0:12814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869466.929585:0:12814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869466.929591:0:12814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869466.929596:0:12814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869466.929602:0:12814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869466.929607:0:12814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869466.929612:0:12814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869466.929625:0:12814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869466.929630:0:12814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869466.929636:0:12814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869466.929642:0:12814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869466.929662:0:12814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869466.929678:0:12814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869466.929689:0:12814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869466.929696:0:12814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869466.929703:0:12814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869466.929709:0:12814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869466.929714:0:12814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869466.929720:0:12814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869466.929725:0:12814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869466.929730:0:12814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869466.929735:0:12814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869466.929743:0:12814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869466.929759:0:12814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869466.929765:0:12814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869466.929770:0:12814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869466.929775:0:12814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869466.929780:0:12814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869466.929785:0:12814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869466.929790:0:12814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869466.929795:0:12814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869466.929800:0:12814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869466.929805:0:12814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869466.929811:0:12814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869466.929815:0:12814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869466.929831:0:12814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869466.929837:0:12814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869466.929843:0:12814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869466.929849:0:12814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869466.929855:0:12814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869466.929860:0:12814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869466.929864:0:12814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869466.929874:0:12814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869466.929880:0:12814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869466.929885:0:12814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869466.929891:0:12814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869466.929896:0:12814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869466.929905:0:12814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869466.929912:0:12814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788869466.937011:0:5762:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0000: service thread [ffff94c817078600:5762] 0 exiting: rc = 1 00000100:00100000:2.0:1788869466.937117:0:5763:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0001: service thread [ffff94c817078800:5763] 1 exiting: rc = 0 00000100:00100000:3.0:1788869466.937171:0:12814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869466.937178:0:12814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869466.937184:0:12814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869466.937189:0:12814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869466.937195:0:12814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869466.937200:0:12814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869466.937205:0:12814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869466.937210:0:12814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869466.937215:0:12814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869466.937220:0:12814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869466.937226:0:12814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869466.937231:0:12814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869466.937246:0:12814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869466.937281:0:12814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869466.937286:0:12814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869466.937291:0:12814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869466.937295:0:12814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869466.937300:0:12814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869466.937305:0:12814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869466.937311:0:12814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869466.937316:0:12814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869466.937321:0:12814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869466.937326:0:12814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869466.937331:0:12814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869466.937335:0:12814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869466.937339:0:12814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869466.937344:0:12814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869466.937348:0:12814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869466.937364:0:12814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869466.937368:0:12814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869466.937373:0:12814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869466.937377:0:12814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869466.937382:0:12814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869466.937386:0:12814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869466.937391:0:12814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869466.937395:0:12814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869466.937400:0:12814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869466.937404:0:12814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869466.937409:0:12814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869466.937413:0:12814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869466.937417:0:12814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869466.937422:0:12814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869466.937426:0:12814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869466.937431:0:12814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869466.937435:0:12814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869466.937439:0:12814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869466.937443:0:12814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869466.937448:0:12814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869466.937452:0:12814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869466.937457:0:12814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869466.937461:0:12814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869466.937465:0:12814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869466.937469:0:12814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869466.937473:0:12814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869466.937477:0:12814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869466.937482:0:12814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869466.937487:0:12814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869466.937491:0:12814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869466.937496:0:12814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869466.937501:0:12814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869466.937506:0:12814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869466.937511:0:12814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869466.937516:0:12814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869466.937582:0:12814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869466.937913:0:5764:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0000: service thread [ffff94c817079600:5764] 0 exiting: rc = 1 00000100:00100000:1.0:1788869466.937988:0:5765:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0001: service thread [ffff94c817079200:5765] 1 exiting: rc = 0 00000100:00100000:3.0:1788869466.938065:0:12814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869466.938072:0:12814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869466.938077:0:12814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869466.938081:0:12814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869466.938087:0:12814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869466.938092:0:12814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869466.938097:0:12814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869466.938103:0:12814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869466.938108:0:12814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869466.938114:0:12814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869466.938120:0:12814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869466.938125:0:12814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869466.938129:0:12814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869466.938134:0:12814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869466.938138:0:12814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869466.938143:0:12814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869466.938148:0:12814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869466.938153:0:12814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869466.938157:0:12814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869466.938162:0:12814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869466.938166:0:12814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869466.938170:0:12814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869466.938175:0:12814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869466.938180:0:12814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869466.938185:0:12814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869466.938192:0:12814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869466.938324:0:12814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869466.938334:0:12814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869466.938338:0:12814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869466.938343:0:12814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869466.938347:0:12814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869466.938352:0:12814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869466.938356:0:12814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869466.938360:0:12814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869466.938372:0:12814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869466.938376:0:12814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869466.938381:0:12814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869466.938385:0:12814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869466.938391:0:12814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869466.938395:0:12814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869466.938399:0:12814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869466.938404:0:12814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869466.938409:0:12814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869466.938413:0:12814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869466.938418:0:12814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869466.938422:0:12814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869466.938426:0:12814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869466.938432:0:12814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869466.938436:0:12814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869466.938440:0:12814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869466.938445:0:12814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869466.938449:0:12814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869466.938453:0:12814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869466.938457:0:12814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869466.938462:0:12814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869466.938467:0:12814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869466.938471:0:12814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869466.938476:0:12814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869466.938482:0:12814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869466.938514:0:12814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869466.938522:0:12814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869466.938527:0:12814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869466.938532:0:12814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869466.938536:0:12814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788869466.940426:0:5767:0:(service.c:3183:ptlrpc_main()) mdt_fld_0001: service thread [ffff94c817079c00:5767] 1 exiting: rc = 0 00000100:00100000:3.0:1788869466.941614:0:5766:0:(service.c:3183:ptlrpc_main()) mdt_fld_0000: service thread [ffff94c817078a00:5766] 0 exiting: rc = 1 00000100:00100000:2.0:1788869466.941830:0:12814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869466.941836:0:12814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869466.941840:0:12814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869466.941843:0:12814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869466.941847:0:12814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869466.941850:0:12814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869466.941853:0:12814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869466.941856:0:12814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869466.941859:0:12814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869466.941875:0:12814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869466.941879:0:12814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869466.941882:0:12814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869466.941885:0:12814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869466.941889:0:12814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869466.941892:0:12814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869466.941896:0:12814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869466.941899:0:12814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869466.941902:0:12814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869466.941905:0:12814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869466.941908:0:12814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869466.941911:0:12814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869466.941914:0:12814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869466.941917:0:12814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869466.941920:0:12814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869466.941923:0:12814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869466.941925:0:12814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869466.941928:0:12814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869466.941931:0:12814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869466.941934:0:12814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869466.941937:0:12814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869466.941940:0:12814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869466.941943:0:12814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869466.941946:0:12814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869466.941949:0:12814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869466.941952:0:12814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869466.941954:0:12814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869466.941957:0:12814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869466.941959:0:12814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869466.941962:0:12814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869466.941965:0:12814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869466.941968:0:12814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869466.941971:0:12814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869466.941975:0:12814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869466.941978:0:12814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869466.941985:0:12814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869466.941988:0:12814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869466.941992:0:12814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869466.941995:0:12814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869466.941998:0:12814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869466.942001:0:12814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869466.942004:0:12814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869466.942006:0:12814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869466.942009:0:12814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869466.942012:0:12814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869466.942014:0:12814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869466.942017:0:12814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869466.942020:0:12814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869466.942023:0:12814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869466.942026:0:12814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869466.942029:0:12814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869466.942031:0:12814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869466.942035:0:12814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869466.942038:0:12814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869466.942041:0:12814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869466.942655:0:5768:0:(service.c:3183:ptlrpc_main()) mdt_io00_000: service thread [ffff94c808771400:5768] 0 exiting: rc = 1 00000100:00100000:1.0:1788869466.942668:0:5769:0:(service.c:3183:ptlrpc_main()) mdt_io00_001: service thread [ffff94c81f215000:5769] 1 exiting: rc = 0 00000100:00100000:2.0:1788869466.942820:0:5770:0:(service.c:3183:ptlrpc_main()) mdt_io00_002: service thread [ffff94c81f214c00:5770] 2 exiting: rc = 0 00000100:00100000:3.0:1788869466.942895:0:12814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869466.942902:0:12814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869466.942907:0:12814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869466.942912:0:12814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869466.942925:0:12814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869466.942930:0:12814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869466.942936:0:12814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869466.942941:0:12814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869466.942946:0:12814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869466.942951:0:12814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869466.942956:0:12814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869466.942961:0:12814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869466.942967:0:12814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869466.942972:0:12814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869466.942977:0:12814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869466.942982:0:12814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869466.942987:0:12814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869466.942992:0:12814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869466.942998:0:12814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869466.943003:0:12814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869466.943009:0:12814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869466.943014:0:12814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869466.943020:0:12814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869466.943038:0:12814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869466.943044:0:12814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869466.943049:0:12814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869466.943054:0:12814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869466.943059:0:12814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869466.943065:0:12814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869466.943070:0:12814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869466.943075:0:12814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869466.943080:0:12814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869466.943086:0:12814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869466.943092:0:12814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869466.943098:0:12814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869466.943115:0:12814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869466.943119:0:12814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869466.943125:0:12814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869466.943129:0:12814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869466.943141:0:12814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869466.943145:0:12814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869466.943151:0:12814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869466.943156:0:12814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869466.943160:0:12814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869466.943165:0:12814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869466.943170:0:12814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869466.943175:0:12814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869466.943191:0:12814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869466.943197:0:12814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869466.943202:0:12814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869466.943207:0:12814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869466.943211:0:12814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869466.943217:0:12814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869466.943223:0:12814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869466.943229:0:12814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869466.943242:0:12814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869466.943279:0:12814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869466.943287:0:12814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869466.943293:0:12814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869466.943300:0:12814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869466.943305:0:12814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869466.943311:0:12814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869466.943436:0:12814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869466.943441:0:12814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:2.0:1788869466.947821:0:12814:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788869466.947832:0:12814:0:(obd_config.c:883:class_detach()) detach on obd MDS (uuid MDS_uuid) 00000020:00000080:2.0:1788869466.947836:0:12814:0:(genops.c:906:class_export_put()) final put ffff94c808fe4800/MDS_uuid 00000020:00000080:2.0:1788869466.947840:0:12814:0:(genops.c:865:class_export_destroy()) destroying export ffff94c808fe4800/MDS_uuid for MDS 00000020:01000000:2.0:1788869466.947843:0:12814:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MDS (MDS_uuid) 00000020:02000400:2.0:1788869466.947942:0:12814:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-MDT0000 complete 00000100:00100000:3.0:1788869467.227407:0:3284:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94c835a15880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3284:1875765421477248:0@lo:400:kworker.0 00000400:00000100:3.0:1788869467.227457:0:3284:0:(lib-move.c:4322:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875765421477248 offset 0 length 224: 4 00000100:00100000:3.0:1788869467.227502:0:3284:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788869467.227508:0:3284:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94c835a17800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:121cd5bc-7f07-4cf7-8e2e-4356c89c0696:3284:1875765421477120:0@lo:400:kworker.0 00000400:00000100:3.0:1788869467.227525:0:3284:0:(lib-move.c:4322:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1875765421477120 offset 0 length 224: 4 00000100:00100000:3.0:1788869467.227548:0:3285:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94c835a16300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3285:1875765421477376:0@lo:400:kworker.0 00000400:00000100:3.0:1788869467.227564:0:3285:0:(lib-move.c:4322:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875765421477376 offset 0 length 224: 4 00010000:00010000:1.0:1788869467.547352:0:5742:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1788869468.562746:0:12966:0:(tgt_mount.c:2192:server_umount_begin()) umount -f 00010000:00010000:3.0:1788869468.571683:0:7447:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1788869468.577386:0:12966:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-OST0000 00010000:00010000:3.0:1788869468.577427:0:12966:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.139@tcp lock: ffff94c818d1f400/0x3d2d1916761d6451 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x3d2d1916761d6458 expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869468.577442:0:12966:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.139@tcp lock: ffff94c818d1f400/0x3d2d1916761d6451 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x3d2d1916761d6458 expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869468.577450:0:12966:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.139@tcp lock: ffff94c818d1f400/0x3d2d1916761d6451 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0x3d2d1916761d6458 expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869468.577458:0:12966:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.139@tcp lock: ffff94c818d1f400/0x3d2d1916761d6451 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0x3d2d1916761d6458 expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869468.577486:0:12966:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1788869468.577492:0:12966:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:3.0:1788869468.577515:0:12966:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1788869468.577525:0:12966:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff94c835a15880 x1875765421477248/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788869483 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788869468.577547:0:12966:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00080000:3.0:1788869468.577552:0:12966:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:3.0:1788869468.577574:0:12966:0:(import.c:65:import_set_state_nolock()) ffff94c839dd3800 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00010000:00010000:2.0:1788869468.577647:0:5743:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788869468.577654:0:5743:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.139@tcp lock: ffff94c818d1f400/0x3d2d1916761d6451 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0x3d2d1916761d6458 expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869468.577662:0:5743:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94c818d1f400 already unused, calling callback (ffffffffc1ce9c20) 10000000:00010000:2.0:1788869468.577665:0:5743:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.139@tcp lock: ffff94c818d1f400/0x3d2d1916761d6451 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0x3d2d1916761d6458 expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788869468.577667:0:3282:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94c835a14000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3282:1875765421477504:0@lo:39:umount.0 00010000:00010000:2.0:1788869468.577684:0:5743:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.139@tcp lock: ffff94c818d1f400/0x3d2d1916761d6451 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1008400000000 nid: local remote: 0x3d2d1916761d6458 expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788869468.577690:0:5743:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.139@tcp lock: ffff94c818d1f400/0x3d2d1916761d6451 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1009400000000 nid: local remote: 0x3d2d1916761d6458 expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788869468.577695:0:5743:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1788869468.577697:0:5743:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:2.0:1788869468.577699:0:5743:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00000400:00000100:1.0:1788869468.577715:0:3282:0:(lib-move.c:4322:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875765421477504 offset 0 length 224: 4 00010000:00010000:2.0:1788869468.577720:0:5743:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.139@tcp lock: ffff94c818d1f400/0x3d2d1916761d6451 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0x3d2d1916761d6458 expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869468.577727:0:5743:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788869468.577751:0:5743:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.139@tcp lock: ffff94c818d1f400/0x3d2d1916761d6451 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0x3d2d1916761d6458 expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869468.577758:0:5743:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.139@tcp lock: ffff94c818d1f400/0x3d2d1916761d6451 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0x3d2d1916761d6458 expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869468.577768:0:5743:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788869468.577770:0:5743:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788869468.577771:0:5743:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788869468.577780:0:3285:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788869468.577788:0:3285:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94c835156300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:121cd5bc-7f07-4cf7-8e2e-4356c89c0696:3285:1875765421477632:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788869468.577825:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869468.577912:0:3284:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94c835a15880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3284:1875765421477248:0@lo:400:kworker.0 00000100:00100000:1.0:1788869468.577929:0:5741:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765421477632 00000100:00100000:1.0:1788869468.577940:0:5741:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765421477632 00000100:00100000:1.0:1788869468.577981:0:5741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1788869468.577987:0:5741:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c808ee6850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0+-99:3285:x1875765421477632:12345-0@lo:103:ldlm_bl.0 00010000:00020000:1.0:1788869468.577994:0:5741:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788869468 with bad export cookie 4408207194527195408 00000100:00100000:0.0:1788869468.584827:0:5741:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c808ee6850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0+-99:3285:x1875765421477632:12345-0@lo:103:ldlm_bl.0 Request processed in 6832us (6995us total) trans 0 rc -107/-107 00000100:00100000:0.0:1788869468.584841:0:5741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00080000:2.0:1788869468.584979:0:3285:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.201.139@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00080000:2.0:1788869468.584983:0:3285:0:(import.c:65:import_set_state_nolock()) ffff94c808fe1000 MGS: changing import state from FULL to DISCONN 00000100:02020000:2.0:1788869468.584986:0:3285:0:(import.c:186:ptlrpc_set_import_discon()) MGC192.168.201.139@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail 00000100:00080000:2.0:1788869468.589171:0:3285:0:(import.c:192:ptlrpc_set_import_discon()) import MGS@0@lo for MGC192.168.201.139@tcp not replayable, auto-deactivating 00000100:00080000:2.0:1788869468.589186:0:3285:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:2.0:1788869468.589194:0:3285:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff94c835a17800 x1875765421477120/t0(0) o400->MGC192.168.201.139@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1788869483 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788869468.589215:0:3285:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff94c835156300 x1875765421477632/t0(0) o103->MGC192.168.201.139@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1788869484 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 10000000:01000000:2.0:1788869468.589235:0:3285:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:2.0:1788869468.589238:0:3285:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:2.0:1788869468.589240:0:3285:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:2.0:1788869468.589244:0:3285:0:(import.c:65:import_set_state_nolock()) ffff94c808fe1000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788869468.589275:0:3285:0:(import.c:510:import_select_connection()) MGC192.168.201.139@tcp: connect to NID 0@lo last attempt 77 00000100:00080000:2.0:1788869468.589283:0:3285:0:(import.c:624:import_select_connection()) MGC192.168.201.139@tcp: import ffff94c808fe1000 using connection 192.168.201.139@tcp/0@lo 00000100:00100000:0.0:1788869468.589299:0:3284:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94c835a17800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:121cd5bc-7f07-4cf7-8e2e-4356c89c0696:3284:1875765421477120:0@lo:400:kworker.0 00000100:00100000:3.0:1788869468.589371:0:3285:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff94c835a17480 x1875765421477760/t0(0) o250->MGC192.168.201.139@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788869468.589413:0:3285:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94c835156300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:121cd5bc-7f07-4cf7-8e2e-4356c89c0696:3285:1875765421477632:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788869468.589439:0:3282:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94c835a17480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:121cd5bc-7f07-4cf7-8e2e-4356c89c0696:3282:1875765421477760:0@lo:250:ptlrpcd_00_02.0 00000400:00000100:3.0:1788869468.589528:0:3282:0:(lib-move.c:4322:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1875765421477760 offset 0 length 520: 4 00010000:00010000:1.0:1788869469.595599:0:5742:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788869470.622876:0:7447:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788869471.646626:0:5743:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1788869472.347401:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) 121cd5bc-7f07-4cf7-8e2e-4356c89c0696->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788869472.347465:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) 121cd5bc-7f07-4cf7-8e2e-4356c89c0696->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1788869472.347558:0:3284:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788869472.347575:0:3284:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94c835a16d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3284:1875765421477888:0@lo:400:kworker.0 00000400:00000100:0.0:1788869472.347637:0:3284:0:(lib-move.c:4322:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875765421477888 offset 0 length 224: 4 00010000:00010000:1.0:1788869472.668185:0:5742:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1788869473.371380:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) 121cd5bc-7f07-4cf7-8e2e-4356c89c0696->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788869473.371401:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) 121cd5bc-7f07-4cf7-8e2e-4356c89c0696->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1788869473.371488:0:3284:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94c835a17100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3284:1875765421478016:0@lo:400:kworker.0 00000400:00000100:0.0:1788869473.371546:0:3284:0:(lib-move.c:4322:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875765421478016 offset 0 length 224: 4 00010000:00010000:3.0:1788869473.694427:0:7447:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788869474.716362:0:5743:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788869475.740559:0:5742:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788869476.764102:0:7447:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788869477.787372:0:5743:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1788869478.498953:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) 121cd5bc-7f07-4cf7-8e2e-4356c89c0696->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788869478.498969:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) 121cd5bc-7f07-4cf7-8e2e-4356c89c0696->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1788869478.499617:0:3286:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788869478.499642:0:3286:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94c835155880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3286:1875765421478144:0@lo:400:kworker.0 00000400:00000100:0.0:1788869478.499711:0:3286:0:(lib-move.c:4322:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875765421478144 offset 0 length 224: 4 00010000:00010000:1.0:1788869478.811745:0:5742:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788869479.006409:0:3282:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788869468/real 1788869468] req@ffff94c835a17480 x1875765421477760/t0(0) o250->MGC192.168.201.139@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1788869478 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'ptlrpcd_00_02.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788869479.007050:0:3282:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff94c835a17480 x1875765421477760/t0(0) o250->MGC192.168.201.139@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1788869478 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'ptlrpcd_00_02.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788869479.007063:0:3282:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788869468/real 1788869468] req@ffff94c835a14000 x1875765421477504/t0(0) o39->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1788869478 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788869479.007077:0:3282:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff94c835a14000 x1875765421477504/t0(0) o39->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1788869478 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788869479.007095:0:3282:0:(import.c:65:import_set_state_nolock()) ffff94c808fe1000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788869479.007141:0:3282:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110) 00000100:00100000:2.0:1788869479.007145:0:3282:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94c835a17480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:121cd5bc-7f07-4cf7-8e2e-4356c89c0696:3282:1875765421477760:0@lo:250:ptlrpcd_00_02.0 00000100:00080000:2.0:1788869479.007151:0:3282:0:(import.c:65:import_set_state_nolock()) ffff94c839dd3800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:2.0:1788869479.007165:0:3282:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94c835a14000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3282:1875765421477504:0@lo:39:umount.0 00000100:00080000:2.0:1788869479.007210:0:12966:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1788869479.007215:0:12966:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:2.0:1788869479.007220:0:12966:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00080000:3.0:1788869479.007355:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) 121cd5bc-7f07-4cf7-8e2e-4356c89c0696->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788869479.007361:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:3.0:1788869479.007364:0:8:0:(import.c:65:import_set_state_nolock()) ffff94c808fe1000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788869479.007369:0:8:0:(import.c:510:import_select_connection()) MGC192.168.201.139@tcp: connect to NID 0@lo last attempt 216 00000100:00080000:3.0:1788869479.007374:0:8:0:(import.c:589:import_select_connection()) MGC192.168.201.139@tcp: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1788869479.007379:0:8:0:(import.c:624:import_select_connection()) MGC192.168.201.139@tcp: import ffff94c808fe1000 using connection 192.168.201.139@tcp/0@lo 00000100:00100000:3.0:1788869479.007407:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff94c835a14700 x1875765421478272/t0(0) o250->MGC192.168.201.139@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788869479.007468:0:3286:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94c835a14e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3286:1875765421478400:0@lo:400:kworker.0 00000400:00000100:3.0:1788869479.007512:0:3286:0:(lib-move.c:4322:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875765421478400 offset 0 length 224: 4 00000100:00100000:3.0:1788869479.007582:0:3282:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94c835a14700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:121cd5bc-7f07-4cf7-8e2e-4356c89c0696:3282:1875765421478272:0@lo:250:kworker.0 00000400:00000100:3.0:1788869479.007600:0:3282:0:(lib-move.c:4322:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1875765421478272 offset 0 length 520: 4 00010000:00010000:2.0:1788869479.010789:0:12966:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.139@tcp lock: ffff94c8421f2200/0x3d2d1916761d645f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x3d2d1916761d6466 expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869479.010805:0:12966:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.139@tcp lock: ffff94c8421f2200/0x3d2d1916761d645f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x3d2d1916761d6466 expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869479.010812:0:12966:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.139@tcp lock: ffff94c8421f2200/0x3d2d1916761d645f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x3d2d1916761d6466 expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869479.010818:0:12966:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.139@tcp lock: ffff94c8421f2200/0x3d2d1916761d645f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x3d2d1916761d6466 expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869479.010837:0:12966:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788869479.010844:0:12966:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.139@tcp lock: ffff94c83504d000/0x3d2d1916761d6665 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x3d2d1916761d666c expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869479.010851:0:12966:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.139@tcp lock: ffff94c83504d000/0x3d2d1916761d6665 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x3d2d1916761d666c expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869479.010857:0:12966:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.139@tcp lock: ffff94c83504d000/0x3d2d1916761d6665 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x3d2d1916761d666c expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869479.010879:0:12966:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.139@tcp lock: ffff94c83504d000/0x3d2d1916761d6665 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x3d2d1916761d666c expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869479.010896:0:12966:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:2.0:1788869479.010900:0:12966:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0000 (0) 00000020:01000004:2.0:1788869479.010920:0:12966:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-OST0000 00000020:01000000:2.0:1788869479.010923:0:12966:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000 (flags='F') 00000020:00000080:2.0:1788869479.010927:0:12966:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788869479.010932:0:12966:0:(obd_config.c:955:class_cleanup()) lustre-OST0000: forcing exports to disconnect: 0/1 00000020:00080000:2.0:1788869479.010936:0:12966:0:(genops.c:1579:class_disconnect_exports()) OBD device 11 (ffff94c808e03380) has no exports 00000020:00080000:2.0:1788869479.010956:0:12966:0:(genops.c:1579:class_disconnect_exports()) OBD device 11 (ffff94c808e03380) has no exports 00010000:00010000:0.0:1788869479.011837:0:5743:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788869479.011846:0:5743:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.139@tcp lock: ffff94c8421f2200/0x3d2d1916761d645f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x3d2d1916761d6466 expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869479.011854:0:5743:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94c8421f2200 already unused, calling callback (ffffffffc1ce9c20) 10000000:00010000:0.0:1788869479.011857:0:5743:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.139@tcp lock: ffff94c8421f2200/0x3d2d1916761d645f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x3d2d1916761d6466 expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869479.011864:0:5743:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.139@tcp lock: ffff94c8421f2200/0x3d2d1916761d645f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0x3d2d1916761d6466 expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788869479.011871:0:5743:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.139@tcp lock: ffff94c8421f2200/0x3d2d1916761d645f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0x3d2d1916761d6466 expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788869479.011876:0:5743:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1788869479.011878:0:5743:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0000: stopping, won't requeue 10000000:01000000:0.0:1788869479.011881:0:5743:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0000 00010000:00010000:0.0:1788869479.011894:0:5743:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff94c808fe1000 00010000:00010000:0.0:1788869479.011898:0:5743:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.139@tcp lock: ffff94c8421f2200/0x3d2d1916761d645f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0x3d2d1916761d6466 expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869479.011913:0:5743:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.139@tcp lock: ffff94c8421f2200/0x3d2d1916761d645f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0x3d2d1916761d6466 expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869479.011927:0:5743:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788869479.011930:0:5743:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.139@tcp lock: ffff94c83504d000/0x3d2d1916761d6665 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x3d2d1916761d666c expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869479.011936:0:5743:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94c83504d000 already unused, calling callback (ffffffffc1ce9c20) 10000000:00010000:0.0:1788869479.011939:0:5743:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.139@tcp lock: ffff94c83504d000/0x3d2d1916761d6665 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x3d2d1916761d666c expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869479.011945:0:5743:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.139@tcp lock: ffff94c83504d000/0x3d2d1916761d6665 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x3d2d1916761d666c expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788869479.011952:0:5743:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.139@tcp lock: ffff94c83504d000/0x3d2d1916761d6665 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x3d2d1916761d666c expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788869479.011957:0:5743:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:0.0:1788869479.011959:0:5743:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:0.0:1788869479.011960:0:5743:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:0.0:1788869479.011964:0:5743:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff94c808fe1000 00010000:00010000:0.0:1788869479.011977:0:5743:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.139@tcp lock: ffff94c83504d000/0x3d2d1916761d6665 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x3d2d1916761d666c expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869479.011984:0:5743:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.139@tcp lock: ffff94c83504d000/0x3d2d1916761d6665 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x3d2d1916761d666c expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869479.011992:0:5743:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788869479.011994:0:5743:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788869479.012026:0:5743:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788869479.013087:0:7447:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:2.0:1788869479.014762:0:12966:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff94c8181f9480 - data ffff94c817457000/ffff94c83547b000 00000020:01000000:2.0:1788869479.014877:0:12966:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff94c804e62240 - data ffff94c817485510/ffff94c83fba8400 00100000:10000000:2.0:1788869479.032874:0:12966:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0000-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:1.0:1788869479.098695:0:12966:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x3d2d1916761d6244 00000020:00000080:1.0:1788869479.098704:0:12966:0:(genops.c:906:class_export_put()) final put ffff94c8031bb000/lustre-OST0000-osd_UUID 00000020:01000004:1.0:1788869479.098724:0:12966:0:(tgt_mount.c:187:server_put_mount()) put mount ffff94c839dd4000 from lustre-OST0000, refs=2 00000020:01000004:1.0:1788869479.098727:0:12966:0:(obd_mount.c:710:lustre_put_lsi()) put ffff94c839dd4000 2 00000020:01000004:1.0:1788869479.098730:0:12966:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff94c839dd4000 from lustre-OST0000 00000020:00000080:1.0:1788869479.098753:0:12966:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788869479.098763:0:12966:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:00000080:1.0:1788869479.098765:0:12966:0:(genops.c:906:class_export_put()) final put ffff94c8031bc800/lustre-OST0000_UUID 00000020:00000080:1.0:1788869479.098768:0:12966:0:(genops.c:865:class_export_destroy()) destroying export ffff94c8031bc800/lustre-OST0000_UUID for lustre-OST0000 00000020:01000000:1.0:1788869479.098775:0:12966:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000 (lustre-OST0000_UUID) 00000020:01000004:1.0:1788869479.098812:0:12966:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 1 references. 00000020:01000000:1.0:1788869479.098817:0:12966:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0000 (flags='F') 00000020:00000080:1.0:1788869479.098820:0:12966:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788869479.098825:0:12966:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:1.0:1788869479.098832:0:12966:0:(genops.c:1840:print_export_data()) lustre-MDT0000-lwp-OST0000: ACTIVE ffff94c7012d0000 lustre-MDT0000-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00000080:3.0:1788869479.098839:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff94c8031bb000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00080000:1.0:1788869479.098839:0:12966:0:(genops.c:1574:class_disconnect_exports()) OBD device 12 (ffff94c8356c99c0) has exports, disconnecting them 00000020:00080000:1.0:1788869479.098846:0:12966:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0000: disconnecting export at 0@lo (ffff94c7012d0000), last request at 1788869339 00000020:00000080:1.0:1788869479.098850:0:12966:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x3d2d1916761d626e 00000020:00080000:1.0:1788869479.098860:0:12966:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff94c7012d0000): rc 0 00000020:00000080:1.0:1788869479.098866:0:12966:0:(genops.c:906:class_export_put()) final put ffff94c7012d0000/lustre-MDT0000-lwp-OST0000 00000020:00000080:3.0:1788869479.098886:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff94c7012d0000/lustre-MDT0000-lwp-OST0000 for lustre-MDT0000-lwp-OST0000 00010000:01000000:2.0:1788869479.103480:0:12966:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0000: client import never connected 00000100:00080000:2.0:1788869479.103489:0:12966:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1788869479.103493:0:12966:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:2.0:1788869479.103499:0:12966:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1788869479.103642:0:12966:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788869479.103651:0:12966:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000020:01000004:2.0:1788869479.103657:0:12966:0:(obd_mount.c:710:lustre_put_lsi()) put ffff94c839dd4000 1 00000020:00000080:2.0:1788869479.103663:0:12966:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x3d2d1916761d61fe 00000020:00000080:2.0:1788869479.103670:0:12966:0:(genops.c:906:class_export_put()) final put ffff94c82067b000/lustre-OST0000-osd_UUID 00000020:01000000:2.0:1788869479.103675:0:12966:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osd (flags='') 00000020:00000080:2.0:1788869479.103681:0:12966:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788869479.103685:0:12966:0:(obd_config.c:955:class_cleanup()) lustre-OST0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1788869479.103688:0:12966:0:(genops.c:1579:class_disconnect_exports()) OBD device 9 (ffff94c81f1acd40) has no exports 00000020:00000080:3.0:1788869479.103952:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff94c839dd3800 for lustre-MDT0000-lwp-OST0000 00000020:00000080:3.0:1788869479.103960:0:8:0:(genops.c:906:class_export_put()) final put ffff94c834dab000/lustre-MDT0000-lwp-OST0000_UUID 00000020:00000080:3.0:1788869479.103963:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff94c834dab000/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000-lwp-OST0000 00000020:01000000:3.0:1788869479.103968:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0000 (lustre-MDT0000-lwp-OST0000_UUID) 00000020:00000080:3.0:1788869479.104037:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff94c82067b000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:3.0:1788869479.136909:0:12966:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788869479.136924:0:12966:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00000020:00000080:3.0:1788869479.136933:0:12966:0:(genops.c:906:class_export_put()) final put ffff94c839dd0000/lustre-OST0000-osd_UUID 00000020:00000080:3.0:1788869479.136937:0:12966:0:(genops.c:865:class_export_destroy()) destroying export ffff94c839dd0000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:01000000:3.0:1788869479.136950:0:12966:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osd (lustre-OST0000-osd_UUID) 00000020:01000004:3.0:1788869479.137097:0:12966:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff94c839dd7800 00000020:02000400:3.0:1788869479.137140:0:12966:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-OST0000 complete 00010000:00010000:1.0:1788869479.836319:0:5742:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1788869480.528151:0:13117:0:(tgt_mount.c:2192:server_umount_begin()) umount -f 00000020:01000004:2.0:1788869480.534444:0:13117:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-OST0001 00010000:00010000:2.0:1788869480.534527:0:13117:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.139@tcp lock: ffff94c8421f3800/0x3d2d1916761d6427 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x3d2d1916761d642e expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869480.534542:0:13117:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.139@tcp lock: ffff94c8421f3800/0x3d2d1916761d6427 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x3d2d1916761d642e expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869480.534550:0:13117:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.139@tcp lock: ffff94c8421f3800/0x3d2d1916761d6427 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x3d2d1916761d642e expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869480.534558:0:13117:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.139@tcp lock: ffff94c8421f3800/0x3d2d1916761d6427 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x3d2d1916761d642e expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869480.534585:0:13117:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1788869480.534590:0:13117:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:2.0:1788869480.534609:0:13117:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1788869480.534620:0:13117:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff94c835a16300 x1875765421477376/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788869483 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788869480.534638:0:13117:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff94c835a16d80 x1875765421477888/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788869488 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788869480.534650:0:13117:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff94c835a17100 x1875765421478016/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788869489 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788869480.534659:0:13117:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff94c835155880 x1875765421478144/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788869494 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788869480.534670:0:13117:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff94c835a14e00 x1875765421478400/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788869495 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788869480.534677:0:13117:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 3 00000100:00080000:2.0:1788869480.534682:0:13117:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00080000:2.0:1788869480.534703:0:13117:0:(import.c:65:import_set_state_nolock()) ffff94c835502000 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00010000:00010000:0.0:1788869480.534756:0:5743:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788869480.534763:0:5743:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.139@tcp lock: ffff94c8421f3800/0x3d2d1916761d6427 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x3d2d1916761d642e expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869480.534771:0:5743:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94c8421f3800 already unused, calling callback (ffffffffc1ce9c20) 10000000:00010000:0.0:1788869480.534775:0:5743:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.139@tcp lock: ffff94c8421f3800/0x3d2d1916761d6427 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x3d2d1916761d642e expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869480.534783:0:5743:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.139@tcp lock: ffff94c8421f3800/0x3d2d1916761d6427 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x3d2d1916761d642e expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788869480.534790:0:5743:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.139@tcp lock: ffff94c8421f3800/0x3d2d1916761d6427 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x3d2d1916761d642e expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788869480.534796:0:5743:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1788869480.534799:0:5743:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:0.0:1788869480.534802:0:5743:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:0.0:1788869480.534829:0:5743:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff94c808fe1000 00010000:00010000:0.0:1788869480.534833:0:5743:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.139@tcp lock: ffff94c8421f3800/0x3d2d1916761d6427 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x3d2d1916761d642e expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788869480.534837:0:3285:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94c835a16300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3285:1875765421477376:0@lo:400:kworker.0 00010000:00010000:0.0:1788869480.534844:0:5743:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.139@tcp lock: ffff94c8421f3800/0x3d2d1916761d6427 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x3d2d1916761d642e expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869480.534858:0:5743:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788869480.534870:0:5743:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788869480.534873:0:5743:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788869480.534879:0:3286:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94c835a14e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3286:1875765421478400:0@lo:400:kworker.0 00000100:00100000:0.0:1788869480.534895:0:3284:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94c835a17100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3284:1875765421478016:0@lo:400:kworker.0 00000100:00100000:3.0:1788869480.534902:0:3286:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94c835155880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3286:1875765421478144:0@lo:400:kworker.0 00000100:00100000:0.0:1788869480.534909:0:3284:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94c835a16d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3284:1875765421477888:0@lo:400:kworker.0 00000100:00100000:3.0:1788869480.534938:0:3282:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94c835157480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3282:1875765421478528:0@lo:39:umount.0 00000400:00000100:3.0:1788869480.535017:0:3282:0:(lib-move.c:4322:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875765421478528 offset 0 length 224: 4 00010000:00010000:3.0:1788869480.861140:0:7447:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788869481.883452:0:5742:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788869482.907984:0:5743:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788869483.931481:0:7447:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1788869484.125666:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) 121cd5bc-7f07-4cf7-8e2e-4356c89c0696->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788869484.125676:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) 121cd5bc-7f07-4cf7-8e2e-4356c89c0696->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00010000:00010000:1.0:1788869484.955933:0:5742:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788869485.979900:0:5743:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788869487.003533:0:7447:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788869488.031178:0:5742:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788869489.051457:0:5743:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1788869489.243390:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 121cd5bc-7f07-4cf7-8e2e-4356c89c0696->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788869489.243398:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) 121cd5bc-7f07-4cf7-8e2e-4356c89c0696->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00010000:00010000:3.0:1788869490.075740:0:7447:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788869490.715332:0:3282:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788869480/real 1788869480] req@ffff94c835157480 x1875765421478528/t0(0) o39->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1788869490 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788869490.715358:0:3282:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff94c835157480 x1875765421478528/t0(0) o39->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1788869490 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788869490.715373:0:3282:0:(import.c:65:import_set_state_nolock()) ffff94c835502000 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:3.0:1788869490.715386:0:3282:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94c835157480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3282:1875765421478528:0@lo:39:umount.0 00000100:00080000:2.0:1788869490.715416:0:13117:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1788869490.715426:0:13117:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 4 00000100:00100000:2.0:1788869490.715434:0:13117:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:2.0:1788869490.716316:0:13117:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.139@tcp lock: ffff94c80153b200/0x3d2d1916761d6435 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x3d2d1916761d643c expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869490.716329:0:13117:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.139@tcp lock: ffff94c80153b200/0x3d2d1916761d6435 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x3d2d1916761d643c expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869490.716336:0:13117:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.139@tcp lock: ffff94c80153b200/0x3d2d1916761d6435 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x3d2d1916761d643c expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869490.716344:0:13117:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.139@tcp lock: ffff94c80153b200/0x3d2d1916761d6435 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x3d2d1916761d643c expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869490.716365:0:13117:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788869490.716372:0:13117:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.139@tcp lock: ffff94c805038200/0x3d2d1916761d6657 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3d2d1916761d665e expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869490.716380:0:13117:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.139@tcp lock: ffff94c805038200/0x3d2d1916761d6657 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x3d2d1916761d665e expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869490.716388:0:13117:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.139@tcp lock: ffff94c805038200/0x3d2d1916761d6657 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x3d2d1916761d665e expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869490.716394:0:13117:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.139@tcp lock: ffff94c805038200/0x3d2d1916761d6657 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x3d2d1916761d665e expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869490.716400:0:5742:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788869490.716409:0:13117:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1788869490.716413:0:13117:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0001 (0) 00010000:00010000:1.0:1788869490.716421:0:5742:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.139@tcp lock: ffff94c80153b200/0x3d2d1916761d6435 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x3d2d1916761d643c expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1788869490.716431:0:13117:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-OST0001 00010000:00010000:1.0:1788869490.716432:0:5742:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94c80153b200 already unused, calling callback (ffffffffc1ce9c20) 00000020:01000000:2.0:1788869490.716438:0:13117:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001 (flags='F') 10000000:00010000:1.0:1788869490.716438:0:5742:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.139@tcp lock: ffff94c80153b200/0x3d2d1916761d6435 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x3d2d1916761d643c expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000080:2.0:1788869490.716451:0:13117:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00010000:00010000:1.0:1788869490.716451:0:5742:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.139@tcp lock: ffff94c80153b200/0x3d2d1916761d6435 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x3d2d1916761d643c expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000080:2.0:1788869490.716458:0:13117:0:(obd_config.c:955:class_cleanup()) lustre-OST0001: forcing exports to disconnect: 0/1 10000000:00010000:1.0:1788869490.716461:0:5742:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.139@tcp lock: ffff94c80153b200/0x3d2d1916761d6435 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x3d2d1916761d643c expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:2.0:1788869490.716464:0:13117:0:(genops.c:1579:class_disconnect_exports()) OBD device 15 (ffff94c8060acd40) has no exports 00010000:00010000:0.0:1788869490.716465:0:5743:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 10000000:01000000:1.0:1788869490.716473:0:5742:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1788869490.716476:0:5742:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0001: stopping, won't requeue 00010000:00010000:0.0:1788869490.716476:0:5743:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.139@tcp lock: ffff94c805038200/0x3d2d1916761d6657 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x3d2d1916761d665e expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788869490.716481:0:5742:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0001 00010000:00010000:0.0:1788869490.716489:0:5743:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94c805038200 already unused, calling callback (ffffffffc1ce9c20) 10000000:00010000:0.0:1788869490.716494:0:5743:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.139@tcp lock: ffff94c805038200/0x3d2d1916761d6657 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x3d2d1916761d665e expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:2.0:1788869490.716495:0:13117:0:(genops.c:1579:class_disconnect_exports()) OBD device 15 (ffff94c8060acd40) has no exports 00010000:00010000:0.0:1788869490.716505:0:5743:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.139@tcp lock: ffff94c805038200/0x3d2d1916761d6657 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x3d2d1916761d665e expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869490.716506:0:5742:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff94c808fe1000 00010000:00010000:1.0:1788869490.716512:0:5742:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.139@tcp lock: ffff94c80153b200/0x3d2d1916761d6435 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x3d2d1916761d643c expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788869490.716518:0:5743:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.139@tcp lock: ffff94c805038200/0x3d2d1916761d6657 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x3d2d1916761d665e expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869490.716524:0:5742:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.139@tcp lock: ffff94c80153b200/0x3d2d1916761d6435 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x3d2d1916761d643c expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788869490.716529:0:5743:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:0.0:1788869490.716535:0:5743:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:0.0:1788869490.716538:0:5743:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:1.0:1788869490.716543:0:5742:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788869490.716546:0:5742:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788869490.716548:0:5743:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff94c808fe1000 00010000:00010000:1.0:1788869490.716555:0:5742:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788869490.716565:0:5743:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.139@tcp lock: ffff94c805038200/0x3d2d1916761d6657 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0x3d2d1916761d665e expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869490.716573:0:5743:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.139@tcp lock: ffff94c805038200/0x3d2d1916761d6657 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0x3d2d1916761d665e expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869490.716589:0:5743:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788869490.716591:0:5743:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788869490.716593:0:5743:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:2.0:1788869490.718141:0:13117:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff94c8181f94e0 - data ffff94c83ffaa5e8/ffff94c83547bc00 00000020:01000000:2.0:1788869490.718319:0:13117:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff94c808f94240 - data ffff94c83038a288/ffff94c83ca26000 00100000:10000000:2.0:1788869490.726158:0:13117:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0001-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:1.0:1788869490.735648:0:13117:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x3d2d1916761d630f 00000020:00000080:1.0:1788869490.735660:0:13117:0:(genops.c:906:class_export_put()) final put ffff94c834daa000/lustre-OST0001-osd_UUID 00000020:01000004:1.0:1788869490.735682:0:13117:0:(tgt_mount.c:187:server_put_mount()) put mount ffff94c83f970800 from lustre-OST0001, refs=2 00000020:01000004:1.0:1788869490.735691:0:13117:0:(obd_mount.c:710:lustre_put_lsi()) put ffff94c83f970800 2 00000020:01000004:1.0:1788869490.735696:0:13117:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff94c83f970800 from lustre-OST0001 00000020:00000080:3.0:1788869490.735712:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff94c834daa000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:00000080:1.0:1788869490.735730:0:13117:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788869490.735741:0:13117:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:00000080:1.0:1788869490.735745:0:13117:0:(genops.c:906:class_export_put()) final put ffff94c834dad000/lustre-OST0001_UUID 00000020:00000080:1.0:1788869490.735748:0:13117:0:(genops.c:865:class_export_destroy()) destroying export ffff94c834dad000/lustre-OST0001_UUID for lustre-OST0001 00000020:01000000:1.0:1788869490.735766:0:13117:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001 (lustre-OST0001_UUID) 00000100:00080000:1.0:1788869490.735874:0:13117:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import 121cd5bc-7f07-4cf7-8e2e-4356c89c0696->MGS 00010000:00010000:1.0:1788869490.735889:0:13117:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.139@tcp lock: ffff94c818d1e400/0x3d2d1916761d6221 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x3d2d1916761d6228 expref: -99 pid: 6543 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788869490.735902:0:13117:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.139@tcp lock: ffff94c818d1e400/0x3d2d1916761d6221 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x3d2d1916761d6228 expref: -99 pid: 6543 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788869490.735913:0:13117:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 10000000:01000000:1.0:1788869490.735916:0:13117:0:(mgc_request.c:954:mgc_blocking_ast()) log nodemap: disconnecting, won't requeue 10000000:01000000:1.0:1788869490.735919:0:13117:0:(mgc_request.c:130:config_log_put()) dropping config log nodemap 00010000:00010000:1.0:1788869490.735935:0:13117:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff94c808fe1000 00010000:00010000:1.0:1788869490.735938:0:13117:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.139@tcp lock: ffff94c818d1e400/0x3d2d1916761d6221 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x3d2d1916761d6228 expref: -99 pid: 6543 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869490.735954:0:13117:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.139@tcp lock: ffff94c80153bc00/0x3d2d1916761d64a5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x3d2d1916761d64ac expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788869490.735961:0:13117:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.139@tcp lock: ffff94c80153bc00/0x3d2d1916761d64a5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x3d2d1916761d64ac expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788869490.735967:0:13117:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1788869490.735979:0:13117:0:(mgc_request.c:954:mgc_blocking_ast()) log lustre-s: disconnecting, won't requeue 10000000:01000000:1.0:1788869490.735980:0:13117:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-sptlrpc 00010000:00010000:1.0:1788869490.735990:0:13117:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff94c808fe1000 00010000:00010000:1.0:1788869490.735994:0:13117:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.139@tcp lock: ffff94c80153bc00/0x3d2d1916761d64a5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x3d2d1916761d64ac expref: -99 pid: 5752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1788869490.736014:0:13117:0:(import.c:65:import_set_state_nolock()) ffff94c808fe1000 MGS: changing import state from CONNECTING to CLOSED 10000000:01000000:1.0:1788869490.736018:0:13117:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:1.0:1788869490.736020:0:13117:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:1.0:1788869490.736022:0:13117:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:1.0:1788869490.736025:0:13117:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:1.0:1788869490.736037:0:13117:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff94c835a14700 x1875765421478272/t0(0) o250->MGC192.168.201.139@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 1788869494 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 10000000:01000000:1.0:1788869490.736064:0:13117:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:1.0:1788869490.736066:0:13117:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 5s for inflight to error out 00000100:00100000:3.0:1788869490.736101:0:3282:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94c835a14700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:121cd5bc-7f07-4cf7-8e2e-4356c89c0696:3282:1875765421478272:0@lo:250:kworker.0 10000000:01000000:1.0:1788869490.736122:0:13117:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:1.0:1788869490.736130:0:13117:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x3d2d1916761d6102 00000020:00000080:1.0:1788869490.736135:0:13117:0:(genops.c:906:class_export_put()) final put ffff94c808fe6800/121cd5bc-7f07-4cf7-8e2e-4356c89c0696 00000020:01000000:1.0:1788869490.736149:0:13117:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGC192.168.201.139@tcp (flags='') 00000020:00000080:1.0:1788869490.736153:0:13117:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788869490.736157:0:13117:0:(obd_config.c:955:class_cleanup()) MGC192.168.201.139@tcp: forcing exports to disconnect: 0/3 00000020:00080000:1.0:1788869490.736161:0:13117:0:(genops.c:1579:class_disconnect_exports()) OBD device 2 (ffff94c81f1a99c0) has no exports 00000020:00000080:3.0:1788869490.736230:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff94c808fe6800/121cd5bc-7f07-4cf7-8e2e-4356c89c0696 for MGC192.168.201.139@tcp 10000000:01000000:0.0:1788869490.736375:0:5752:0:(mgc_request.c:708:mgc_requeue_thread()) Ending requeue thread 10000000:01000000:1.0:1788869490.736386:0:13117:0:(obd_class.h:671:obd_cleanup_client_import()) MGC192.168.201.139@tcp: client import never connected 00000100:00080000:1.0:1788869490.736395:0:13117:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 10000000:01000000:1.0:1788869490.736397:0:13117:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:1.0:1788869490.736400:0:13117:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 10000000:01000000:1.0:1788869490.736403:0:13117:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:3.0:1788869490.736435:0:36:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff94c808fe1000 for MGC192.168.201.139@tcp 00000020:00000080:1.0:1788869490.736444:0:13117:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788869490.736450:0:13117:0:(obd_config.c:883:class_detach()) detach on obd MGC192.168.201.139@tcp (uuid 121cd5bc-7f07-4cf7-8e2e-4356c89c0696) 00000020:00000080:1.0:1788869490.736458:0:13117:0:(genops.c:906:class_export_put()) final put ffff94c808fe0800/121cd5bc-7f07-4cf7-8e2e-4356c89c0696 00000020:00000080:1.0:1788869490.736461:0:13117:0:(genops.c:865:class_export_destroy()) destroying export ffff94c808fe0800/121cd5bc-7f07-4cf7-8e2e-4356c89c0696 for MGC192.168.201.139@tcp 00000020:01000000:1.0:1788869490.736466:0:13117:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGC192.168.201.139@tcp (121cd5bc-7f07-4cf7-8e2e-4356c89c0696) 00000020:01000000:1.0:1788869490.736837:0:13117:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0001 (flags='F') 00000020:00000080:1.0:1788869490.736840:0:13117:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788869490.736843:0:13117:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-lwp-OST0001: forcing exports to disconnect: 1/3 00000020:00080000:1.0:1788869490.736846:0:13117:0:(genops.c:1840:print_export_data()) lustre-MDT0000-lwp-OST0001: ACTIVE ffff94c835507000 lustre-MDT0000-lwp-OST0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1788869490.736850:0:13117:0:(genops.c:1574:class_disconnect_exports()) OBD device 16 (ffff94c8356ccd40) has exports, disconnecting them 00000020:00080000:1.0:1788869490.736853:0:13117:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0001: disconnecting export at 0@lo (ffff94c835507000), last request at 1788869350 00000020:00000080:1.0:1788869490.736856:0:13117:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x3d2d1916761d6339 00000020:00080000:1.0:1788869490.736864:0:13117:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff94c835507000): rc 0 00000020:00000080:1.0:1788869490.736867:0:13117:0:(genops.c:906:class_export_put()) final put ffff94c835507000/lustre-MDT0000-lwp-OST0001 00000020:00000080:3.0:1788869490.736883:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff94c835507000/lustre-MDT0000-lwp-OST0001 for lustre-MDT0000-lwp-OST0001 00010000:01000000:0.0:1788869490.739293:0:13117:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0001: client import never connected 00000100:00080000:0.0:1788869490.739301:0:13117:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1788869490.739305:0:13117:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 5 00000100:00100000:0.0:1788869490.739312:0:13117:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1788869490.739351:0:36:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff94c835502000 for lustre-MDT0000-lwp-OST0001 00010000:00010000:3.0:1788869490.739378:0:7447:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-1 blwis in pool) 00010000:00010000:2.0:1788869490.739426:0:5742:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-2 blwis in pool) 00010000:00010000:0.0:1788869490.739457:0:5743:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-3 blwis in pool) 00000100:00100000:3.0:1788869490.739620:0:5737:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_000: service thread [ffff94c810f0c000:5737] 0 exiting: rc = 1 00000100:00100000:2.0:1788869490.739620:0:5738:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_001: service thread [ffff94c818358e00:5738] 1 exiting: rc = 0 00000100:00100000:2.0:1788869490.739692:0:5787:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_002: service thread [ffff94c808fc4800:5787] 2 exiting: rc = 0 00000100:00100000:3.0:1788869490.739735:0:11468:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_003: service thread [ffff94c82cdbf000:11468] 3 exiting: rc = 0 00000100:00100000:0.0:1788869490.739794:0:13117:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869490.740020:0:5741:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_002: service thread [ffff94c80877da00:5741] 2 exiting: rc = 0 00000100:00100000:2.0:1788869490.740043:0:5788:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_003: service thread [ffff94c805390800:5788] 3 exiting: rc = 0 00000100:00100000:3.0:1788869490.740096:0:7448:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_004: service thread [ffff94c82076fe00:7448] 4 exiting: rc = 0 00000100:00100000:3.0:1788869490.740179:0:5739:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_000: service thread [ffff94c820cc2600:5739] 0 exiting: rc = 1 00000100:00100000:1.0:1788869490.740573:0:5740:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_001: service thread [ffff94c820cc2000:5740] 1 exiting: rc = 0 00000100:00100000:0.0:1788869490.740621:0:13117:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869490.740627:0:13117:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869490.740633:0:13117:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869490.740638:0:13117:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869490.740644:0:13117:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869490.740650:0:13117:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869490.740654:0:13117:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869490.740658:0:13117:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869490.740662:0:13117:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869490.740666:0:13117:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869490.740669:0:13117:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869490.740673:0:13117:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869490.740677:0:13117:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869490.740681:0:13117:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869490.740685:0:13117:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869490.740690:0:13117:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869490.740694:0:13117:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869490.740698:0:13117:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869490.740701:0:13117:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869490.740705:0:13117:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869490.740708:0:13117:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869490.740711:0:13117:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869490.740715:0:13117:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869490.740721:0:13117:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869490.740726:0:13117:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869490.740730:0:13117:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869490.740749:0:13117:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869490.740772:0:13117:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869490.740779:0:13117:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869490.740783:0:13117:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869490.740787:0:13117:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869490.740792:0:13117:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869490.740798:0:13117:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869490.740803:0:13117:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869490.740808:0:13117:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869490.740813:0:13117:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869490.740818:0:13117:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869490.740824:0:13117:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869490.740829:0:13117:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869490.740835:0:13117:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869490.740840:0:13117:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869490.740845:0:13117:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869490.740850:0:13117:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869490.740856:0:13117:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869490.740863:0:13117:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869490.740869:0:13117:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869490.740874:0:13117:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869490.740879:0:13117:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869490.740884:0:13117:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869490.740890:0:13117:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869490.740895:0:13117:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869490.740900:0:13117:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869490.740905:0:13117:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869490.740910:0:13117:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869490.740914:0:13117:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869490.740919:0:13117:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869490.740924:0:13117:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869490.740928:0:13117:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869490.740933:0:13117:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869490.740939:0:13117:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869490.740943:0:13117:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869490.740955:0:13117:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869490.740960:0:13117:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869490.740966:0:13117:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:0.0:1788869490.741725:0:13117:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788869490.741735:0:13117:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000020:00000080:0.0:1788869490.741740:0:13117:0:(genops.c:906:class_export_put()) final put ffff94c835506000/lustre-MDT0000-lwp-OST0001_UUID 00000020:00000080:0.0:1788869490.741744:0:13117:0:(genops.c:865:class_export_destroy()) destroying export ffff94c835506000/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000-lwp-OST0001 00000020:01000000:0.0:1788869490.741750:0:13117:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0001 (lustre-MDT0000-lwp-OST0001_UUID) 00000020:01000004:0.0:1788869490.741808:0:13117:0:(obd_mount.c:710:lustre_put_lsi()) put ffff94c83f970800 1 00000020:00000080:0.0:1788869490.741813:0:13117:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x3d2d1916761d62de 00000020:00000080:0.0:1788869490.741820:0:13117:0:(genops.c:906:class_export_put()) final put ffff94c8031b9000/lustre-OST0001-osd_UUID 00000020:01000000:0.0:1788869490.741838:0:13117:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osd (flags='') 00000020:00000080:0.0:1788869490.741842:0:13117:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788869490.741847:0:13117:0:(obd_config.c:955:class_cleanup()) lustre-OST0001-osd: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1788869490.741851:0:13117:0:(genops.c:1579:class_disconnect_exports()) OBD device 14 (ffff94c8356cb380) has no exports 00000020:00000080:2.0:1788869490.741908:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff94c8031b9000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:00000080:0.0:1788869490.751667:0:13117:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788869490.751683:0:13117:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00000020:00000080:0.0:1788869490.751690:0:13117:0:(genops.c:906:class_export_put()) final put ffff94c83f977800/lustre-OST0001-osd_UUID 00000020:00000080:0.0:1788869490.751695:0:13117:0:(genops.c:865:class_export_destroy()) destroying export ffff94c83f977800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:01000000:0.0:1788869490.751704:0:13117:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osd (lustre-OST0001-osd_UUID) 00000020:01000004:0.0:1788869490.751983:0:13117:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff94c83f972000 00000020:01000000:0.0:1788869490.752015:0:13117:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of OSS (flags='F') 00000020:00000080:0.0:1788869490.752021:0:13117:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788869490.752026:0:13117:0:(obd_config.c:955:class_cleanup()) OSS: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1788869490.752030:0:13117:0:(genops.c:1579:class_disconnect_exports()) OBD device 10 (ffff94c808e019c0) has no exports 00000020:00000080:0.0:1788869490.752074:0:13117:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788869490.752083:0:13117:0:(obd_config.c:883:class_detach()) detach on obd OSS (uuid OSS_uuid) 00000020:00000080:0.0:1788869490.752087:0:13117:0:(genops.c:906:class_export_put()) final put ffff94c82067e000/OSS_uuid 00000020:00000080:0.0:1788869490.752089:0:13117:0:(genops.c:865:class_export_destroy()) destroying export ffff94c82067e000/OSS_uuid for OSS 00000020:01000000:0.0:1788869490.752093:0:13117:0:(genops.c:441:class_free_dev()) finishing cleanup of obd OSS (OSS_uuid) 00000100:00080000:1.0:1788869490.752155:0:5751:0:(pinger.c:548:ping_evictor_main()) Exiting Ping Evictor 00000100:00100000:3.0:1788869490.752337:0:6546:0:(service.c:3183:ptlrpc_main()) ll_ost00_001: service thread [ffff94c8206f9600:6546] 1 exiting: rc = 0 00000100:00100000:1.0:1788869490.752372:0:6544:0:(service.c:3183:ptlrpc_main()) ll_ost00_000: service thread [ffff94c808f4de00:6544] 0 exiting: rc = 1 00000100:00100000:3.0:1788869490.752432:0:11822:0:(service.c:3183:ptlrpc_main()) ll_ost00_004: service thread [ffff94c83f9e3800:11822] 4 exiting: rc = 0 00000100:00100000:1.0:1788869490.752459:0:6547:0:(service.c:3183:ptlrpc_main()) ll_ost00_002: service thread [ffff94c8206f9200:6547] 2 exiting: rc = 0 00000100:00100000:0.0:1788869490.752564:0:7884:0:(service.c:3183:ptlrpc_main()) ll_ost00_003: service thread [ffff94c808e78a00:7884] 3 exiting: rc = 0 00000100:00100000:0.0:1788869490.752652:0:13117:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869490.752679:0:13117:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869490.752687:0:13117:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869490.752693:0:13117:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869490.752702:0:13117:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869490.752707:0:13117:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869490.752712:0:13117:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869490.752717:0:13117:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869490.752722:0:13117:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869490.752765:0:13117:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869490.752775:0:13117:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869490.752784:0:13117:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869490.752791:0:13117:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869490.752796:0:13117:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869490.752801:0:13117:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869490.752807:0:13117:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869490.752814:0:13117:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869490.752819:0:13117:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869490.752825:0:13117:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869490.752832:0:13117:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869490.752840:0:13117:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869490.752846:0:13117:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869490.752853:0:13117:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869490.752859:0:13117:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869490.752866:0:13117:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869490.752872:0:13117:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869490.752879:0:13117:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869490.752885:0:13117:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869490.752892:0:13117:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869490.752899:0:13117:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869490.752906:0:13117:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869490.752913:0:13117:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869490.752919:0:13117:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869490.752925:0:13117:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869490.752931:0:13117:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869490.752938:0:13117:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869490.752952:0:13117:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869490.752959:0:13117:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869490.752965:0:13117:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869490.752970:0:13117:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869490.752975:0:13117:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869490.752981:0:13117:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869490.752988:0:13117:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869490.752995:0:13117:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869490.753003:0:13117:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869490.753009:0:13117:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869490.753015:0:13117:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869490.753021:0:13117:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869490.753029:0:13117:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869490.753036:0:13117:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869490.753042:0:13117:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869490.753049:0:13117:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869490.753057:0:13117:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869490.753064:0:13117:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869490.753072:0:13117:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869490.753079:0:13117:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869490.753086:0:13117:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869490.753093:0:13117:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869490.753101:0:13117:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869490.753108:0:13117:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869490.753115:0:13117:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869490.753120:0:13117:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869490.753138:0:13117:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869490.753146:0:13117:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869490.754430:0:6549:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_001: service thread [ffff94c8206f9c00:6549] 1 exiting: rc = 0 00000100:00100000:1.0:1788869490.754548:0:6548:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_000: service thread [ffff94c8206f8a00:6548] 0 exiting: rc = 1 00000100:00100000:0.0:1788869490.754598:0:13117:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869490.754610:0:13117:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869490.754616:0:13117:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869490.754625:0:13117:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869490.754632:0:13117:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869490.754639:0:13117:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869490.754647:0:13117:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869490.754660:0:13117:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869490.754666:0:13117:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869490.754671:0:13117:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869490.754676:0:13117:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869490.754682:0:13117:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869490.754688:0:13117:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869490.754695:0:13117:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869490.754701:0:13117:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869490.754710:0:13117:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869490.754717:0:13117:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869490.754725:0:13117:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869490.754733:0:13117:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869490.754741:0:13117:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869490.754748:0:13117:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869490.754770:0:13117:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869490.754778:0:13117:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869490.754786:0:13117:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869490.754793:0:13117:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869490.754800:0:13117:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869490.754806:0:13117:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869490.754815:0:13117:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869490.754823:0:13117:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869490.754830:0:13117:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869490.754837:0:13117:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869490.754845:0:13117:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869490.754853:0:13117:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869490.754860:0:13117:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869490.754869:0:13117:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869490.754875:0:13117:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869490.754883:0:13117:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869490.754892:0:13117:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869490.754899:0:13117:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869490.754905:0:13117:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869490.754913:0:13117:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869490.754920:0:13117:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869490.754935:0:13117:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869490.754942:0:13117:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869490.754950:0:13117:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869490.754958:0:13117:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869490.754965:0:13117:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869490.754972:0:13117:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869490.754980:0:13117:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869490.754986:0:13117:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869490.754993:0:13117:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869490.755000:0:13117:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869490.755007:0:13117:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869490.755014:0:13117:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869490.755024:0:13117:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869490.755031:0:13117:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869490.755039:0:13117:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869490.755047:0:13117:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869490.755056:0:13117:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869490.755064:0:13117:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869490.755072:0:13117:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869490.755079:0:13117:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869490.755086:0:13117:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869490.755093:0:13117:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869490.756810:0:6550:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_000: service thread [ffff94c8206f8400:6550] 0 exiting: rc = 1 00000100:00100000:3.0:1788869490.757012:0:6552:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_002: service thread [ffff94c8206f9000:6552] 2 exiting: rc = 0 00000100:00100000:0.0:1788869490.757048:0:6551:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_001: service thread [ffff94c8206f9a00:6551] 1 exiting: rc = 0 00000100:00100000:1.0:1788869490.757058:0:11821:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_003: service thread [ffff94c7034afe00:11821] 3 exiting: rc = 0 00000100:00100000:0.0:1788869490.757185:0:13117:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869490.757196:0:13117:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869490.757207:0:13117:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869490.757218:0:13117:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869490.757229:0:13117:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869490.757239:0:13117:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869490.757271:0:13117:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869490.757283:0:13117:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869490.757295:0:13117:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869490.757307:0:13117:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869490.757316:0:13117:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869490.757327:0:13117:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869490.757350:0:13117:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869490.757362:0:13117:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869490.757373:0:13117:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869490.757384:0:13117:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869490.757414:0:13117:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869490.757425:0:13117:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869490.757434:0:13117:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869490.757444:0:13117:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869490.757454:0:13117:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869490.757464:0:13117:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869490.757474:0:13117:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869490.757486:0:13117:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869490.757496:0:13117:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869490.757506:0:13117:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869490.757515:0:13117:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869490.757526:0:13117:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869490.757537:0:13117:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869490.757549:0:13117:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869490.757560:0:13117:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869490.757569:0:13117:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869490.757579:0:13117:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869490.757589:0:13117:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869490.757598:0:13117:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869490.757609:0:13117:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869490.757621:0:13117:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869490.757631:0:13117:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869490.757641:0:13117:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869490.757654:0:13117:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869490.757689:0:13117:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869490.757699:0:13117:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869490.757707:0:13117:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869490.757717:0:13117:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869490.757729:0:13117:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869490.757740:0:13117:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869490.757766:0:13117:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869490.757785:0:13117:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869490.757797:0:13117:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869490.757809:0:13117:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869490.757819:0:13117:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869490.757831:0:13117:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869490.757842:0:13117:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869490.757852:0:13117:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869490.757862:0:13117:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869490.757873:0:13117:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869490.757885:0:13117:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869490.757895:0:13117:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869490.757906:0:13117:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869490.757917:0:13117:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869490.757929:0:13117:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869490.757942:0:13117:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869490.757971:0:13117:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869490.757982:0:13117:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869490.761092:0:6553:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_000: service thread [ffff94c834f0c400:6553] 0 exiting: rc = 1 00000100:00100000:1.0:1788869490.761092:0:6554:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_001: service thread [ffff94c834f0da00:6554] 1 exiting: rc = 0 00000100:00100000:0.0:1788869490.761144:0:13117:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869490.761155:0:13117:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869490.761165:0:13117:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869490.761176:0:13117:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869490.761185:0:13117:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869490.761191:0:13117:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869490.761196:0:13117:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869490.761200:0:13117:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869490.761206:0:13117:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869490.761210:0:13117:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869490.761215:0:13117:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869490.761219:0:13117:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869490.761224:0:13117:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869490.761229:0:13117:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869490.761234:0:13117:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869490.761238:0:13117:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869490.761243:0:13117:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869490.761273:0:13117:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869490.761324:0:13117:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869490.761331:0:13117:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869490.761336:0:13117:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869490.761340:0:13117:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869490.761345:0:13117:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869490.761349:0:13117:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869490.761354:0:13117:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869490.761359:0:13117:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869490.761364:0:13117:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869490.761369:0:13117:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869490.761374:0:13117:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869490.761379:0:13117:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869490.761383:0:13117:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869490.761388:0:13117:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869490.761393:0:13117:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869490.761397:0:13117:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869490.761402:0:13117:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869490.761407:0:13117:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869490.761412:0:13117:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869490.761416:0:13117:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869490.761421:0:13117:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869490.761426:0:13117:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869490.761430:0:13117:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869490.761435:0:13117:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869490.761440:0:13117:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869490.761444:0:13117:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869490.761448:0:13117:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869490.761453:0:13117:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869490.761457:0:13117:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869490.761461:0:13117:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869490.761466:0:13117:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869490.761470:0:13117:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869490.761475:0:13117:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869490.761480:0:13117:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869490.761485:0:13117:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869490.761495:0:13117:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869490.761500:0:13117:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869490.761505:0:13117:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869490.761510:0:13117:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869490.761515:0:13117:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869490.761520:0:13117:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869490.761525:0:13117:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869490.761530:0:13117:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869490.761535:0:13117:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869490.761539:0:13117:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869490.761544:0:13117:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869490.762136:0:6555:0:(service.c:3183:ptlrpc_main()) ll_ost_out00_000: service thread [ffff94c82cc84c00:6555] 0 exiting: rc = 1 00000100:00100000:1.0:1788869490.762137:0:6556:0:(service.c:3183:ptlrpc_main()) ll_ost_out00_001: service thread [ffff94c82cc84000:6556] 1 exiting: rc = 0 00000100:00100000:0.0:1788869490.762175:0:13117:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869490.762197:0:13117:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869490.762204:0:13117:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869490.762210:0:13117:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869490.762216:0:13117:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869490.762221:0:13117:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869490.762231:0:13117:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869490.762238:0:13117:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869490.762244:0:13117:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869490.762278:0:13117:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869490.762287:0:13117:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869490.762298:0:13117:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869490.762309:0:13117:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869490.762320:0:13117:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869490.762332:0:13117:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869490.762343:0:13117:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869490.762354:0:13117:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869490.762369:0:13117:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869490.762400:0:13117:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869490.762412:0:13117:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869490.762419:0:13117:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869490.762428:0:13117:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869490.762438:0:13117:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869490.762444:0:13117:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869490.762457:0:13117:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869490.762464:0:13117:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869490.762471:0:13117:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869490.762479:0:13117:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869490.762489:0:13117:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869490.762495:0:13117:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869490.762521:0:13117:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869490.762532:0:13117:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869490.762539:0:13117:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869490.762546:0:13117:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869490.762552:0:13117:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869490.762559:0:13117:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869490.762569:0:13117:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869490.762578:0:13117:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869490.762586:0:13117:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869490.762593:0:13117:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869490.762603:0:13117:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869490.762614:0:13117:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869490.762638:0:13117:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869490.762644:0:13117:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869490.762649:0:13117:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869490.762655:0:13117:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869490.762662:0:13117:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869490.762669:0:13117:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869490.762675:0:13117:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869490.762681:0:13117:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869490.762688:0:13117:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869490.762693:0:13117:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869490.762699:0:13117:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869490.762706:0:13117:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869490.762722:0:13117:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869490.762729:0:13117:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869490.762735:0:13117:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869490.762740:0:13117:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869490.762746:0:13117:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869490.762775:0:13117:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869490.762784:0:13117:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869490.762791:0:13117:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869490.762798:0:13117:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869490.762803:0:13117:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:02000400:0.0:1788869490.768005:0:13117:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-OST0001 complete 00000001:02000400:3.0:1788869505.511605:0:13736:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg139-server.virtnet: executing load_modules_local 00000020:01000004:1.0:1788869513.726686:0:14150:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:1.0:1788869513.726712:0:14150:0:(obd_mount.c:926:lmd_print()) device: lustre-mdt1/mdt1 00000080:01200004:1.0:1788869513.726822:0:14150:0:(super25.c:130:lustre_fill_super()) VFS Op: sb ffff94c83f9d2800 00000020:01000004:1.0:1788869513.726838:0:14150:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-MDT0000, type=osd-zfs, lsifl=200005, mountfl=0 00000020:01000004:1.0:1788869513.726845:0:14150:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-zfs) 00000020:00000080:1.0:1788869513.726859:0:14150:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (ffff94c81f1a99c0) 00000020:00000080:1.0:1788869513.726873:0:14150:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-zfs with refcount 2 00100000:10000000:0.0:1788869513.740659:0:14150:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:0.0:1788869513.742615:0:14150:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000003:0x11:0x0] (8/32) 00100000:10000000:0.0:1788869513.742956:0:14150:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled params under 451: rc = 0 00100000:10000000:0.0:1788869513.743098:0:14150:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-OST0000 under 451: rc = 0 00100000:10000000:0.0:1788869513.743378:0:14150:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:0.0:1788869513.743451:0:14150:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled nodemap under 451: rc = 0 00100000:10000000:0.0:1788869513.743550:0:14150:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-OST0001 under 451: rc = 0 00100000:10000000:0.0:1788869513.743650:0:14150:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-MDT0000 under 451: rc = 0 00100000:10000000:0.0:1788869513.743747:0:14150:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-client under 451: rc = 0 00100000:10000000:0.0:1788869513.743995:0:14150:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre under 453: rc = 0 00100000:10000000:0.0:1788869513.745038:0:14150:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled md-0x0 under 590: rc = 0 00100000:10000000:0.0:1788869513.745137:0:14150:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled dt-0x0 under 590: rc = 0 00100000:10000000:0.0:1788869513.745726:0:14150:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000-MDT0000 under 599: rc = 0 00100000:10000000:0.0:1788869513.745989:0:14150:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000 under 599: rc = 0 00100000:10000000:0.0:1788869513.746229:0:14150:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000-MDT0000 under 599: rc = 0 00100000:10000000:0.0:1788869513.746536:0:14150:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000-MDT0000 under 599: rc = 0 00100000:10000000:0.0:1788869513.746785:0:14150:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000 under 599: rc = 0 00100000:10000000:0.0:1788869513.747033:0:14150:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000 under 599: rc = 0 00100000:10000000:0.0:1788869513.747340:0:14150:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000 under 599: rc = 0 00100000:10000000:0.0:1788869513.747594:0:14150:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000 under 599: rc = 0 00100000:10000000:0.0:1788869513.747864:0:14150:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000-MDT0000 under 599: rc = 0 00100000:10000000:0.0:1788869513.748114:0:14150:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000-MDT0000 under 599: rc = 0 00100000:10000000:0.0:1788869513.748446:0:14150:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000 under 599: rc = 0 00100000:10000000:0.0:1788869513.748688:0:14150:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000-MDT0000 under 599: rc = 0 00100000:10000000:0.0:1788869513.749090:0:14150:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_13 under 282: rc = 0 00100000:10000000:0.0:1788869513.749404:0:14150:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_00 under 282: rc = 0 00100000:10000000:0.0:1788869513.749644:0:14150:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_00 under 282: rc = 0 00100000:10000000:0.0:1788869513.749904:0:14150:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_13 under 282: rc = 0 00100000:10000000:0.0:1788869513.750147:0:14150:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_14 under 282: rc = 0 00100000:10000000:0.0:1788869513.750469:0:14150:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_07 under 282: rc = 0 00100000:10000000:0.0:1788869513.750719:0:14150:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_07 under 282: rc = 0 00100000:10000000:0.0:1788869513.750974:0:14150:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_14 under 282: rc = 0 00100000:10000000:0.0:1788869513.751216:0:14150:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_10 under 282: rc = 0 00100000:10000000:0.0:1788869513.751547:0:14150:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_03 under 282: rc = 0 00100000:10000000:0.0:1788869513.751797:0:14150:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_09 under 282: rc = 0 00100000:10000000:0.0:1788869513.752050:0:14150:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_09 under 282: rc = 0 00100000:10000000:0.0:1788869513.752344:0:14150:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_03 under 282: rc = 0 00100000:10000000:0.0:1788869513.752566:0:14150:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_10 under 282: rc = 0 00100000:10000000:0.0:1788869513.752809:0:14150:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_04 under 282: rc = 0 00100000:10000000:0.0:1788869513.753060:0:14150:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_04 under 282: rc = 0 00100000:10000000:0.0:1788869513.753354:0:14150:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_06 under 282: rc = 0 00100000:10000000:0.0:1788869513.753573:0:14150:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_15 under 282: rc = 0 00100000:10000000:0.0:1788869513.753812:0:14150:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_15 under 282: rc = 0 00100000:10000000:0.0:1788869513.754056:0:14150:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_06 under 282: rc = 0 00100000:10000000:0.0:1788869513.754383:0:14150:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_01 under 282: rc = 0 00100000:10000000:0.0:1788869513.754622:0:14150:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_12 under 282: rc = 0 00100000:10000000:0.0:1788869513.754855:0:14150:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_12 under 282: rc = 0 00100000:10000000:0.0:1788869513.755086:0:14150:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_01 under 282: rc = 0 00100000:10000000:0.0:1788869513.755366:0:14150:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_05 under 282: rc = 0 00100000:10000000:0.0:1788869513.755591:0:14150:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_05 under 282: rc = 0 00100000:10000000:0.0:1788869513.755867:0:14150:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_02 under 282: rc = 0 00100000:10000000:0.0:1788869513.756108:0:14150:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_08 under 282: rc = 0 00100000:10000000:0.0:1788869513.756384:0:14150:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_11 under 282: rc = 0 00100000:10000000:0.0:1788869513.756623:0:14150:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_11 under 282: rc = 0 00100000:10000000:0.0:1788869513.756864:0:14150:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_08 under 282: rc = 0 00100000:10000000:0.0:1788869513.757094:0:14150:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_02 under 282: rc = 0 00100000:10000000:0.0:1788869513.757466:0:14150:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled [0x200000400:0x1:0x0] under 778: rc = 0 00100000:10000000:0.0:1788869513.757938:0:14150:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x2010000:0x0] (8/32) 00100000:10000000:0.0:1788869513.758088:0:14150:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000 under 591: rc = 0 00100000:10000000:0.0:1788869513.758299:0:14150:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x1010000:0x0] (8/32) 00100000:10000000:0.0:1788869513.758363:0:14150:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000 under 591: rc = 0 00100000:10000000:0.0:1788869513.758537:0:14150:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x10000:0x0] (8/32) 00100000:10000000:0.0:1788869513.758595:0:14150:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000 under 591: rc = 0 00100000:10000000:0.0:1788869513.758919:0:14150:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x1020000:0x0] (8/32) 00100000:10000000:0.0:1788869513.758978:0:14150:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000 under 595: rc = 0 00100000:10000000:0.0:1788869513.759152:0:14150:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x2020000:0x0] (8/32) 00100000:10000000:0.0:1788869513.759211:0:14150:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000 under 595: rc = 0 00100000:10000000:0.0:1788869513.759429:0:14150:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x20000:0x0] (8/32) 00100000:10000000:0.0:1788869513.759487:0:14150:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000 under 595: rc = 0 00000020:00000080:0.0:1788869513.759716:0:14150:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:0.0:1788869513.759725:0:14150:0:(osd_handler.c:1569:osd_obd_connect()) connect #0 00000020:00000080:0.0:1788869513.759736:0:14150:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x3d2d1916761d7418 00000020:01000004:0.0:1788869513.759744:0:14150:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-MDT0000 on device lustre-mdt1/mdt1 00000020:01000000:0.0:1788869513.759748:0:14150:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:0.0:1788869513.759753:0:14150:0:(tgt_mount.c:101:server_register_mount()) register mount ffff94c83f9d2800 from MGS 00000020:01000004:0.0:1788869513.759757:0:14150:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:0.0:1788869513.759765:0:14150:0:(genops.c:413:class_newdev()) Allocate new device MGS (ffff94c808e019c0) 00000020:00000080:0.0:1788869513.759783:0:14150:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:0.0:1788869513.759841:0:14150:0:(tgt_mount.c:153:server_get_mount()) get mount ffff94c83f9d2800 from MGS, refs=2 00080000:01000000:0.0:1788869513.759845:0:14150:0:(osd_handler.c:1569:osd_obd_connect()) connect #1 00000020:00000080:0.0:1788869513.759850:0:14150:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x3d2d1916761d7426 00000100:00100000:0.0:1788869513.759962:0:14150:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:0.0:1788869513.760069:0:14150:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:0.0:1788869513.760076:0:14150:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:3.0:1788869513.760413:0:14150:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:3.0:1788869513.760422:0:14150:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:3.0:1788869513.761221:0:14150:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788869513.761525:0:14150:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:3.0:1788869513.761531:0:14150:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:3.0:1788869513.761924:0:14150:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:3.0:1788869513.761931:0:14150:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:3.0:1788869513.762200:0:14150:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:3.0:1788869513.762207:0:14150:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:0.0:1788869513.762969:0:14156:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788869513.762973:0:14156:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788869513.762975:0:14156:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788869513.763220:0:14157:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788869513.763222:0:14157:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788869513.763224:0:14157:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788869513.764012:0:14150:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:0.0:1788869513.765638:0:14156:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:2.0:1788869513.774685:0:14150:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 20000000:01000000:2.0:1788869513.774702:0:14150:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:2.0:1788869513.774706:0:14150:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 10000000:01000000:2.0:1788869513.781631:0:14159:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:0.0:1788869513.781820:0:14150:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:0.0:1788869513.784485:0:14150:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:0.0:1788869513.785924:0:14150:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:0.0:1788869513.787232:0:14150:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788869513.787618:0:14150:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:0.0:1788869513.787626:0:14150:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:0.0:1788869513.788457:0:14150:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:0.0:1788869513.788465:0:14150:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:2.0:1788869513.788805:0:14150:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:2.0:1788869513.788823:0:14150:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:2.0:1788869513.789771:0:14150:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:2.0:1788869513.789791:0:14150:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.201.139@tcp' 00000020:01000004:2.0:1788869513.789793:0:14150:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:2.0:1788869513.789821:0:14150:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.201.139@tcp (typ=mgc) 00000020:00000080:2.0:1788869513.789832:0:14150:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.201.139@tcp (ffff94c8060ab380) 00000020:00000080:2.0:1788869513.789846:0:14150:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:2.0:1788869513.789910:0:14150:0:(ldlm_lib.c:102:import_set_conn()) imp ffff94c805186000@MGC192.168.201.139@tcp: add connection 192.168.201.139@tcp at head 00010000:00010000:2.0:1788869513.790048:0:14150:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.201.139@tcp-0 is initialized 00000040:01000000:2.0:1788869513.790054:0:14150:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.201.139@tcp ctxt 1 is initialized 10000000:01000000:0.0:1788869513.793237:0:14165:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:2.0:1788869513.793374:0:14150:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.201.139@tcp (uuid cd496ea5-7761-4e68-8a6b-58e98659ad4a) 00000020:00000080:2.0:1788869513.793396:0:14150:0:(genops.c:1406:class_connect()) connect: client cd496ea5-7761-4e68-8a6b-58e98659ad4a, cookie 0x3d2d1916761d7434 00000100:00080000:2.0:1788869513.793408:0:14150:0:(import.c:510:import_select_connection()) MGC192.168.201.139@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788869513.793414:0:14150:0:(import.c:624:import_select_connection()) MGC192.168.201.139@tcp: import ffff94c805186000 using connection 192.168.201.139@tcp/0@lo 00000100:00100000:2.0:1788869513.793445:0:14150:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff94c835155c00 x1875765421478656/t0(0) o250->MGC192.168.201.139@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788869513.793474:0:14150:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import cd496ea5-7761-4e68-8a6b-58e98659ad4a->MGS 00000020:01000004:2.0:1788869513.793492:0:14150:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:2.0:1788869513.793497:0:14150:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:2.0:1788869513.793510:0:14150:0:(genops.c:413:class_newdev()) Allocate new device MDS (ffff94c8060a8000) 00000020:00000080:2.0:1788869513.793521:0:14150:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:3.0:1788869513.793650:0:3282:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94c835155c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:cd496ea5-7761-4e68-8a6b-58e98659ad4a:3282:1875765421478656:0@lo:250:mount.lustre.0 00000100:00100000:3.0:1788869513.793717:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869513.793790:0:14161:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765421478656 00000100:00100000:3.0:1788869513.793801:0:14161:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765421478656 00000100:00100000:3.0:1788869513.793831:0:14161:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788869513.793838:0:14161:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c83fddac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3282:x1875765421478656:12345-0@lo:250:mount.lustre.0 00010000:00080000:3.0:1788869513.793859:0:14161:0:(ldlm_lib.c:1445:target_handle_connect()) MGS: connection from cd496ea5-7761-4e68-8a6b-58e98659ad4a@0@lo t0 exp 0000000000000000 cur 262 last 0 00000020:00000080:3.0:1788869513.793878:0:14161:0:(genops.c:1406:class_connect()) connect: client cd496ea5-7761-4e68-8a6b-58e98659ad4a, cookie 0x3d2d1916761d7442 00000100:00080000:3.0:1788869513.793985:0:14161:0:(import.c:65:import_set_state_nolock()) ffff94c806303000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788869513.794032:0:14161:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c83fddac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cd496ea5-7761-4e68-8a6b-58e98659ad4a+5:3282:x1875765421478656:12345-0@lo:250:mount.lustre.0 Request processed in 193us (314us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869513.794039:0:14161:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788869513.794081:0:3282:0:(client.c:3112:ptlrpc_free_committed()) MGC192.168.201.139@tcp: committing for last_committed 0 gen 1 00000100:00080000:3.0:1788869513.794089:0:3282:0:(import.c:1132:ptlrpc_connect_interpret()) MGC192.168.201.139@tcp: connect to target with instance 0 00000100:00080000:3.0:1788869513.794095:0:3282:0:(import.c:956:ptlrpc_connect_set_flags()) MGC192.168.201.139@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:3.0:1788869513.794098:0:3282:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:3.0:1788869513.794102:0:3282:0:(import.c:65:import_set_state_nolock()) ffff94c805186000 MGS: changing import state from CONNECTING to FULL 10000000:01000000:3.0:1788869513.794104:0:3282:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:3.0:1788869513.794123:0:3282:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:3.0:1788869513.794128:0:3282:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94c835155c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:cd496ea5-7761-4e68-8a6b-58e98659ad4a:3282:1875765421478656:0@lo:250:mount.lustre.0 00000100:00080000:1.0:1788869513.797733:0:14164:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 00000100:00100000:2.0:1788869513.810718:0:14150:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788869513.810881:0:14150:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:2.0:1788869513.810887:0:14150:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:2.0:1788869513.820952:0:14150:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:2.0:1788869513.820971:0:14150:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:2.0:1788869513.826574:0:14150:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:2.0:1788869513.826587:0:14150:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:3.0:1788869513.908675:0:14150:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788869513.909399:0:14150:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:3.0:1788869513.909406:0:14150:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:3.0:1788869513.911601:0:14150:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:3.0:1788869513.911611:0:14150:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:1.0:1788869513.984692:0:14150:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788869513.984942:0:14150:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:1.0:1788869513.984948:0:14150:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:1.0:1788869513.986048:0:14150:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:1.0:1788869513.986160:0:14150:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:1.0:1788869513.987030:0:14150:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788869513.987345:0:14150:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:1.0:1788869513.987351:0:14150:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:1.0:1788869513.987806:0:14150:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:1.0:1788869513.987813:0:14150:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:1.0:1788869513.988492:0:14150:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788869513.988608:0:14150:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:1.0:1788869513.988612:0:14150:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:1.0:1788869513.989173:0:14150:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:1.0:1788869513.989180:0:14150:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:1.0:1788869513.989885:0:14150:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788869513.990001:0:14150:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:1.0:1788869513.990006:0:14150:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:1.0:1788869513.990629:0:14150:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:1.0:1788869513.990636:0:14150:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:1.0:1788869514.015718:0:14150:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788869514.015950:0:14150:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:1.0:1788869514.015956:0:14150:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:1.0:1788869514.023413:0:14150:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:1.0:1788869514.023429:0:14150:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:1.0:1788869514.024395:0:14150:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:1.0:1788869514.024402:0:14150:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:1.0:1788869514.026630:0:14150:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:1.0:1788869514.026655:0:14150:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-mdt1/mdt1 10000000:01000000:1.0:1788869514.026661:0:14150:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.201.139@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:1.0:1788869514.026850:0:14150:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.201.139@tcp ctxt 0 is initialized 00000020:01000004:1.0:1788869514.026890:0:14150:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.201.139@tcp, index=0000, flags=0x20005 00000020:01000004:1.0:1788869514.026895:0:14150:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:1.0:1788869514.026897:0:14150:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1788869514.026898:0:14150:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788869514.026899:0:14150:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788869514.026900:0:14150:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788869514.026902:0:14150:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788869514.026903:0:14150:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1788869514.026905:0:14150:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1788869514.026911:0:14150:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788869514.026912:0:14150:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1788869514.026915:0:14150:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020005 00000020:01000004:1.0:1788869514.026917:0:14150:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1788869514.026918:0:14150:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1788869514.026919:0:14150:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788869514.026920:0:14150:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788869514.026920:0:14150:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788869514.026921:0:14150:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788869514.026922:0:14150:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1788869514.026923:0:14150:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1788869514.026924:0:14150:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788869514.026925:0:14150:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1788869514.026950:0:14150:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:1.0:1788869514.026969:0:14150:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94c83c688380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cd496ea5-7761-4e68-8a6b-58e98659ad4a:14150:1875765421478784:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1788869514.027034:0:14150:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869514.027220:0:14150:0:(client.c:2702:ptlrpc_set_wait()) set ffff94c80319b780 going to sleep for 11 seconds 00000100:00100000:0.0:1788869514.027433:0:14163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765421478784 00000100:00100000:0.0:1788869514.027440:0:14163:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765421478784 00000100:00100000:0.0:1788869514.027515:0:14163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788869514.027525:0:14163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c83fdd8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cd496ea5-7761-4e68-8a6b-58e98659ad4a+5:14150:x1875765421478784:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1788869514.027567:0:14163:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:0.0:1788869514.027570:0:14163:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:0.0:1788869514.027574:0:14163:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0000 is running on 0@lo 10000000:01000000:1.0:1788869514.027965:0:14184:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:0.0:1788869514.028481:0:14163:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 5 20000000:01000000:0.0:1788869514.029523:0:14185:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 0 20000000:01000000:0.0:1788869514.029529:0:14185:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0000_UUID is 0 (0) 20000000:01000000:0.0:1788869514.029539:0:14185:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0001_UUID is 1 (1) 00000040:00080000:0.0:1788869514.029574:0:14185:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 20000000:01000000:1.0:1788869514.029871:0:14163:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:1.0:1788869514.029879:0:14163:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:1.0:1788869514.035471:0:14163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c83fdd8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cd496ea5-7761-4e68-8a6b-58e98659ad4a+5:14150:x1875765421478784:12345-0@lo:253:mount.lustre.0 Request processed in 7939us (8428us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869514.035490:0:14163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788869514.035860:0:14150:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94c83c688380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cd496ea5-7761-4e68-8a6b-58e98659ad4a:14150:1875765421478784:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1788869514.035875:0:14150:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:2.0:1788869514.035879:0:14150:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1788869514.035880:0:14150:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1788869514.035882:0:14150:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788869514.035883:0:14150:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788869514.035884:0:14150:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788869514.035885:0:14150:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788869514.035887:0:14150:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788869514.035888:0:14150:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1788869514.035890:0:14150:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788869514.035891:0:14150:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1788869514.035908:0:14150:0:(tgt_mount.c:101:server_register_mount()) register mount ffff94c83f9d2800 from lustre-MDT0000 10000000:01000000:2.0:1788869514.035930:0:14150:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:2.0:1788869514.035933:0:14150:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:2.0:1788869514.035947:0:14150:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff94c8060ab380 10000000:01000000:2.0:1788869514.035951:0:14150:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1788869514.035959:0:14150:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-sptlrpc-ffff94c8060ab380 from 1 10000000:01000000:2.0:1788869514.035962:0:14150:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1788869514.035998:0:14150:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.139@tcp lock: ffff94c805039200/0x3d2d1916761d7449 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869514.036009:0:14150:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.139@tcp lock: ffff94c805039200/0x3d2d1916761d7449 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869514.036019:0:14150:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.139@tcp lock: ffff94c805039200/0x3d2d1916761d7449 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788869514.036038:0:14150:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94c835156d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cd496ea5-7761-4e68-8a6b-58e98659ad4a:14150:1875765421478912:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788869514.036085:0:14150:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869514.036202:0:14150:0:(client.c:2702:ptlrpc_set_wait()) set ffff94c80904f540 going to sleep for 11 seconds 00000100:00100000:3.0:1788869514.036240:0:14162:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765421478912 00000100:00100000:3.0:1788869514.036246:0:14162:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765421478912 00000100:00100000:3.0:1788869514.036325:0:14162:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788869514.036334:0:14162:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c83fdd8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cd496ea5-7761-4e68-8a6b-58e98659ad4a+5:14150:x1875765421478912:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788869514.036347:0:14162:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788869514.036362:0:14162:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff94c83504c200/0x3d2d1916761d7450 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x3d2d1916761d7449 expref: -99 pid: 14162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869514.036388:0:14162:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff94c83504c200/0x3d2d1916761d7450 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3d2d1916761d7449 expref: 6 pid: 14162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869514.036399:0:14162:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff94c83504c200/0x3d2d1916761d7450 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3d2d1916761d7449 expref: 6 pid: 14162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869514.036408:0:14162:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94c83504c200, rc 0) 00000100:00100000:3.0:1788869514.036448:0:14162:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c83fdd8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cd496ea5-7761-4e68-8a6b-58e98659ad4a+6:14150:x1875765421478912:12345-0@lo:101:mount.lustre.0 Request processed in 115us (362us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869514.036454:0:14162:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788869514.036835:0:14150:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94c835156d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cd496ea5-7761-4e68-8a6b-58e98659ad4a:14150:1875765421478912:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788869514.036848:0:14150:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.139@tcp lock: ffff94c805039200/0x3d2d1916761d7449 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3d2d1916761d7450 expref: -99 pid: 14150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869514.036859:0:14150:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.139@tcp lock: ffff94c805039200/0x3d2d1916761d7449 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x3d2d1916761d7450 expref: -99 pid: 14150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788869514.036905:0:14150:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94c83c688000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cd496ea5-7761-4e68-8a6b-58e98659ad4a:14150:1875765421479040:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788869514.036930:0:14150:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869514.036964:0:14150:0:(client.c:2702:ptlrpc_set_wait()) set ffff94c80319b240 going to sleep for 11 seconds 00000100:00100000:2.0:1788869514.037020:0:14163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765421479040 00000100:00100000:2.0:1788869514.037025:0:14163:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765421479040 00000100:00100000:3.0:1788869514.037081:0:14162:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788869514.037089:0:14162:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c833d6f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cd496ea5-7761-4e68-8a6b-58e98659ad4a+6:14150:x1875765421479040:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788869514.037425:0:14162:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c833d6f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cd496ea5-7761-4e68-8a6b-58e98659ad4a+6:14150:x1875765421479040:12345-0@lo:501:mount.lustre.0 Request processed in 337us (493us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788869514.037433:0:14162:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788869514.037461:0:14150:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94c83c688000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cd496ea5-7761-4e68-8a6b-58e98659ad4a:14150:1875765421479040:0@lo:501:mount.lustre.0 10000000:01000000:1.0:1788869514.037492:0:14150:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.139@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:1.0:1788869514.037509:0:14150:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.139@tcp lock: ffff94c805039200/0x3d2d1916761d7449 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3d2d1916761d7450 expref: -99 pid: 14150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869514.037518:0:14150:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.139@tcp lock: ffff94c805039200/0x3d2d1916761d7449 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3d2d1916761d7450 expref: -99 pid: 14150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788869514.037526:0:14150:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff94c83f9d2800 10000000:01000000:1.0:1788869514.037530:0:14150:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1788869514.037534:0:14150:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff94c83f9d2800 10000000:01000000:1.0:1788869514.037537:0:14150:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:1.0:1788869514.037540:0:14150:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-barrier-ffff94c83f9d2800 from 1 10000000:01000000:1.0:1788869514.037542:0:14150:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:1.0:1788869514.037558:0:14150:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.139@tcp lock: ffff94c83fde6400/0x3d2d1916761d7457 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869514.037566:0:14150:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.139@tcp lock: ffff94c83fde6400/0x3d2d1916761d7457 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869514.037574:0:14150:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.139@tcp lock: ffff94c83fde6400/0x3d2d1916761d7457 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788869514.037585:0:14150:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94c83c688000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cd496ea5-7761-4e68-8a6b-58e98659ad4a:14150:1875765421479168:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788869514.037608:0:14150:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869514.037633:0:14150:0:(client.c:2702:ptlrpc_set_wait()) set ffff94c80319b240 going to sleep for 11 seconds 00000100:00100000:2.0:1788869514.037789:0:14161:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765421479168 00000100:00100000:2.0:1788869514.037794:0:14161:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765421479168 00000100:00100000:2.0:1788869514.037824:0:14161:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788869514.037830:0:14161:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c833d6e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cd496ea5-7761-4e68-8a6b-58e98659ad4a+6:14150:x1875765421479168:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788869514.037838:0:14161:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788869514.037849:0:14161:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff94c805039e00/0x3d2d1916761d745e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x3d2d1916761d7457 expref: -99 pid: 14161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869514.037864:0:14161:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff94c805039e00/0x3d2d1916761d745e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3d2d1916761d7457 expref: 7 pid: 14161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869514.037873:0:14161:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff94c805039e00/0x3d2d1916761d745e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3d2d1916761d7457 expref: 7 pid: 14161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869514.037887:0:14161:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94c805039e00, rc 0) 00000100:00100000:2.0:1788869514.037922:0:14161:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c833d6e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cd496ea5-7761-4e68-8a6b-58e98659ad4a+7:14150:x1875765421479168:12345-0@lo:101:mount.lustre.0 Request processed in 92us (313us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869514.037928:0:14161:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788869514.038023:0:14150:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94c83c688000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cd496ea5-7761-4e68-8a6b-58e98659ad4a:14150:1875765421479168:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788869514.038041:0:14150:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.139@tcp lock: ffff94c83fde6400/0x3d2d1916761d7457 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3d2d1916761d745e expref: -99 pid: 14150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869514.038054:0:14150:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.139@tcp lock: ffff94c83fde6400/0x3d2d1916761d7457 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x3d2d1916761d745e expref: -99 pid: 14150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788869514.038065:0:14150:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.139@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:1.0:1788869514.038080:0:14150:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.139@tcp lock: ffff94c83fde6400/0x3d2d1916761d7457 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3d2d1916761d745e expref: -99 pid: 14150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869514.038087:0:14150:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.139@tcp lock: ffff94c83fde6400/0x3d2d1916761d7457 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3d2d1916761d745e expref: -99 pid: 14150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788869514.038094:0:14150:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:1.0:1788869514.038097:0:14150:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1788869514.038441:0:14150:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff94c83f9d2800 10000000:01000000:1.0:1788869514.038445:0:14150:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:1.0:1788869514.038449:0:14150:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:1.0:1788869514.038451:0:14150:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:1.0:1788869514.038465:0:14150:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.139@tcp lock: ffff94c83fde7600/0x3d2d1916761d7465 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869514.038472:0:14150:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.139@tcp lock: ffff94c83fde7600/0x3d2d1916761d7465 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869514.038480:0:14150:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.139@tcp lock: ffff94c83fde7600/0x3d2d1916761d7465 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788869514.038492:0:14150:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94c83c688000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cd496ea5-7761-4e68-8a6b-58e98659ad4a:14150:1875765421479296:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788869514.038516:0:14150:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869514.038541:0:14150:0:(client.c:2702:ptlrpc_set_wait()) set ffff94c80319b240 going to sleep for 11 seconds 00000100:00100000:3.0:1788869514.038834:0:14162:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765421479296 00000100:00100000:3.0:1788869514.038839:0:14162:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765421479296 00000100:00100000:3.0:1788869514.038869:0:14162:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788869514.038876:0:14162:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c833d6fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cd496ea5-7761-4e68-8a6b-58e98659ad4a+7:14150:x1875765421479296:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788869514.038883:0:14162:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788869514.038891:0:14162:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff94c83504d800/0x3d2d1916761d746c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x3d2d1916761d7465 expref: -99 pid: 14162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869514.038904:0:14162:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff94c83504d800/0x3d2d1916761d746c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3d2d1916761d7465 expref: 8 pid: 14162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869514.038913:0:14162:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff94c83504d800/0x3d2d1916761d746c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3d2d1916761d7465 expref: 8 pid: 14162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869514.038927:0:14162:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94c83504d800, rc 0) 00000100:00100000:3.0:1788869514.038972:0:14162:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c833d6fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cd496ea5-7761-4e68-8a6b-58e98659ad4a+8:14150:x1875765421479296:12345-0@lo:101:mount.lustre.0 Request processed in 96us (454us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869514.038979:0:14162:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788869514.039081:0:14150:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94c83c688000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cd496ea5-7761-4e68-8a6b-58e98659ad4a:14150:1875765421479296:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788869514.039091:0:14150:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.139@tcp lock: ffff94c83fde7600/0x3d2d1916761d7465 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x3d2d1916761d746c expref: -99 pid: 14150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869514.039099:0:14150:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.139@tcp lock: ffff94c83fde7600/0x3d2d1916761d7465 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x3d2d1916761d746c expref: -99 pid: 14150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788869514.039193:0:14150:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94c83c688000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cd496ea5-7761-4e68-8a6b-58e98659ad4a:14150:1875765421479424:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788869514.039217:0:14150:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869514.039236:0:14150:0:(client.c:2702:ptlrpc_set_wait()) set ffff94c80319b240 going to sleep for 11 seconds 00000100:00100000:2.0:1788869514.039282:0:14161:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765421479424 00000100:00100000:2.0:1788869514.039287:0:14161:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765421479424 00000100:00100000:2.0:1788869514.039317:0:14161:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788869514.039324:0:14161:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c833d6e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cd496ea5-7761-4e68-8a6b-58e98659ad4a+8:14150:x1875765421479424:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788869514.039629:0:14161:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c833d6e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cd496ea5-7761-4e68-8a6b-58e98659ad4a+9:14150:x1875765421479424:12345-0@lo:501:mount.lustre.0 Request processed in 304us (410us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869514.039636:0:14161:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788869514.040037:0:14150:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94c83c688000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cd496ea5-7761-4e68-8a6b-58e98659ad4a:14150:1875765421479424:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788869514.040062:0:14150:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94c83c688000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cd496ea5-7761-4e68-8a6b-58e98659ad4a:14150:1875765421479552:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788869514.040096:0:14150:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869514.040132:0:14150:0:(client.c:2702:ptlrpc_set_wait()) set ffff94c80319b240 going to sleep for 11 seconds 00000100:00100000:3.0:1788869514.040147:0:14162:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765421479552 00000100:00100000:3.0:1788869514.040153:0:14162:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765421479552 00000100:00100000:3.0:1788869514.040187:0:14162:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788869514.040194:0:14162:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c833d6d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cd496ea5-7761-4e68-8a6b-58e98659ad4a+9:14150:x1875765421479552:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788869514.040512:0:14162:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c833d6d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cd496ea5-7761-4e68-8a6b-58e98659ad4a+9:14150:x1875765421479552:12345-0@lo:503:mount.lustre.0 Request processed in 317us (415us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869514.040519:0:14162:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788869514.041136:0:14150:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94c83c688000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cd496ea5-7761-4e68-8a6b-58e98659ad4a:14150:1875765421479552:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788869514.042231:0:14186:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94c83c688000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cd496ea5-7761-4e68-8a6b-58e98659ad4a:14186:1875765421479680:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788869514.042335:0:14186:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869514.042366:0:14186:0:(client.c:2702:ptlrpc_set_wait()) set ffff94c80319b180 going to sleep for 11 seconds 00000100:00100000:2.0:1788869514.042794:0:14161:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765421479680 00000100:00100000:2.0:1788869514.042800:0:14161:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765421479680 00000100:00100000:2.0:1788869514.042839:0:14161:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788869514.042848:0:14161:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c833d6c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cd496ea5-7761-4e68-8a6b-58e98659ad4a+9:14186:x1875765421479680:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788869514.043223:0:14161:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c833d6c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cd496ea5-7761-4e68-8a6b-58e98659ad4a+9:14186:x1875765421479680:12345-0@lo:502:llog_process_th.0 Request processed in 375us (887us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869514.043232:0:14161:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788869514.043403:0:14186:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94c83c688000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cd496ea5-7761-4e68-8a6b-58e98659ad4a:14186:1875765421479680:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788869514.043512:0:14186:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788869514.043523:0:14186:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788869514.043526:0:14186:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:0.0:1788869514.043531:0:14186:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:0.0:1788869514.043534:0:14186:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1788869514.043547:0:14186:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (ffff94c808e04d40) 00000020:00000080:0.0:1788869514.043564:0:14186:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:0.0:1788869514.043569:0:14186:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00080000:01000000:0.0:1788869514.043638:0:14186:0:(osd_handler.c:1569:osd_obd_connect()) connect #2 00000020:00000080:0.0:1788869514.043645:0:14186:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x3d2d1916761d747a 00000020:00000080:0.0:1788869514.043906:0:14186:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:0.0:1788869514.043911:0:14186:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788869514.043914:0:14186:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788869514.043916:0:14186:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:0.0:1788869514.043919:0:14186:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788869514.043922:0:14186:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788869514.043923:0:14186:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:0.0:1788869514.043927:0:14186:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1788869514.043934:0:14186:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (ffff94c808e03380) 00000020:00000080:0.0:1788869514.043944:0:14186:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:0.0:1788869514.043948:0:14186:0:(obd_config.c:1470:class_process_config()) processing cmd: cf007 00000020:00000080:0.0:1788869514.043950:0:14186:0:(obd_config.c:1514:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:0.0:1788869514.043953:0:14186:0:(obd_config.c:1148:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:0.0:1788869514.043958:0:14186:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:0.0:1788869514.043992:0:14186:0:(tgt_mount.c:153:server_get_mount()) get mount ffff94c83f9d2800 from lustre-MDT0000, refs=3 00000020:00000080:0.0:1788869514.044002:0:14186:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (ffff94c808e00000) 00000020:00000080:0.0:1788869514.044010:0:14186:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:0.0:1788869514.044118:0:14186:0:(lod_dev.c:2292:lod_obd_connect()) connect #0 00000020:00000080:0.0:1788869514.044125:0:14186:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x3d2d1916761d748f 00000020:00000080:0.0:1788869514.044215:0:14186:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:0.0:1788869514.044221:0:14186:0:(mdd_device.c:1596:mdd_obd_connect()) connect #0 00000020:00000080:0.0:1788869514.044230:0:14186:0:(genops.c:1406:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0x3d2d1916761d7496 00080000:01000000:0.0:1788869514.044235:0:14186:0:(osd_handler.c:1569:osd_obd_connect()) connect #3 00000020:00000080:0.0:1788869514.044238:0:14186:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x3d2d1916761d749d 00010000:00010000:3.0:1788869514.247943:0:14186:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:00000004:3.0:1788869514.249123:0:14186:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 4294967526 00000001:00080000:3.0:1788869514.249343:0:14186:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:3.0:1788869514.249905:0:14186:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (ffff94c82c8499c0) 00000020:00000080:3.0:1788869514.249920:0:14186:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:3.0:1788869514.249972:0:14186:0:(osd_handler.c:1569:osd_obd_connect()) connect #4 00000020:00000080:3.0:1788869514.249978:0:14186:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x3d2d1916761d74ab 00000020:00000080:3.0:1788869514.254213:0:14186:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:3.0:1788869514.269772:0:14186:0:(genops.c:1406:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0x3d2d1916761d74b2 00000020:00000080:0.0:1788869514.270626:0:14186:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:0.0:1788869514.270637:0:14186:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788869514.270643:0:14186:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788869514.270645:0:14186:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:0.0:1788869514.270648:0:14186:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:0.0:1788869514.270650:0:14186:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #9 00000020:01000000:0.0:1788869514.270652:0:14186:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1788869514.270654:0:14186:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1788869514.270655:0:14186:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:0.0:1788869514.270657:0:14186:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788869514.270658:0:14186:0:(obd_config.c:1561:class_process_config()) marker 9 (0x6) lustre sys.timeout 00000020:01000000:0.0:1788869514.270660:0:14186:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788869514.270665:0:14186:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788869514.270666:0:14186:0:(obd_config.c:1561:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:0.0:1788869514.270670:0:14186:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000004:01000000:0.0:1788869514.270712:0:14186:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:0.0:1788869514.270726:0:14186:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788869514.270728:0:14186:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788869514.270730:0:14186:0:(obd_config.c:1561:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:0.0:1788869514.270732:0:14186:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1788869514.270736:0:14186:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-mdt1/mdt1 00000020:00000080:0.0:1788869514.270739:0:14186:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788869514.270740:0:14186:0:(obd_config.c:1561:class_process_config()) marker 12 (0x1) lustre-OST0000 add osc 00000020:00000080:0.0:1788869514.270743:0:14186:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1788869514.270748:0:14186:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.201.139@tcp to nid 0x20000c0a8c98b (192.168.201.139@tcp) 00000020:01000000:0.0:1788869514.270771:0:14186:0:(obd_config.c:1975:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:0.0:1788869514.270773:0:14186:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1788869514.270796:0:14186:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff94c82dedb380) 00000020:00000080:0.0:1788869514.270810:0:14186:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type osp with refcount 2 00000020:00000080:0.0:1788869514.270814:0:14186:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1788869514.270864:0:14186:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:0.0:1788869514.270869:0:14186:0:(osd_handler.c:1569:osd_obd_connect()) connect #5 00000020:00000080:0.0:1788869514.270873:0:14186:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x3d2d1916761d74c0 00010000:00080000:0.0:1788869514.270909:0:14186:0:(ldlm_lib.c:102:import_set_conn()) imp ffff94c839dd5000@lustre-OST0000-osc-MDT0000: add connection 192.168.201.139@tcp at head 00010000:00010000:0.0:1788869514.271234:0:14186:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-1 is initialized 00000040:01000000:0.0:1788869514.273805:0:14186:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:0.0:1788869514.273849:0:14186:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:0.0:1788869514.275208:0:14186:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788869514.275325:0:14186:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].2, 64 off8320 00000040:00080000:0.0:1788869514.275455:0:14186:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1, 64 off8256 00000040:00080000:3.0:1788869514.334525:0:14190:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:3.0:1788869514.334533:0:14190:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xa:0x0] at index 2 of catalog [0x1:0x2:0x0] 00000020:00000080:2.0:1788869514.339400:0:14186:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1788869514.339415:0:14186:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1788869514.339449:0:14186:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:2.0:1788869514.339466:0:14186:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x3d2d1916761d74c7 00000100:00080000:2.0:1788869514.339476:0:14186:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788869514.339495:0:14186:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff94c839dd5000 using connection 192.168.201.139@tcp/0@lo 00000100:00100000:2.0:1788869514.339527:0:14186:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff94c835157100 x1875765421479808/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788869514.339556:0:14186:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:2.0:1788869514.339610:0:14186:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788869514.339613:0:14186:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788869514.339616:0:14186:0:(obd_config.c:1561:class_process_config()) marker 12 (0x2) lustre-OST0000 add osc 00000020:01000000:2.0:1788869514.339619:0:14186:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1788869514.339622:0:14186:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #15 00000020:01000000:2.0:1788869514.339623:0:14186:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1788869514.339624:0:14186:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1788869514.339626:0:14186:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1788869514.339627:0:14186:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788869514.339629:0:14186:0:(obd_config.c:1561:class_process_config()) marker 15 (0x6) lustre sys.timeout 00000020:01000000:2.0:1788869514.339631:0:14186:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1788869514.339634:0:14186:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-mdt1/mdt1 00000020:00000080:2.0:1788869514.339638:0:14186:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788869514.339639:0:14186:0:(obd_config.c:1561:class_process_config()) marker 18 (0x1) lustre-OST0001 add osc 00000020:00000080:2.0:1788869514.339642:0:14186:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1788869514.339645:0:14186:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.201.139@tcp to nid 0x20000c0a8c98b (192.168.201.139@tcp) 00000020:01000000:2.0:1788869514.339666:0:14186:0:(obd_config.c:1975:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:2.0:1788869514.339669:0:14186:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1788869514.339679:0:14186:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff94c8060a99c0) 00000020:00000080:2.0:1788869514.339688:0:14186:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osp with refcount 2 00000020:00000080:2.0:1788869514.339692:0:14186:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1788869514.339740:0:14186:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:2.0:1788869514.339745:0:14186:0:(osd_handler.c:1569:osd_obd_connect()) connect #6 00000020:00000080:2.0:1788869514.339749:0:14186:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x3d2d1916761d74d5 00010000:00080000:2.0:1788869514.339775:0:14186:0:(ldlm_lib.c:102:import_set_conn()) imp ffff94c80f9b5000@lustre-OST0001-osc-MDT0000: add connection 192.168.201.139@tcp at head 00010000:00010000:2.0:1788869514.339952:0:14186:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-2 is initialized 00000040:01000000:2.0:1788869514.340118:0:14186:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:2.0:1788869514.340138:0:14186:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000100:00100000:3.0:1788869514.340582:0:3282:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94c835157100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3282:1875765421479808:0@lo:8:llog_process_th.0 00000400:00000100:3.0:1788869514.340636:0:3282:0:(lib-move.c:4322:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875765421479808 offset 0 length 520: 4 00000040:00080000:3.0:1788869514.342125:0:14186:0:(llog_cat.c:403:llog_cat_set_first_idx()) catlog [0x1:0x5:0x0] first idx 0, last_idx 1 00000040:00080000:3.0:1788869514.342522:0:14186:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788869514.342580:0:14186:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].2, 64 off8320 00000040:00080000:3.0:1788869514.342658:0:14186:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xc:0x0].1, 64 off8256 00000040:00080000:3.0:1788869514.344887:0:14192:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 2 synced_idx: 0 lgh_last_idx: 2 00000040:00080000:3.0:1788869514.344893:0:14192:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x6:0x0] at index 1 of catalog [0x1:0x5:0x0] 00000020:00000080:0.0:1788869514.345881:0:14186:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1788869514.345890:0:14186:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00d 00000004:01000000:0.0:1788869514.345916:0:14186:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:0.0:1788869514.345937:0:14186:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x3d2d1916761d74dc 00000100:00080000:0.0:1788869514.346035:0:14186:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1788869514.346043:0:14186:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff94c80f9b5000 using connection 192.168.201.139@tcp/0@lo 00000100:00100000:0.0:1788869514.346075:0:14186:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff94c83661d180 x1875765421479936/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788869514.346103:0:14186:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:0.0:1788869514.346161:0:14186:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788869514.346165:0:14186:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788869514.346167:0:14186:0:(obd_config.c:1561:class_process_config()) marker 18 (0x2) lustre-OST0001 add osc 00000020:01000000:0.0:1788869514.346169:0:14186:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788869514.346173:0:14186:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788869514.346174:0:14186:0:(obd_config.c:1561:class_process_config()) marker 21 (0x1) lustre sys.timeout 00000020:00000080:0.0:1788869514.346177:0:14186:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1788869514.346179:0:14186:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1788869514.346181:0:14186:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788869514.346183:0:14186:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788869514.346185:0:14186:0:(obd_config.c:1561:class_process_config()) marker 21 (0x2) lustre sys.timeout 00000020:01000000:0.0:1788869514.346187:0:14186:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788869514.346194:0:14186:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788869514.346195:0:14186:0:(obd_config.c:1561:class_process_config()) marker 25 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1788869514.346199:0:14186:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000100:00100000:0.0:1788869514.346231:0:14186:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94c83661ce00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cd496ea5-7761-4e68-8a6b-58e98659ad4a:14186:1875765421480064:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788869514.346879:0:14186:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869514.346911:0:14186:0:(client.c:2702:ptlrpc_set_wait()) set ffff94c802c3f6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788869514.347359:0:3282:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94c83661d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3282:1875765421479936:0@lo:8:llog_process_th.0 00000400:00000100:3.0:1788869514.347574:0:3282:0:(lib-move.c:4322:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875765421479936 offset 0 length 520: 4 00000100:00100000:3.0:1788869514.347613:0:14162:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765421480064 00000100:00100000:3.0:1788869514.347619:0:14162:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765421480064 00000100:00100000:3.0:1788869514.347654:0:14162:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788869514.347663:0:14162:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c833d6d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cd496ea5-7761-4e68-8a6b-58e98659ad4a+9:14186:x1875765421480064:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788869514.347873:0:14162:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c833d6d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cd496ea5-7761-4e68-8a6b-58e98659ad4a+9:14186:x1875765421480064:12345-0@lo:502:llog_process_th.0 Request processed in 211us (995us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869514.347882:0:14162:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788869514.348555:0:14186:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94c83661ce00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cd496ea5-7761-4e68-8a6b-58e98659ad4a:14186:1875765421480064:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788869514.348581:0:14186:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788869514.348587:0:14186:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788869514.348588:0:14186:0:(obd_config.c:1561:class_process_config()) marker 25 (0x2) lustre sys.jobid_var 00000040:00080000:0.0:1788869514.348592:0:14186:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 37 count 37 00000020:01000000:2.0:1788869514.356877:0:14150:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-36 (rc=0) 10000000:01000000:2.0:1788869514.356916:0:14150:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.139@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:2.0:1788869514.357048:0:14150:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.139@tcp lock: ffff94c83fde7600/0x3d2d1916761d7465 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x3d2d1916761d746c expref: -99 pid: 14150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869514.357061:0:14150:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.139@tcp lock: ffff94c83fde7600/0x3d2d1916761d7465 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x3d2d1916761d746c expref: -99 pid: 14150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788869514.357599:0:14150:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff94c83f9d2800 from 1 10000000:01000000:2.0:1788869514.357603:0:14150:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1788869514.357641:0:14150:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.139@tcp lock: ffff94c805038c00/0x3d2d1916761d74e3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869514.357651:0:14150:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.139@tcp lock: ffff94c805038c00/0x3d2d1916761d74e3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869514.357661:0:14150:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.139@tcp lock: ffff94c805038c00/0x3d2d1916761d74e3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788869514.357697:0:14150:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94c835154700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cd496ea5-7761-4e68-8a6b-58e98659ad4a:14150:1875765421480192:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788869514.357774:0:14150:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869514.357812:0:14150:0:(client.c:2702:ptlrpc_set_wait()) set ffff94c80904f3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788869514.357874:0:14161:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765421480192 00000100:00100000:0.0:1788869514.357881:0:14161:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765421480192 00000100:00100000:0.0:1788869514.357927:0:14161:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788869514.357935:0:14161:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c833d6c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cd496ea5-7761-4e68-8a6b-58e98659ad4a+9:14150:x1875765421480192:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788869514.357959:0:14161:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788869514.357974:0:14161:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff94c818d1fa00/0x3d2d1916761d74ea lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x3d2d1916761d74e3 expref: -99 pid: 14161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869514.357995:0:14161:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff94c818d1fa00/0x3d2d1916761d74ea lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3d2d1916761d74e3 expref: 10 pid: 14161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869514.358005:0:14161:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff94c818d1fa00/0x3d2d1916761d74ea lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3d2d1916761d74e3 expref: 10 pid: 14161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869514.358012:0:14161:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94c818d1fa00, rc 0) 00000100:00100000:0.0:1788869514.358046:0:14161:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c833d6c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cd496ea5-7761-4e68-8a6b-58e98659ad4a+10:14150:x1875765421480192:12345-0@lo:101:mount.lustre.0 Request processed in 112us (272us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869514.358053:0:14161:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788869514.358236:0:14150:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94c835154700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cd496ea5-7761-4e68-8a6b-58e98659ad4a:14150:1875765421480192:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788869514.358276:0:14150:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.139@tcp lock: ffff94c805038c00/0x3d2d1916761d74e3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3d2d1916761d74ea expref: -99 pid: 14150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869514.358286:0:14150:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.139@tcp lock: ffff94c805038c00/0x3d2d1916761d74e3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x3d2d1916761d74ea expref: -99 pid: 14150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788869514.359118:0:14150:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94c835154700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cd496ea5-7761-4e68-8a6b-58e98659ad4a:14150:1875765421480320:0@lo:256:mount.lustre.0 00000100:00100000:2.0:1788869514.359155:0:14150:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869514.359202:0:14150:0:(client.c:2702:ptlrpc_set_wait()) set ffff94c80904f3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788869514.359220:0:14162:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765421480320 00000100:00100000:2.0:1788869514.359224:0:14162:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765421480320 00000100:00100000:2.0:1788869514.359247:0:14162:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788869514.359281:0:14162:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c833d6d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cd496ea5-7761-4e68-8a6b-58e98659ad4a+10:14150:x1875765421480320:12345-0@lo:256:mount.lustre.0 20000000:01000000:2.0:1788869514.359298:0:14162:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:2.0:1788869514.359303:0:14162:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:2.0:1788869514.359477:0:14162:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c833d6d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cd496ea5-7761-4e68-8a6b-58e98659ad4a+10:14150:x1875765421480320:12345-0@lo:256:mount.lustre.0 Request processed in 197us (321us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869514.359484:0:14162:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788869514.359512:0:14150:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94c835154700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cd496ea5-7761-4e68-8a6b-58e98659ad4a:14150:1875765421480320:0@lo:256:mount.lustre.0 10000000:01000000:2.0:1788869514.361224:0:14150:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.139@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1788869514.366582:0:14150:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.139@tcp lock: ffff94c805038c00/0x3d2d1916761d74e3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3d2d1916761d74ea expref: -99 pid: 14150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869514.366602:0:14150:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.139@tcp lock: ffff94c805038c00/0x3d2d1916761d74e3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3d2d1916761d74ea expref: -99 pid: 14150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788869514.366661:0:14150:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff94c83f9d2800 from 1 10000000:01000000:3.0:1788869514.366666:0:14150:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788869514.366720:0:14150:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.139@tcp lock: ffff94c83504c000/0x3d2d1916761d74f1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869514.366729:0:14150:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.139@tcp lock: ffff94c83504c000/0x3d2d1916761d74f1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869514.366739:0:14150:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.139@tcp lock: ffff94c83504c000/0x3d2d1916761d74f1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788869514.366763:0:14150:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94c835a14700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cd496ea5-7761-4e68-8a6b-58e98659ad4a:14150:1875765421480448:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788869514.366826:0:14150:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869514.366883:0:14150:0:(client.c:2702:ptlrpc_set_wait()) set ffff94c8104503c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788869514.366972:0:14162:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765421480448 00000100:00100000:2.0:1788869514.366979:0:14162:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765421480448 00000100:00100000:2.0:1788869514.367102:0:14162:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788869514.367113:0:14162:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c833d6c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cd496ea5-7761-4e68-8a6b-58e98659ad4a+10:14150:x1875765421480448:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788869514.367129:0:14162:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788869514.367142:0:14162:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff94c805038400/0x3d2d1916761d74f8 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x3d2d1916761d74f1 expref: -99 pid: 14162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869514.367164:0:14162:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff94c805038400/0x3d2d1916761d74f8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3d2d1916761d74f1 expref: 11 pid: 14162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869514.367184:0:14162:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff94c805038400/0x3d2d1916761d74f8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3d2d1916761d74f1 expref: 11 pid: 14162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869514.367193:0:14162:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94c805038400, rc 0) 00000100:00100000:2.0:1788869514.367238:0:14162:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c833d6c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cd496ea5-7761-4e68-8a6b-58e98659ad4a+11:14150:x1875765421480448:12345-0@lo:101:mount.lustre.0 Request processed in 127us (410us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869514.367245:0:14162:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788869514.369359:0:14150:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94c835a14700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cd496ea5-7761-4e68-8a6b-58e98659ad4a:14150:1875765421480448:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788869514.369382:0:14150:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.139@tcp lock: ffff94c83504c000/0x3d2d1916761d74f1 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3d2d1916761d74f8 expref: -99 pid: 14150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869514.369394:0:14150:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.139@tcp lock: ffff94c83504c000/0x3d2d1916761d74f1 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x3d2d1916761d74f8 expref: -99 pid: 14150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788869514.369460:0:14150:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94c835a14700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cd496ea5-7761-4e68-8a6b-58e98659ad4a:14150:1875765421480576:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788869514.369498:0:14150:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869514.371154:0:14150:0:(client.c:2702:ptlrpc_set_wait()) set ffff94c8104503c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788869514.371209:0:14163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765421480576 00000100:00100000:0.0:1788869514.371216:0:14163:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765421480576 00000100:00100000:0.0:1788869514.371283:0:14163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788869514.371292:0:14163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c833d6f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cd496ea5-7761-4e68-8a6b-58e98659ad4a+11:14150:x1875765421480576:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788869514.371650:0:14163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c833d6f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cd496ea5-7761-4e68-8a6b-58e98659ad4a+11:14150:x1875765421480576:12345-0@lo:501:mount.lustre.0 Request processed in 360us (2151us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869514.371659:0:14163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1788869514.371743:0:14150:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94c835a14700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cd496ea5-7761-4e68-8a6b-58e98659ad4a:14150:1875765421480576:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788869514.371787:0:14150:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94c835a14700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cd496ea5-7761-4e68-8a6b-58e98659ad4a:14150:1875765421480704:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788869514.371826:0:14150:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869514.371907:0:14162:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765421480704 00000100:00100000:2.0:1788869514.371911:0:14162:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765421480704 00000100:00100000:3.0:1788869514.372084:0:14150:0:(client.c:2702:ptlrpc_set_wait()) set ffff94c8104503c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788869514.372112:0:14162:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788869514.372119:0:14162:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c833d6cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cd496ea5-7761-4e68-8a6b-58e98659ad4a+11:14150:x1875765421480704:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788869514.372280:0:14162:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c833d6cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cd496ea5-7761-4e68-8a6b-58e98659ad4a+11:14150:x1875765421480704:12345-0@lo:503:mount.lustre.0 Request processed in 160us (452us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869514.372287:0:14162:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788869514.372364:0:14150:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94c835a14700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cd496ea5-7761-4e68-8a6b-58e98659ad4a:14150:1875765421480704:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788869514.372635:0:14194:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94c835154700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cd496ea5-7761-4e68-8a6b-58e98659ad4a:14194:1875765421480832:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788869514.372669:0:14194:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869514.372701:0:14194:0:(client.c:2702:ptlrpc_set_wait()) set ffff94c80904f540 going to sleep for 11 seconds 00000100:00100000:3.0:1788869514.372765:0:14162:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765421480832 00000100:00100000:3.0:1788869514.372769:0:14162:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765421480832 00000100:00100000:3.0:1788869514.372785:0:14162:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788869514.372791:0:14162:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c833d6e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cd496ea5-7761-4e68-8a6b-58e98659ad4a+11:14194:x1875765421480832:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788869514.372938:0:14162:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c833d6e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cd496ea5-7761-4e68-8a6b-58e98659ad4a+11:14194:x1875765421480832:12345-0@lo:502:llog_process_th.0 Request processed in 145us (268us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869514.372962:0:14162:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788869514.373063:0:14194:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94c835154700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cd496ea5-7761-4e68-8a6b-58e98659ad4a:14194:1875765421480832:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788869514.373083:0:14194:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788869514.373092:0:14194:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788869514.373094:0:14194:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:2.0:1788869514.373100:0:14194:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff94c83f9d2800 00000020:00000080:2.0:1788869514.373103:0:14194:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1788869514.373110:0:14194:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788869514.373112:0:14194:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788869514.373113:0:14194:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:2.0:1788869514.373116:0:14194:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788869514.373118:0:14194:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788869514.373119:0:14194:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1788869514.373123:0:14194:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff94c83f9d2800 00000020:00000080:2.0:1788869514.373125:0:14194:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1788869514.373184:0:14194:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788869514.373187:0:14194:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788869514.373189:0:14194:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:2.0:1788869514.373191:0:14194:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788869514.373193:0:14194:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788869514.373195:0:14194:0:(obd_config.c:1561:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1788869514.373198:0:14194:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff94c83f9d2800 00000020:00000080:2.0:1788869514.373200:0:14194:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1788869514.373230:0:14194:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94c835154700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cd496ea5-7761-4e68-8a6b-58e98659ad4a:14194:1875765421480960:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788869514.373289:0:14194:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869514.373299:0:14194:0:(client.c:2702:ptlrpc_set_wait()) set ffff94c818d26840 going to sleep for 11 seconds 00000100:00100000:0.0:1788869514.373342:0:14163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765421480960 00000100:00100000:0.0:1788869514.373346:0:14163:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765421480960 00000100:00100000:0.0:1788869514.373362:0:14163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1788869514.373367:0:14163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c83553f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cd496ea5-7761-4e68-8a6b-58e98659ad4a+11:14194:x1875765421480960:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788869514.373479:0:14163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c83553f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cd496ea5-7761-4e68-8a6b-58e98659ad4a+11:14194:x1875765421480960:12345-0@lo:502:llog_process_th.0 Request processed in 111us (190us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869514.373486:0:14163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1788869514.374302:0:14194:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94c835154700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cd496ea5-7761-4e68-8a6b-58e98659ad4a:14194:1875765421480960:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788869514.374321:0:14194:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788869514.374325:0:14194:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788869514.374327:0:14194:0:(obd_config.c:1561:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:2.0:1788869514.374330:0:14194:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:0.0:1788869514.374751:0:14150:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:0.0:1788869514.374769:0:14150:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.139@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788869514.374791:0:14150:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.139@tcp lock: ffff94c83504c000/0x3d2d1916761d74f1 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3d2d1916761d74f8 expref: -99 pid: 14150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869514.374802:0:14150:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.139@tcp lock: ffff94c83504c000/0x3d2d1916761d74f1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3d2d1916761d74f8 expref: -99 pid: 14150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788869514.374839:0:14150:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1788869514.374842:0:14150:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff94c83f9d2800 10000000:01000000:0.0:1788869514.374845:0:14150:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff94c83f9d2800 10000000:01000000:0.0:1788869514.374848:0:14150:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1788869514.374853:0:14150:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff94c83f9d2800 from 1 10000000:01000000:0.0:1788869514.374856:0:14150:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1788869514.374879:0:14150:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.139@tcp lock: ffff94c818d1ec00/0x3d2d1916761d74ff lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869514.374894:0:14150:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.139@tcp lock: ffff94c818d1ec00/0x3d2d1916761d74ff lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869514.374903:0:14150:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.139@tcp lock: ffff94c818d1ec00/0x3d2d1916761d74ff lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788869514.374917:0:14150:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94c83661ce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cd496ea5-7761-4e68-8a6b-58e98659ad4a:14150:1875765421481088:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788869514.375006:0:14150:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869514.375031:0:14150:0:(client.c:2702:ptlrpc_set_wait()) set ffff94c820d000c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788869514.375046:0:14163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765421481088 00000100:00100000:0.0:1788869514.375050:0:14163:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765421481088 00000100:00100000:0.0:1788869514.375071:0:14163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1788869514.375077:0:14163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c83553f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cd496ea5-7761-4e68-8a6b-58e98659ad4a+11:14150:x1875765421481088:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788869514.375085:0:14163:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788869514.375096:0:14163:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff94c818d1f400/0x3d2d1916761d7506 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x3d2d1916761d74ff expref: -99 pid: 14163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869514.375115:0:14163:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff94c818d1f400/0x3d2d1916761d7506 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3d2d1916761d74ff expref: 12 pid: 14163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869514.375125:0:14163:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff94c818d1f400/0x3d2d1916761d7506 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3d2d1916761d74ff expref: 12 pid: 14163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869514.375133:0:14163:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94c818d1f400, rc 0) 00000100:00100000:0.0:1788869514.375158:0:14163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c83553f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cd496ea5-7761-4e68-8a6b-58e98659ad4a+12:14150:x1875765421481088:12345-0@lo:101:mount.lustre.0 Request processed in 81us (211us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869514.375164:0:14163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1788869514.375200:0:14150:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94c83661ce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cd496ea5-7761-4e68-8a6b-58e98659ad4a:14150:1875765421481088:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788869514.375212:0:14150:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.139@tcp lock: ffff94c818d1ec00/0x3d2d1916761d74ff lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x3d2d1916761d7506 expref: -99 pid: 14150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869514.375220:0:14150:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.139@tcp lock: ffff94c818d1ec00/0x3d2d1916761d74ff lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x3d2d1916761d7506 expref: -99 pid: 14150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788869514.375755:0:14150:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94c83661ce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cd496ea5-7761-4e68-8a6b-58e98659ad4a:14150:1875765421481216:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788869514.375779:0:14150:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869514.375807:0:14150:0:(client.c:2702:ptlrpc_set_wait()) set ffff94c820d000c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788869514.375844:0:14163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765421481216 00000100:00100000:2.0:1788869514.375847:0:14163:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765421481216 00000100:00100000:2.0:1788869514.375876:0:14163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1788869514.375882:0:14163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c83553dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cd496ea5-7761-4e68-8a6b-58e98659ad4a+12:14150:x1875765421481216:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788869514.376128:0:14163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c83553dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cd496ea5-7761-4e68-8a6b-58e98659ad4a+12:14150:x1875765421481216:12345-0@lo:501:mount.lustre.0 Request processed in 245us (347us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869514.376135:0:14163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1788869514.376193:0:14150:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94c83661ce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cd496ea5-7761-4e68-8a6b-58e98659ad4a:14150:1875765421481216:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788869514.376216:0:14150:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94c83661ce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cd496ea5-7761-4e68-8a6b-58e98659ad4a:14150:1875765421481344:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788869514.376328:0:14150:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869514.377313:0:14150:0:(client.c:2702:ptlrpc_set_wait()) set ffff94c820d000c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788869514.381041:0:14163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765421481344 00000100:00100000:2.0:1788869514.381052:0:14163:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765421481344 00000100:00100000:2.0:1788869514.381099:0:14163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1788869514.381108:0:14163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c83553f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cd496ea5-7761-4e68-8a6b-58e98659ad4a+12:14150:x1875765421481344:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788869514.383401:0:14163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c83553f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cd496ea5-7761-4e68-8a6b-58e98659ad4a+12:14150:x1875765421481344:12345-0@lo:503:mount.lustre.0 Request processed in 2290us (7147us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869514.383413:0:14163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1788869514.383479:0:14150:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94c83661ce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cd496ea5-7761-4e68-8a6b-58e98659ad4a:14150:1875765421481344:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788869514.391119:0:14199:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94c83661ea00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cd496ea5-7761-4e68-8a6b-58e98659ad4a:14199:1875765421481472:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788869514.391194:0:14199:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869514.391232:0:14162:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765421481472 00000100:00100000:0.0:1788869514.391238:0:14162:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765421481472 00000100:00100000:0.0:1788869514.391304:0:14162:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1788869514.391312:0:14162:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c83553ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cd496ea5-7761-4e68-8a6b-58e98659ad4a+12:14199:x1875765421481472:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788869514.391533:0:14162:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c83553ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cd496ea5-7761-4e68-8a6b-58e98659ad4a+12:14199:x1875765421481472:12345-0@lo:502:llog_process_th.0 Request processed in 220us (337us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869514.391541:0:14162:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1788869514.391591:0:14199:0:(client.c:2702:ptlrpc_set_wait()) set ffff94c8351783c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788869514.391609:0:14199:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94c83661ea00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cd496ea5-7761-4e68-8a6b-58e98659ad4a:14199:1875765421481472:0@lo:502:llog_process_th.0 00000020:01000004:0.0:1788869514.391670:0:14199:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:0.0:1788869514.392756:0:14199:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (ffff94c82dedcd40) 00000020:00000080:0.0:1788869514.392789:0:14199:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type lwp with refcount 2 00000020:01000004:0.0:1788869514.392929:0:14199:0:(tgt_mount.c:153:server_get_mount()) get mount ffff94c83f9d2800 from lustre-MDT0000, refs=4 00000020:01000004:0.0:1788869514.392933:0:14199:0:(tgt_mount.c:187:server_put_mount()) put mount ffff94c83f9d2800 from lustre-MDT0000, refs=4 00000020:01000004:0.0:1788869514.392936:0:14199:0:(obd_mount.c:710:lustre_put_lsi()) put ffff94c83f9d2800 4 00010000:00080000:0.0:1788869514.393128:0:14199:0:(ldlm_lib.c:102:import_set_conn()) imp ffff94c810d5e000@lustre-MDT0000-lwp-MDT0000: add connection 192.168.201.139@tcp at head 00010000:00010000:0.0:1788869514.397492:0:14199:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-3 is initialized 00000020:00000080:0.0:1788869514.397599:0:14199:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:0.0:1788869514.397631:0:14199:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1788869514.397642:0:14199:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0x3d2d1916761d7514 00000100:00080000:0.0:1788869514.397651:0:14199:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1788869514.397657:0:14199:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff94c810d5e000 using connection 192.168.201.139@tcp/0@lo 00000100:00100000:0.0:1788869514.399907:0:14199:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff94c83661ea00 x1875765421481600/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788869514.399933:0:14199:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:3.0:1788869514.400909:0:3282:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94c83661ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3282:1875765421481600:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1788869514.400990:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869514.401207:0:14199:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94c835a16300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cd496ea5-7761-4e68-8a6b-58e98659ad4a:14199:1875765421481728:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788869514.401243:0:14199:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869514.401296:0:14163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765421481728 00000100:00100000:3.0:1788869514.401302:0:14163:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765421481728 00000100:00100000:3.0:1788869514.401341:0:14163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1788869514.401348:0:14163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c83553e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cd496ea5-7761-4e68-8a6b-58e98659ad4a+12:14199:x1875765421481728:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788869514.401557:0:14163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c83553e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cd496ea5-7761-4e68-8a6b-58e98659ad4a+12:14199:x1875765421481728:12345-0@lo:502:llog_process_th.0 Request processed in 208us (312us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869514.401565:0:14163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1788869514.401633:0:14199:0:(client.c:2702:ptlrpc_set_wait()) set ffff94c808773cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788869514.401650:0:14199:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94c835a16300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cd496ea5-7761-4e68-8a6b-58e98659ad4a:14199:1875765421481728:0@lo:502:llog_process_th.0 00000040:00080000:3.0:1788869514.401673:0:14199:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:3.0:1788869514.401824:0:14150:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:3.0:1788869514.401846:0:14150:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.139@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1788869514.401860:0:14150:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.139@tcp lock: ffff94c818d1ec00/0x3d2d1916761d74ff lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x3d2d1916761d7506 expref: -99 pid: 14150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869514.401871:0:14150:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.139@tcp lock: ffff94c818d1ec00/0x3d2d1916761d74ff lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x3d2d1916761d7506 expref: -99 pid: 14150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1788869514.401912:0:14150:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:3.0:1788869514.401914:0:14150:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1788869514.401915:0:14150:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788869514.401917:0:14150:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788869514.401918:0:14150:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788869514.401919:0:14150:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788869514.401920:0:14150:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788869514.401922:0:14150:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1788869514.401923:0:14150:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788869514.401925:0:14150:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1788869514.401928:0:14150:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020005 00000020:01000004:3.0:1788869514.401931:0:14150:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1788869514.401932:0:14150:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1788869514.401933:0:14150:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788869514.401934:0:14150:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788869514.401936:0:14150:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788869514.401936:0:14150:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788869514.401937:0:14150:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788869514.401938:0:14150:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1788869514.401939:0:14150:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788869514.401940:0:14150:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1788869514.402003:0:14150:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:3.0:1788869514.402012:0:14150:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94c835a16300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cd496ea5-7761-4e68-8a6b-58e98659ad4a:14150:1875765421481856:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1788869514.402039:0:14150:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869514.402050:0:14150:0:(client.c:2702:ptlrpc_set_wait()) set ffff94c808773cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788869514.402433:0:14168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765421481600 00000100:00100000:0.0:1788869514.402438:0:14168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765421481600 00000100:00100000:0.0:1788869514.402460:0:14168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788869514.402465:0:14168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c835a14e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3282:x1875765421481600:12345-0@lo:38:llog_process_th.0 00000100:00100000:0.0:1788869514.402513:0:14168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c835a14e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3282:x1875765421481600:12345-0@lo:38:llog_process_th.0 Request processed in 46us (1523us total) trans 0 rc -11/-11 00000100:00100000:0.0:1788869514.402520:0:14168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788869514.402536:0:14161:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765421481856 00000100:00100000:0.0:1788869514.402539:0:14161:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765421481856 00000100:00100000:0.0:1788869514.402555:0:14161:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1788869514.402561:0:14161:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c83553e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cd496ea5-7761-4e68-8a6b-58e98659ad4a+12:14150:x1875765421481856:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1788869514.402588:0:14161:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:0.0:1788869514.402600:0:14161:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:3.0:1788869514.404800:0:3282:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1788869514.404811:0:3282:0:(import.c:65:import_set_state_nolock()) ffff94c810d5e000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788869514.404816:0:3282:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:3.0:1788869514.404820:0:3282:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94c83661ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3282:1875765421481600:0@lo:38:llog_process_th.0 20000000:01000000:2.0:1788869514.460653:0:14161:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1788869514.460674:0:14161:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:1.0:1788869514.461283:0:14184:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1788869514.461289:0:14184:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1788869514.461311:0:14184:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff94c83fde7e00/0x3d2d1916761d751b lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869514.461330:0:14184:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff94c818d1fa00/0x3d2d1916761d74ea lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3d2d1916761d74e3 expref: 12 pid: 14161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869514.461337:0:14184:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff94c83fde7e00/0x3d2d1916761d751b lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869514.461391:0:14184:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff94c818d1fa00/0x3d2d1916761d74ea lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x3d2d1916761d74e3 expref: 12 pid: 14161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869514.461404:0:14184:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff94c818d1fa00/0x3d2d1916761d74ea lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x3d2d1916761d74e3 expref: 12 pid: 14161 timeout: 362 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788869514.461418:0:14184:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94c83c68b480 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14184:1875765421481984:0@lo:104: 00000100:00100000:1.0:1788869514.461476:0:14184:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869514.461516:0:14184:0:(client.c:2702:ptlrpc_set_wait()) set ffff94c80319b0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788869514.461639:0:14151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765421481984 00000100:00100000:2.0:1788869514.461645:0:14151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765421481984 00000100:00100000:2.0:1788869514.461690:0:14151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788869514.461699:0:14151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c83c689c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:cd496ea5-7761-4e68-8a6b-58e98659ad4a+3:14184:x1875765421481984:12345-0@lo:104: 00010000:00010000:2.0:1788869514.461712:0:14151:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.139@tcp lock: ffff94c805038c00/0x3d2d1916761d74e3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x3d2d1916761d74ea expref: -99 pid: 14150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869514.461760:0:14151:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788869514.461766:0:14151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c83c689c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:cd496ea5-7761-4e68-8a6b-58e98659ad4a+3:14184:x1875765421481984:12345-0@lo:104: Request processed in 68us (290us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869514.461773:0:14151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:2.0:1788869514.461790:0:14157:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788869514.461796:0:14157:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.139@tcp lock: ffff94c805038c00/0x3d2d1916761d74e3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x3d2d1916761d74ea expref: -99 pid: 14150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869514.461804:0:14157:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94c805038c00 already unused, calling callback (ffffffffc1ce9c20) 10000000:00010000:2.0:1788869514.461808:0:14157:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.139@tcp lock: ffff94c805038c00/0x3d2d1916761d74e3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x3d2d1916761d74ea expref: -99 pid: 14150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869514.461816:0:14157:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.139@tcp lock: ffff94c805038c00/0x3d2d1916761d74e3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x3d2d1916761d74ea expref: -99 pid: 14150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788869514.461824:0:14157:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.139@tcp lock: ffff94c805038c00/0x3d2d1916761d74e3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x3d2d1916761d74ea expref: -99 pid: 14150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788869514.461829:0:14157:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1788869514.461851:0:14157:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.139@tcp lock: ffff94c805038c00/0x3d2d1916761d74e3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3d2d1916761d74ea expref: -99 pid: 14150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869514.461857:0:14157:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788869514.461880:0:14157:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.139@tcp lock: ffff94c805038c00/0x3d2d1916761d74e3 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3d2d1916761d74ea expref: -99 pid: 14150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869514.461887:0:14157:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.139@tcp lock: ffff94c805038c00/0x3d2d1916761d74e3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3d2d1916761d74ea expref: -99 pid: 14150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869514.461900:0:14157:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788869514.461902:0:14157:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788869514.461904:0:14157:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788869514.461920:0:3284:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788869514.461928:0:3284:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94c835154700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:cd496ea5-7761-4e68-8a6b-58e98659ad4a:3284:1875765421482112:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788869514.461967:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869514.462008:0:14153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765421482112 00000100:00100000:2.0:1788869514.462011:0:14153:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765421482112 00010000:00010000:2.0:1788869514.462026:0:14153:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff94c818d1fa00/0x3d2d1916761d74ea lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3d2d1916761d74e3 expref: 13 pid: 14161 timeout: 362 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788869514.462043:0:14153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788869514.462049:0:14153:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c835154e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cd496ea5-7761-4e68-8a6b-58e98659ad4a+13:3284:x1875765421482112:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788869514.462058:0:14153:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788869514.462063:0:14153:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff94c818d1fa00/0x3d2d1916761d74ea lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3d2d1916761d74e3 expref: 13 pid: 14161 timeout: 362 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869514.462072:0:14153:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff94c818d1fa00/0x3d2d1916761d74ea lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x3d2d1916761d74e3 expref: 13 pid: 14161 timeout: 362 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869514.462086:0:14153:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff94c83fde7e00/0x3d2d1916761d751b lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869514.462184:0:14153:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff94c83fde7e00/0x3d2d1916761d751b lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1788869514.462201:0:14153:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.000913315s 00010000:00010000:2.0:1788869514.462205:0:14153:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff94c83fde7e00/0x3d2d1916761d751b lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869514.462212:0:14153:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff94c83fde7e00/0x3d2d1916761d751b lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869514.462219:0:14153:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff94c83fde7e00/0x3d2d1916761d751b lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869514.462224:0:14153:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff94c83fde7e00/0x3d2d1916761d751b lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869514.462230:0:14153:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94c83fde7e00 already unused, calling callback (ffffffffc1703220) 00010000:00010000:2.0:1788869514.462234:0:14153:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff94c83fde7e00/0x3d2d1916761d751b lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869514.462242:0:14153:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff94c83fde7e00/0x3d2d1916761d751b lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869514.462281:0:14153:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff94c83fde7e00/0x3d2d1916761d751b lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869514.462291:0:14153:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788869514.462319:0:14153:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c835154e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cd496ea5-7761-4e68-8a6b-58e98659ad4a+13:3284:x1875765421482112:12345-0@lo:103:ldlm_bl.0 Request processed in 270us (351us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869514.462326:0:14153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788869514.462356:0:3284:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94c835154700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:cd496ea5-7761-4e68-8a6b-58e98659ad4a:3284:1875765421482112:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788869514.462915:0:14184:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff94c818d1fa00/0x3d2d1916761d74ea lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x3d2d1916761d74e3 expref: 12 pid: 14161 timeout: 362 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788869514.462925:0:14184:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94c83c68b480 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14184:1875765421481984:0@lo:104: 00010000:00010000:1.0:1788869514.462936:0:14184:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff94c83fde7e00/0x3d2d1916761d751b lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869514.463001:0:14184:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff94c83fde7e00/0x3d2d1916761d751b lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869514.463009:0:14184:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff94c83fde7e00/0x3d2d1916761d751b lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869514.463016:0:14184:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff94c83fde7e00/0x3d2d1916761d751b lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788869514.470285:0:14161:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c83553e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cd496ea5-7761-4e68-8a6b-58e98659ad4a+11:14150:x1875765421481856:12345-0@lo:253:mount.lustre.0 Request processed in 67715us (68237us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869514.470307:0:14161:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1788869514.470529:0:14150:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94c835a16300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cd496ea5-7761-4e68-8a6b-58e98659ad4a:14150:1875765421481856:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1788869514.470543:0:14150:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:0.0:1788869514.470546:0:14150:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1788869514.470548:0:14150:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1788869514.470550:0:14150:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788869514.470551:0:14150:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788869514.470553:0:14150:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788869514.470554:0:14150:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788869514.470555:0:14150:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788869514.470557:0:14150:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1788869514.470558:0:14150:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788869514.470560:0:14150:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1788869514.470574:0:14150:0:(tgt_mount.c:2689:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:1.0:1788869514.476580:0:14150:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/8/4) registered 00080000:10000000:1.0:1788869514.476749:0:14150:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:1.0:1788869514.477171:0:14150:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00080000:10000000:1.0:1788869514.477482:0:14150:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:1.0:1788869514.477722:0:14150:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/8/4) registered 00080000:10000000:1.0:1788869514.477853:0:14150:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00080000:10000000:1.0:1788869514.478715:0:14150:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/8/4) registered 00080000:10000000:1.0:1788869514.478845:0:14150:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8/1) registered 00080000:10000000:1.0:1788869514.479196:0:14150:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/8/4) registered 00080000:10000000:1.0:1788869514.479508:0:14150:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8/1) registered 00080000:10000000:1.0:1788869514.479730:0:14150:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xf:0x0] (8/8/4) registered 00080000:10000000:1.0:1788869514.479860:0:14150:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8/1) registered 00000020:00080000:2.0:1788869514.508191:0:14150:0:(update_trans.c:1495:distribute_txn_commit_batchid_init()) lustre-MDT0000: committed batchid 8 00000040:01000000:3.0:1788869514.508626:0:14150:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000020:00080000:2.0:1788869514.508753:0:14205:0:(update_trans.c:1538:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 8 00000020:00080000:2.0:1788869514.508758:0:14205:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000040:01000000:2.0:1788869514.508853:0:14206:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:00080000:2.0:1788869514.508906:0:14206:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788869514.513809:0:14206:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:2.0:1788869514.513866:0:14206:0:(lod_dev.c:522:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000004:00080000:2.0:1788869514.513870:0:14206:0:(lod_dev.c:546:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00000040:01000000:3.0:1788869514.514748:0:14150:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:3.0:1788869514.514849:0:14150:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:3.0:1788869514.515556:0:14150:0:(mdd_device.c:553:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:3.0:1788869514.515568:0:14150:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:3.0:1788869514.515675:0:14150:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788869514.522078:0:14150:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:3.0:1788869514.523119:0:14150:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:3.0:1788869514.523152:0:14150:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000040:00080000:3.0:1788869514.523805:0:14150:0:(llog_cat.c:403:llog_cat_set_first_idx()) catlog [0xa:0x7:0x0] first idx 0, last_idx 1 00080000:10000000:3.0:1788869514.524806:0:14150:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x36:0x0] (8/8/4) registered 00000001:00000004:3.0:1788869514.546821:0:14150:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934592 00000001:00080000:3.0:1788869514.663907:0:14150:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:3.0:1788869514.663943:0:14150:0:(mdd_device.c:2302:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffacc142a03988 00100000:10000000:3.0:1788869514.663951:0:14150:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:3.0:1788869514.665882:0:14150:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1788869514.665897:0:14150:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.201.139@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1788869514.665909:0:14150:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=45 00000080:00000004:3.0:1788869514.665924:0:14150:0:(super25.c:181:lustre_fill_super()) lustre-mdt1/mdt1: Mount complete 00010000:00010000:0.0:1788869514.784000:0:14156:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1788869514.952631:0:14165:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1788869514.952640:0:14165:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff94c83f9d2800 from 6 10000000:01000000:1.0:1788869514.952645:0:14165:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1788869514.952689:0:14165:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.139@tcp lock: ffff94c83fde6c00/0x3d2d1916761d7522 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869514.952701:0:14165:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.139@tcp lock: ffff94c83fde6c00/0x3d2d1916761d7522 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869514.952713:0:14165:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.139@tcp lock: ffff94c83fde6c00/0x3d2d1916761d7522 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788869514.952739:0:14165:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94c83c68b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cd496ea5-7761-4e68-8a6b-58e98659ad4a:14165:1875765421482240:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788869514.952804:0:14165:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869514.952903:0:14165:0:(client.c:2702:ptlrpc_set_wait()) set ffff94c820d66a80 going to sleep for 11 seconds 00000100:00100000:3.0:1788869514.957683:0:14162:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765421482240 00000100:00100000:3.0:1788869514.957698:0:14162:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765421482240 00000100:00100000:3.0:1788869514.957762:0:14162:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1788869514.957772:0:14162:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c83553d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cd496ea5-7761-4e68-8a6b-58e98659ad4a+11:14165:x1875765421482240:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788869514.957788:0:14162:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788869514.957808:0:14162:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff94c83504c400/0x3d2d1916761d7529 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x3d2d1916761d7522 expref: -99 pid: 14162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869514.957836:0:14162:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff94c83504c400/0x3d2d1916761d7529 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3d2d1916761d7522 expref: 12 pid: 14162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869514.957848:0:14162:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff94c83504c400/0x3d2d1916761d7529 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3d2d1916761d7522 expref: 12 pid: 14162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869514.957857:0:14162:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94c83504c400, rc 0) 00000100:00100000:3.0:1788869514.958176:0:14162:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c83553d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cd496ea5-7761-4e68-8a6b-58e98659ad4a+12:14165:x1875765421482240:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 404us (5369us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869514.958193:0:14162:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1788869514.969626:0:14165:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94c83c68b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cd496ea5-7761-4e68-8a6b-58e98659ad4a:14165:1875765421482240:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788869514.969658:0:14165:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.139@tcp lock: ffff94c83fde6c00/0x3d2d1916761d7522 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3d2d1916761d7529 expref: -99 pid: 14165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869514.969673:0:14165:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.139@tcp lock: ffff94c83fde6c00/0x3d2d1916761d7522 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x3d2d1916761d7529 expref: -99 pid: 14165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788869514.969768:0:14165:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94c83c68b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cd496ea5-7761-4e68-8a6b-58e98659ad4a:14165:1875765421482368:0@lo:256:ll_cfg_requeue.0 00000100:00100000:1.0:1788869514.969830:0:14165:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869514.969872:0:14165:0:(client.c:2702:ptlrpc_set_wait()) set ffff94c820d66a80 going to sleep for 11 seconds 00000100:00100000:0.0:1788869514.970640:0:14161:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765421482368 00000100:00100000:0.0:1788869514.970649:0:14161:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765421482368 00000100:00100000:0.0:1788869514.970703:0:14161:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1788869514.970712:0:14161:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c83553c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cd496ea5-7761-4e68-8a6b-58e98659ad4a+12:14165:x1875765421482368:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1788869514.970734:0:14161:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1788869514.970750:0:14161:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1788869514.970754:0:14161:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 6 00000100:00100000:0.0:1788869514.970839:0:14161:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c83553c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cd496ea5-7761-4e68-8a6b-58e98659ad4a+12:14165:x1875765421482368:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 127us (1008us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869514.970847:0:14161:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1788869514.970987:0:14165:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94c83c68b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cd496ea5-7761-4e68-8a6b-58e98659ad4a:14165:1875765421482368:0@lo:256:ll_cfg_requeue.0 10000000:01000000:1.0:1788869514.971031:0:14165:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.139@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1788869514.971040:0:14165:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.139@tcp lock: ffff94c83fde6c00/0x3d2d1916761d7522 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3d2d1916761d7529 expref: -99 pid: 14165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869514.971048:0:14165:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.139@tcp lock: ffff94c83fde6c00/0x3d2d1916761d7522 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3d2d1916761d7529 expref: -99 pid: 14165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788869515.483484:0:14201:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788869515.483494:0:14201:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788869515.483852:0:14201:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:1.0:1788869515.483858:0:14201:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:0.0:1788869515.812413:0:14157:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788869516.509858:0:14201:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788869516.509869:0:14201:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788869516.510864:0:14201:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 3 00000040:00080000:1.0:1788869516.510874:0:14201:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:0.0:1788869516.827525:0:14156:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788869517.853444:0:14157:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788869518.889819:0:14156:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1788869519.451449:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788869519.451457:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788869519.451460:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788869519.451464:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788869519.451466:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:2.0:1788869519.451469:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1788869519.451473:0:36:0:(import.c:65:import_set_state_nolock()) ffff94c810d5e000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788869519.451486:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff94c810d5e000 using connection 192.168.201.139@tcp/0@lo 00000100:00100000:2.0:1788869519.451510:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff94c835155500 x1875765421482624/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788869519.451554:0:3283:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788869519.451571:0:3283:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94c835154700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:cd496ea5-7761-4e68-8a6b-58e98659ad4a:3283:1875765421482496:0@lo:400:kworker.0 00000100:00100000:2.0:1788869519.451641:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869519.451705:0:3282:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94c835155500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3282:1875765421482624:0@lo:38:kworker.0 00000100:00100000:2.0:1788869519.451737:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869519.451778:0:14162:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765421482496 00000100:00100000:2.0:1788869519.451785:0:14162:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765421482496 00000100:00100000:2.0:1788869519.451829:0:14162:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1788869519.451838:0:14162:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c83553d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cd496ea5-7761-4e68-8a6b-58e98659ad4a+12:3283:x1875765421482496:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788869519.451886:0:14162:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c83553d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cd496ea5-7761-4e68-8a6b-58e98659ad4a+12:3283:x1875765421482496:12345-0@lo:400:kworker.0 Request processed in 49us (244us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869519.451894:0:14162:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1788869519.451943:0:3283:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94c835154700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:cd496ea5-7761-4e68-8a6b-58e98659ad4a:3283:1875765421482496:0@lo:400:kworker.0 00000100:00100000:1.0:1788869519.452177:0:14170:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765421482624 00000100:00100000:1.0:1788869519.452182:0:14170:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765421482624 00000100:00100000:1.0:1788869519.452260:0:14170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788869519.452266:0:14170:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c835157800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3282:x1875765421482624:12345-0@lo:38:kworker.0 00010000:00080000:1.0:1788869519.452287:0:14170:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 267 last 0 00000020:00000080:1.0:1788869519.452323:0:14170:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0x3d2d1916761d7530 00000004:00100000:1.0:1788869519.452345:0:14170:0:(mdt_handler.c:7366:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1788869519.454234:0:14170:0:(import.c:65:import_set_state_nolock()) ffff94c805120800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788869519.454335:0:14170:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c835157800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3282:x1875765421482624:12345-0@lo:38:kworker.0 Request processed in 2065us (2594us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869519.454344:0:14170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1788869519.454520:0:3282:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff94c835155500 x1875765421482624/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788869529 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788869519.454538:0:3282:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 2 00000100:00080000:2.0:1788869519.454547:0:3282:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:2.0:1788869519.454551:0:3282:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1788869519.454554:0:3282:0:(import.c:65:import_set_state_nolock()) ffff94c810d5e000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1788869519.454560:0:3282:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94c835155500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3282:1875765421482624:0@lo:38:kworker.0 00010000:00010000:0.0:1788869519.900585:0:14157:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1788869520.209481:0:14449:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg139-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:1.0:1788869520.923643:0:14156:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788869521.948154:0:14157:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788869522.983241:0:14156:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788869523.995616:0:14157:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1788869524.571522:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788869524.571532:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788869524.571535:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788869524.571538:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1788869524.571591:0:3286:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94c835a16a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3286:1875765421482880:0@lo:400:kworker.0 00000100:00100000:2.0:1788869524.571681:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869524.571738:0:3285:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94c835a15f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:cd496ea5-7761-4e68-8a6b-58e98659ad4a:3285:1875765421482752:0@lo:400:kworker.0 00000100:00100000:1.0:1788869524.571779:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869524.571853:0:14163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765421482752 00000100:00100000:2.0:1788869524.571864:0:14163:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765421482752 00000100:00100000:3.0:1788869524.571866:0:14169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765421482880 00000100:00100000:3.0:1788869524.571869:0:14169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765421482880 00000100:00100000:2.0:1788869524.571912:0:14163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1788869524.571913:0:14169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788869524.571921:0:14163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c83553c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cd496ea5-7761-4e68-8a6b-58e98659ad4a+12:3285:x1875765421482752:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788869524.571922:0:14169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c835155500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3286:x1875765421482880:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788869524.571978:0:14163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c83553c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cd496ea5-7761-4e68-8a6b-58e98659ad4a+12:3285:x1875765421482752:12345-0@lo:400:kworker.0 Request processed in 57us (198us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869524.571981:0:14169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c835155500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3286:x1875765421482880:12345-0@lo:400:kworker.0 Request processed in 61us (301us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869524.571986:0:14163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1788869524.571987:0:14169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:3.0:1788869524.572028:0:3286:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff94c835a16a00 x1875765421482880/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788869540 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788869524.572053:0:3286:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94c835a16a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3286:1875765421482880:0@lo:400:kworker.0 00000100:00100000:1.0:1788869524.572133:0:3285:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94c835a15f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:cd496ea5-7761-4e68-8a6b-58e98659ad4a:3285:1875765421482752:0@lo:400:kworker.0 00000100:00100000:3.0:1788869524.573454:0:3282:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788869514/real 1788869514] req@ffff94c83661d180 x1875765421479936/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788869524 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788869524.573482:0:3282:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff94c83661d180 x1875765421479936/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788869524 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788869524.573492:0:3282:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788869514/real 1788869514] req@ffff94c835157100 x1875765421479808/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788869524 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788869524.573503:0:3282:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff94c835157100 x1875765421479808/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788869524 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788869524.573531:0:3282:0:(import.c:65:import_set_state_nolock()) ffff94c80f9b5000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788869524.573557:0:3282:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1788869524.573569:0:3282:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94c83661d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3282:1875765421479936:0@lo:8:llog_process_th.0 00000100:00080000:3.0:1788869524.573574:0:3282:0:(import.c:65:import_set_state_nolock()) ffff94c839dd5000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788869524.573581:0:3282:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1788869524.573583:0:3282:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94c835157100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3282:1875765421479808:0@lo:8:llog_process_th.0 00000100:00080000:1.0:1788869524.573711:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788869524.573717:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:1.0:1788869524.573720:0:36:0:(import.c:65:import_set_state_nolock()) ffff94c839dd5000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788869524.573726:0:36:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 262 00000100:00080000:1.0:1788869524.573732:0:36:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1788869524.573738:0:36:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff94c839dd5000 using connection 192.168.201.139@tcp/0@lo 00000100:00100000:1.0:1788869524.573777:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff94c83c68b480 x1875765421483008/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788869524.573803:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788869524.573807:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1788869524.573808:0:36:0:(import.c:65:import_set_state_nolock()) ffff94c80f9b5000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788869524.573812:0:36:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 262 00000100:00080000:1.0:1788869524.573815:0:36:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1788869524.573818:0:36:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff94c80f9b5000 using connection 192.168.201.139@tcp/0@lo 00000100:00100000:1.0:1788869524.573830:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff94c83c68ad80 x1875765421483136/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788869524.573892:0:3282:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94c83c68b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3282:1875765421483008:0@lo:8:kworker.0 00000400:00000100:3.0:1788869524.573940:0:3282:0:(lib-move.c:4322:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875765421483008 offset 0 length 520: 4 00000100:00100000:3.0:1788869524.573974:0:3282:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94c83c68ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3282:1875765421483136:0@lo:8:kworker.0 00000400:00000100:3.0:1788869524.573988:0:3282:0:(lib-move.c:4322:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875765421483136 offset 0 length 520: 4 00000020:00000080:0.0:1788869524.587537:0:14600:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffd10b12850 20000000:00000080:0.0:1788869524.587563:0:14600:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff94c83cdfa000 uarg=0000000000000000 20000000:01000000:0.0:1788869524.587607:0:14600:0:(mgs_llog.c:6188:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:0.0:1788869524.587616:0:14600:0:(mgs_llog.c:4643:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:0.0:1788869524.587622:0:14600:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:3.0:1788869524.594620:0:14601:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 2 count 10 20000000:00000400:0.0:1788869524.594736:0:14600:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17 10000000:01000000:0.0:1788869524.615533:0:14600:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:1.0:1788869524.615730:0:14600:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff94c83fde7800/0x3d2d1916761d7537 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869524.615759:0:14600:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff94c805038400/0x3d2d1916761d74f8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3d2d1916761d74f1 expref: 11 pid: 14162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869524.615771:0:14600:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff94c83fde7800/0x3d2d1916761d7537 lrc: 4/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869524.615852:0:14600:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff94c805038400/0x3d2d1916761d74f8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x3d2d1916761d74f1 expref: 11 pid: 14162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869524.615873:0:14600:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff94c805038400/0x3d2d1916761d74f8 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x3d2d1916761d74f1 expref: 11 pid: 14162 timeout: 372 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788869524.615894:0:14600:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94c83c689500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:14600:1875765421483264:0@lo:104: 00000100:00100000:1.0:1788869524.615999:0:14600:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869524.616082:0:14600:0:(client.c:2702:ptlrpc_set_wait()) set ffff94c802d53780 going to sleep for 11 seconds 00000100:00100000:0.0:1788869524.616371:0:14152:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765421483264 00000100:00100000:0.0:1788869524.616382:0:14152:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765421483264 00000100:00100000:0.0:1788869524.616448:0:14152:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788869524.616461:0:14152:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c83c68b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:cd496ea5-7761-4e68-8a6b-58e98659ad4a+3:14600:x1875765421483264:12345-0@lo:104: 00010000:00010000:0.0:1788869524.616477:0:14152:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.139@tcp lock: ffff94c83504c000/0x3d2d1916761d74f1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x3d2d1916761d74f8 expref: -99 pid: 14150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869524.616540:0:14152:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788869524.616547:0:14152:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c83c68b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:cd496ea5-7761-4e68-8a6b-58e98659ad4a+3:14600:x1875765421483264:12345-0@lo:104: Request processed in 89us (548us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869524.616555:0:14152:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00010000:0.0:1788869524.616582:0:14156:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788869524.616589:0:14156:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.139@tcp lock: ffff94c83504c000/0x3d2d1916761d74f1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x3d2d1916761d74f8 expref: -99 pid: 14150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869524.616598:0:14156:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94c83504c000 already unused, calling callback (ffffffffc1ce9c20) 10000000:00010000:0.0:1788869524.616602:0:14156:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.139@tcp lock: ffff94c83504c000/0x3d2d1916761d74f1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x3d2d1916761d74f8 expref: -99 pid: 14150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869524.616612:0:14156:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.139@tcp lock: ffff94c83504c000/0x3d2d1916761d74f1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x3d2d1916761d74f8 expref: -99 pid: 14150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788869524.616637:0:14156:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.139@tcp lock: ffff94c83504c000/0x3d2d1916761d74f1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x3d2d1916761d74f8 expref: -99 pid: 14150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788869524.616643:0:14156:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1788869524.616686:0:14156:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.139@tcp lock: ffff94c83504c000/0x3d2d1916761d74f1 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3d2d1916761d74f8 expref: -99 pid: 14150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869524.616693:0:14156:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788869524.616718:0:14156:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.139@tcp lock: ffff94c83504c000/0x3d2d1916761d74f1 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3d2d1916761d74f8 expref: -99 pid: 14150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869524.616726:0:14156:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.139@tcp lock: ffff94c83504c000/0x3d2d1916761d74f1 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3d2d1916761d74f8 expref: -99 pid: 14150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869524.616743:0:14156:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788869524.616745:0:14156:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788869524.616747:0:14156:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788869524.616760:0:3283:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94c83661e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:cd496ea5-7761-4e68-8a6b-58e98659ad4a:3283:1875765421483392:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788869524.616794:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869524.617353:0:14600:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94c83c689500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:14600:1875765421483264:0@lo:104: 00010000:00010000:1.0:1788869524.617380:0:14600:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff94c83fde7800/0x3d2d1916761d7537 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788869524.618080:0:14153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765421483392 00000100:00100000:3.0:1788869524.618093:0:14153:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765421483392 00010000:00010000:3.0:1788869524.618138:0:14153:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff94c805038400/0x3d2d1916761d74f8 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3d2d1916761d74f1 expref: 12 pid: 14162 timeout: 372 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788869524.618182:0:14153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788869524.618192:0:14153:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c83661d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cd496ea5-7761-4e68-8a6b-58e98659ad4a+12:3283:x1875765421483392:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788869524.618210:0:14153:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788869524.618216:0:14153:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff94c805038400/0x3d2d1916761d74f8 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3d2d1916761d74f1 expref: 12 pid: 14162 timeout: 372 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869524.618230:0:14153:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff94c805038400/0x3d2d1916761d74f8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x3d2d1916761d74f1 expref: 12 pid: 14162 timeout: 372 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869524.618298:0:14153:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff94c805038400/0x3d2d1916761d74f8 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x3d2d1916761d74f1 expref: 12 pid: 14162 timeout: 372 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869524.618317:0:14153:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff94c83fde7800/0x3d2d1916761d7537 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869524.618326:0:14153:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff94c83fde7800/0x3d2d1916761d7537 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869524.618344:0:14153:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff94c83fde7800/0x3d2d1916761d7537 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869524.618352:0:14153:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff94c83fde7800/0x3d2d1916761d7537 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869524.618360:0:14153:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff94c83fde7800/0x3d2d1916761d7537 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869524.618368:0:14153:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff94c83fde7800/0x3d2d1916761d7537 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869524.618374:0:14153:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94c83fde7800 already unused, calling callback (ffffffffc1703220) 00010000:00010000:3.0:1788869524.618378:0:14153:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff94c83fde7800/0x3d2d1916761d7537 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869524.618387:0:14153:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff94c83fde7800/0x3d2d1916761d7537 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869524.618399:0:14153:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff94c83fde7800/0x3d2d1916761d7537 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869524.618423:0:14153:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788869524.618507:0:14153:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c83661d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cd496ea5-7761-4e68-8a6b-58e98659ad4a+11:3283:x1875765421483392:12345-0@lo:103:ldlm_bl.0 Request processed in 316us (1711us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869524.618515:0:14153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788869524.619324:0:3283:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94c83661e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:cd496ea5-7761-4e68-8a6b-58e98659ad4a:3283:1875765421483392:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788869524.621032:0:14600:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff94c83fde7800/0x3d2d1916761d7537 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869524.621067:0:14600:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff94c83fde7800/0x3d2d1916761d7537 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869524.621075:0:14600:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff94c83fde7800/0x3d2d1916761d7537 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869525.020610:0:14157:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788869526.043853:0:14156:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1788869526.171494:0:14165:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1788869526.171507:0:14165:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff94c83f9d2800 from 10 10000000:01000000:3.0:1788869526.171514:0:14165:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788869526.171582:0:14165:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.139@tcp lock: ffff94c83504ce00/0x3d2d1916761d753e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869526.171597:0:14165:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.139@tcp lock: ffff94c83504ce00/0x3d2d1916761d753e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869526.171612:0:14165:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.139@tcp lock: ffff94c83504ce00/0x3d2d1916761d753e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788869526.171646:0:14165:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94c835a16a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cd496ea5-7761-4e68-8a6b-58e98659ad4a:14165:1875765421483520:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788869526.171738:0:14165:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869526.171852:0:14165:0:(client.c:2702:ptlrpc_set_wait()) set ffff94c808773240 going to sleep for 11 seconds 00000100:00100000:2.0:1788869526.172913:0:14161:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765421483520 00000100:00100000:2.0:1788869526.172946:0:14161:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765421483520 00000100:00100000:2.0:1788869526.173043:0:14161:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1788869526.173057:0:14161:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c8225f0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cd496ea5-7761-4e68-8a6b-58e98659ad4a+11:14165:x1875765421483520:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788869526.173080:0:14161:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788869526.173104:0:14161:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff94c805038800/0x3d2d1916761d7545 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x3d2d1916761d753e expref: -99 pid: 14161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869526.173140:0:14161:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff94c805038800/0x3d2d1916761d7545 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3d2d1916761d753e expref: 12 pid: 14161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869526.173153:0:14161:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff94c805038800/0x3d2d1916761d7545 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3d2d1916761d753e expref: 12 pid: 14161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869526.173164:0:14161:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94c805038800, rc 0) 00000100:00100000:2.0:1788869526.173282:0:14161:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c8225f0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cd496ea5-7761-4e68-8a6b-58e98659ad4a+12:14165:x1875765421483520:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 228us (1542us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869526.173289:0:14161:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1788869526.173367:0:14165:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94c835a16a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cd496ea5-7761-4e68-8a6b-58e98659ad4a:14165:1875765421483520:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788869526.173637:0:14165:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.139@tcp lock: ffff94c83504ce00/0x3d2d1916761d753e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3d2d1916761d7545 expref: -99 pid: 14165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869526.173649:0:14165:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.139@tcp lock: ffff94c83504ce00/0x3d2d1916761d753e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x3d2d1916761d7545 expref: -99 pid: 14165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788869526.173741:0:14165:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94c835154700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cd496ea5-7761-4e68-8a6b-58e98659ad4a:14165:1875765421483648:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788869526.173778:0:14165:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869526.173844:0:14165:0:(client.c:2702:ptlrpc_set_wait()) set ffff94c8104506c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788869526.177562:0:14162:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765421483648 00000100:00100000:3.0:1788869526.177589:0:14162:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765421483648 00000100:00100000:2.0:1788869526.197295:0:14162:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1788869526.197335:0:14162:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c8225f2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cd496ea5-7761-4e68-8a6b-58e98659ad4a+12:14165:x1875765421483648:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788869526.197846:0:14162:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c8225f2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cd496ea5-7761-4e68-8a6b-58e98659ad4a+12:14165:x1875765421483648:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 514us (24065us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869526.197858:0:14162:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1788869526.198476:0:14165:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94c835154700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cd496ea5-7761-4e68-8a6b-58e98659ad4a:14165:1875765421483648:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788869526.198561:0:14165:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94c835a14a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cd496ea5-7761-4e68-8a6b-58e98659ad4a:14165:1875765421483776:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788869526.198632:0:14165:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869526.198677:0:14165:0:(client.c:2702:ptlrpc_set_wait()) set ffff94c808773f00 going to sleep for 11 seconds 00000100:00100000:2.0:1788869526.199779:0:14163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765421483776 00000100:00100000:2.0:1788869526.199793:0:14163:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765421483776 00000100:00100000:2.0:1788869526.199875:0:14163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1788869526.199887:0:14163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c8225f1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cd496ea5-7761-4e68-8a6b-58e98659ad4a+12:14165:x1875765421483776:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788869526.200224:0:14163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c8225f1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cd496ea5-7761-4e68-8a6b-58e98659ad4a+12:14165:x1875765421483776:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 339us (1592us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869526.200234:0:14163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1788869526.200721:0:14165:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94c835a14a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cd496ea5-7761-4e68-8a6b-58e98659ad4a:14165:1875765421483776:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1788869526.201930:0:14657:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:2.0:1788869526.203714:0:14165:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:2.0:1788869526.203760:0:14165:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.139@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788869526.203777:0:14165:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.139@tcp lock: ffff94c83504ce00/0x3d2d1916761d753e lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3d2d1916761d7545 expref: -99 pid: 14165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869526.203793:0:14165:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.139@tcp lock: ffff94c83504ce00/0x3d2d1916761d753e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3d2d1916761d7545 expref: -99 pid: 14165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788869526.747581:0:14201:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788869526.747596:0:14201:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788869526.748415:0:14201:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 1 00000040:00080000:2.0:1788869526.748490:0:14201:0:(llog_cat_server.c:902:llog_cat_cleanup()) cancel plain log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788869526.748533:0:14201:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 1 count 1 00010000:00010000:2.0:1788869527.067455:0:14157:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788869528.103207:0:14156:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788869529.119161:0:14157:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1788869529.698236:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788869529.698272:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788869529.698276:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788869529.698279:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1788869529.698291:0:3283:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788869529.698319:0:3283:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94c835a14a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:cd496ea5-7761-4e68-8a6b-58e98659ad4a:3283:1875765421483904:0@lo:400:kworker.0 00000100:00100000:3.0:1788869529.698421:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869529.698520:0:3286:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788869529.698529:0:3286:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94c835a17b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3286:1875765421484032:0@lo:400:kworker.0 00000100:00100000:3.0:1788869529.698562:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869529.698667:0:14162:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765421483904 00000100:00100000:2.0:1788869529.698678:0:14162:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765421483904 00000100:00100000:2.0:1788869529.698745:0:14162:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1788869529.698772:0:14162:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c81f236850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cd496ea5-7761-4e68-8a6b-58e98659ad4a+12:3283:x1875765421483904:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788869529.698837:0:14162:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c81f236850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cd496ea5-7761-4e68-8a6b-58e98659ad4a+12:3283:x1875765421483904:12345-0@lo:400:kworker.0 Request processed in 68us (416us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869529.698846:0:14162:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1788869529.698952:0:14170:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765421484032 00000100:00100000:1.0:1788869529.698957:0:14170:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765421484032 00000100:00100000:1.0:1788869529.699009:0:14170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788869529.699017:0:14170:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c835a15180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3286:x1875765421484032:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788869529.699065:0:14170:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c835a15180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3286:x1875765421484032:12345-0@lo:400:kworker.0 Request processed in 49us (502us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869529.699072:0:14170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1788869529.699277:0:3286:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff94c835a17b80 x1875765421484032/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788869545 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788869529.699295:0:3286:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94c835a17b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3286:1875765421484032:0@lo:400:kworker.0 00000100:00100000:3.0:1788869529.701193:0:3283:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94c835a14a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:cd496ea5-7761-4e68-8a6b-58e98659ad4a:3283:1875765421483904:0@lo:400:kworker.0 00010000:00010000:3.0:1788869530.139511:0:14156:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1788869530.673097:0:14802:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1788869530.673103:0:14802:0:(obd_mount.c:926:lmd_print()) device: lustre-ost1/ost1 00000080:01200004:3.0:1788869530.673477:0:14802:0:(super25.c:130:lustre_fill_super()) VFS Op: sb ffff94c8101da800 00000020:01000004:3.0:1788869530.673499:0:14802:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-OST0000, type=osd-zfs, lsifl=200002, mountfl=0 00000020:01000004:3.0:1788869530.673515:0:14802:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-zfs) 00000020:00000080:3.0:1788869530.673534:0:14802:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff94c82c84b380) 00000020:00000080:3.0:1788869530.673554:0:14802:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type osd-zfs with refcount 2 00100000:10000000:3.0:1788869530.719633:0:14802:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:3.0:1788869530.720532:0:14802:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0000: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:3.0:1788869530.726026:0:14802:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:3.0:1788869530.726646:0:14802:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00100000:10000000:3.0:1788869530.726877:0:14802:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0000: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:3.0:1788869530.727315:0:14802:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled lustre-OST0000 under 337: rc = 0 00100000:10000000:3.0:1788869530.727427:0:14802:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled lustre-client under 337: rc = 0 00100000:10000000:3.0:1788869530.727520:0:14802:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled params under 337: rc = 0 00100000:10000000:3.0:1788869530.727973:0:14802:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x2020000 under 642: rc = 0 00100000:10000000:3.0:1788869530.728226:0:14802:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x20000 under 642: rc = 0 00100000:10000000:3.0:1788869530.728645:0:14802:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x20000-OST0000 under 642: rc = 0 00100000:10000000:3.0:1788869530.730563:0:14802:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x1020000 under 642: rc = 0 00100000:10000000:3.0:1788869530.731004:0:14802:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x1020000-OST0000 under 642: rc = 0 00100000:10000000:3.0:1788869530.733877:0:14802:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x2020000-OST0000 under 642: rc = 0 00000020:00000080:3.0:1788869530.734642:0:14802:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:3.0:1788869530.734657:0:14802:0:(osd_handler.c:1569:osd_obd_connect()) connect #0 00000020:00000080:3.0:1788869530.734670:0:14802:0:(genops.c:1406:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x3d2d1916761d7553 00000020:01000004:3.0:1788869530.734679:0:14802:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-OST0000 on device lustre-ost1/ost1 00000020:01000004:3.0:1788869530.734705:0:14802:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.201.139@tcp:Set MGC reconnect 1 10000000:01000000:3.0:1788869530.734710:0:14802:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.201.139@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:3.0:1788869530.734716:0:14802:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0000 00000020:01000004:3.0:1788869530.734721:0:14802:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:3.0:1788869530.734736:0:14802:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff94c82c84cd40) 00000020:00000080:3.0:1788869530.734748:0:14802:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type ost with refcount 2 00000100:00100000:2.0:1788869530.747180:0:14802:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788869530.747455:0:14802:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:2.0:1788869530.747462:0:14802:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:0.0:1788869530.748214:0:14802:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:0.0:1788869530.748225:0:14802:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:1.0:1788869530.748596:0:14802:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:1.0:1788869530.748604:0:14802:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:0.0:1788869530.752803:0:14802:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788869530.753078:0:14802:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:0.0:1788869530.753087:0:14802:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:0.0:1788869530.754081:0:14802:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:0.0:1788869530.754099:0:14802:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:1.0:1788869530.773775:0:14802:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788869530.774116:0:14802:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:1.0:1788869530.774123:0:14802:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:1.0:1788869530.775646:0:14802:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:1.0:1788869530.775656:0:14802:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:1.0:1788869530.776549:0:14802:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:1.0:1788869530.776558:0:14802:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:1.0:1788869530.778343:0:14802:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788869530.778491:0:14802:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:1.0:1788869530.778496:0:14802:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:1.0:1788869530.779178:0:14802:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:1.0:1788869530.779185:0:14802:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:0.0:1788869530.816203:0:14802:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788869530.816519:0:14802:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:0.0:1788869530.816526:0:14802:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:0.0:1788869530.817636:0:14802:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:0.0:1788869530.817647:0:14802:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:1.0:1788869530.818091:0:14802:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:1.0:1788869530.818117:0:14802:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost1/ost1 10000000:01000000:1.0:1788869530.818123:0:14802:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.201.139@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:1.0:1788869530.828167:0:14802:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.201.139@tcp ctxt 0 is initialized 00000020:01000004:1.0:1788869530.828212:0:14802:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.201.139@tcp, index=0000, flags=0x20002 00000020:01000004:1.0:1788869530.828218:0:14802:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:1.0:1788869530.828220:0:14802:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1788869530.828221:0:14802:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788869530.828222:0:14802:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788869530.828224:0:14802:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788869530.828225:0:14802:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788869530.828227:0:14802:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788869530.828228:0:14802:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788869530.828230:0:14802:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1788869530.828234:0:14802:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020002 00000020:01000004:1.0:1788869530.828236:0:14802:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1788869530.828238:0:14802:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1788869530.828239:0:14802:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788869530.828240:0:14802:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788869530.828241:0:14802:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788869530.828242:0:14802:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788869530.828243:0:14802:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788869530.828245:0:14802:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788869530.828245:0:14802:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1788869530.828490:0:14802:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:1.0:1788869530.828512:0:14802:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94c83c689500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cd496ea5-7761-4e68-8a6b-58e98659ad4a:14802:1875765421484160:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1788869530.828586:0:14802:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869530.828681:0:14802:0:(client.c:2702:ptlrpc_set_wait()) set ffff94c840a8c900 going to sleep for 11 seconds 00000100:00100000:2.0:1788869530.828726:0:14163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765421484160 00000100:00100000:2.0:1788869530.828735:0:14163:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765421484160 00000100:00100000:2.0:1788869530.828834:0:14163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1788869530.828845:0:14163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c81f235c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cd496ea5-7761-4e68-8a6b-58e98659ad4a+12:14802:x1875765421484160:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1788869530.828878:0:14163:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:2.0:1788869530.828882:0:14163:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0000 is running on 0@lo 20000000:01000000:2.0:1788869530.828886:0:14163:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:0.0:1788869530.854063:0:14163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c81f235c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cd496ea5-7761-4e68-8a6b-58e98659ad4a+12:14802:x1875765421484160:12345-0@lo:253:mount.lustre.0 Request processed in 25211us (25466us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869530.854080:0:14163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1788869530.854166:0:14802:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94c83c689500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cd496ea5-7761-4e68-8a6b-58e98659ad4a:14802:1875765421484160:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1788869530.854181:0:14802:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:1.0:1788869530.854185:0:14802:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1788869530.854187:0:14802:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1788869530.854188:0:14802:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788869530.854190:0:14802:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788869530.854191:0:14802:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788869530.854193:0:14802:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788869530.854194:0:14802:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788869530.854196:0:14802:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788869530.854197:0:14802:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:1.0:1788869530.854218:0:14802:0:(tgt_mount.c:101:server_register_mount()) register mount ffff94c8101da800 from lustre-OST0000 10000000:01000000:1.0:1788869530.854245:0:14802:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:1.0:1788869530.854279:0:14802:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:1.0:1788869530.854285:0:14802:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff94c8060ab380 local copy 00010000:00010000:1.0:1788869530.854297:0:14802:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.139@tcp lock: ffff94c805039200/0x3d2d1916761d7449 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x3d2d1916761d7450 expref: -99 pid: 14150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788869530.854515:0:14802:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94c83c689500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cd496ea5-7761-4e68-8a6b-58e98659ad4a:14802:1875765421484288:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788869530.854553:0:14802:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869530.854635:0:14802:0:(client.c:2702:ptlrpc_set_wait()) set ffff94c840a8cf00 going to sleep for 11 seconds 00000100:00100000:3.0:1788869530.854679:0:14161:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765421484288 00000100:00100000:3.0:1788869530.854687:0:14161:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765421484288 00000100:00100000:3.0:1788869530.854823:0:14161:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1788869530.854832:0:14161:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c81f234050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cd496ea5-7761-4e68-8a6b-58e98659ad4a+12:14802:x1875765421484288:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788869530.855071:0:14161:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c81f234050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cd496ea5-7761-4e68-8a6b-58e98659ad4a+12:14802:x1875765421484288:12345-0@lo:501:mount.lustre.0 Request processed in 239us (516us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788869530.855079:0:14161:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1788869530.855150:0:14802:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94c83c689500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cd496ea5-7761-4e68-8a6b-58e98659ad4a:14802:1875765421484288:0@lo:501:mount.lustre.0 10000000:01000000:1.0:1788869530.855166:0:14802:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.201.139@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:1.0:1788869530.855350:0:14802:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.201.139@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:1.0:1788869530.855359:0:14802:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.139@tcp lock: ffff94c805039200/0x3d2d1916761d7449 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x3d2d1916761d7450 expref: -99 pid: 14150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869530.855368:0:14802:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.139@tcp lock: ffff94c805039200/0x3d2d1916761d7449 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x3d2d1916761d7450 expref: -99 pid: 14150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788869530.855394:0:14802:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff94c8101da800 10000000:01000000:1.0:1788869530.855399:0:14802:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1788869530.855404:0:14802:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff94c8060ab380 10000000:01000000:1.0:1788869530.855406:0:14802:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:1.0:1788869530.855409:0:14802:0:(mgc_request.c:1801:mgc_process_log()) Process log nodemap-ffff94c8060ab380 from 1 10000000:01000000:1.0:1788869530.855412:0:14802:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:1.0:1788869530.855436:0:14802:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.139@tcp lock: ffff94c83fde7c00/0x3d2d1916761d7561 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869530.855445:0:14802:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.139@tcp lock: ffff94c83fde7c00/0x3d2d1916761d7561 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869530.855466:0:14802:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.139@tcp lock: ffff94c83fde7c00/0x3d2d1916761d7561 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788869530.855481:0:14802:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94c83c689500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cd496ea5-7761-4e68-8a6b-58e98659ad4a:14802:1875765421484416:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788869530.855510:0:14802:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869530.855681:0:14802:0:(client.c:2702:ptlrpc_set_wait()) set ffff94c840a8cf00 going to sleep for 11 seconds 00000100:00100000:0.0:1788869530.855816:0:14162:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765421484416 00000100:00100000:0.0:1788869530.855821:0:14162:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765421484416 00000100:00100000:0.0:1788869530.855848:0:14162:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1788869530.855855:0:14162:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c81f236c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cd496ea5-7761-4e68-8a6b-58e98659ad4a+12:14802:x1875765421484416:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788869530.855864:0:14162:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788869530.855877:0:14162:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff94c818d1fe00/0x3d2d1916761d7568 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x3d2d1916761d7561 expref: -99 pid: 14162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869530.855914:0:14162:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff94c818d1fe00/0x3d2d1916761d7568 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3d2d1916761d7561 expref: 13 pid: 14162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869530.855924:0:14162:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff94c818d1fe00/0x3d2d1916761d7568 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3d2d1916761d7561 expref: 13 pid: 14162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869530.855933:0:14162:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94c818d1fe00, rc 0) 00000100:00100000:0.0:1788869530.855976:0:14162:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c81f236c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cd496ea5-7761-4e68-8a6b-58e98659ad4a+13:14802:x1875765421484416:12345-0@lo:101:mount.lustre.0 Request processed in 121us (464us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869530.855982:0:14162:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1788869530.856113:0:14802:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94c83c689500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cd496ea5-7761-4e68-8a6b-58e98659ad4a:14802:1875765421484416:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788869530.856125:0:14802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.139@tcp lock: ffff94c83fde7c00/0x3d2d1916761d7561 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3d2d1916761d7568 expref: -99 pid: 14802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869530.856133:0:14802:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.139@tcp lock: ffff94c83fde7c00/0x3d2d1916761d7561 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x3d2d1916761d7568 expref: -99 pid: 14802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788869530.856149:0:14802:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.139@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:1.0:1788869530.856170:0:14802:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.139@tcp lock: ffff94c83fde7c00/0x3d2d1916761d7561 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3d2d1916761d7568 expref: -99 pid: 14802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869530.856177:0:14802:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.139@tcp lock: ffff94c83fde7c00/0x3d2d1916761d7561 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3d2d1916761d7568 expref: -99 pid: 14802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788869530.856182:0:14802:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:1.0:1788869530.856186:0:14802:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1788869530.856189:0:14802:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:1.0:1788869530.856191:0:14802:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:1.0:1788869530.856205:0:14802:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.139@tcp lock: ffff94c83fde6000/0x3d2d1916761d756f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869530.856211:0:14802:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.139@tcp lock: ffff94c83fde6000/0x3d2d1916761d756f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869530.856226:0:14802:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.139@tcp lock: ffff94c83fde6000/0x3d2d1916761d756f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788869530.856240:0:14802:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94c83c689500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cd496ea5-7761-4e68-8a6b-58e98659ad4a:14802:1875765421484544:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788869530.856284:0:14802:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869530.856307:0:14162:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765421484544 00000100:00100000:1.0:1788869530.856312:0:14162:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765421484544 00000100:00100000:1.0:1788869530.856331:0:14162:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1788869530.856336:0:14162:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c81f236450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cd496ea5-7761-4e68-8a6b-58e98659ad4a+13:14802:x1875765421484544:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788869530.856344:0:14162:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788869530.856352:0:14162:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff94c83fde7e00/0x3d2d1916761d7576 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x3d2d1916761d756f expref: -99 pid: 14162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869530.856365:0:14162:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff94c83fde7e00/0x3d2d1916761d7576 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3d2d1916761d756f expref: 14 pid: 14162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869530.856373:0:14162:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff94c83fde7e00/0x3d2d1916761d7576 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3d2d1916761d756f expref: 14 pid: 14162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869530.856378:0:14162:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94c83fde7e00, rc 0) 00000100:00100000:1.0:1788869530.856401:0:14162:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c81f236450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cd496ea5-7761-4e68-8a6b-58e98659ad4a+14:14802:x1875765421484544:12345-0@lo:101:mount.lustre.0 Request processed in 65us (116us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869530.856406:0:14162:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1788869530.856435:0:14802:0:(client.c:2702:ptlrpc_set_wait()) set ffff94c840a8cf00 going to sleep for 11 seconds 00000100:00100000:1.0:1788869530.856446:0:14802:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94c83c689500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cd496ea5-7761-4e68-8a6b-58e98659ad4a:14802:1875765421484544:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788869530.856455:0:14802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.139@tcp lock: ffff94c83fde6000/0x3d2d1916761d756f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x3d2d1916761d7576 expref: -99 pid: 14802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869530.856468:0:14802:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.139@tcp lock: ffff94c83fde6000/0x3d2d1916761d756f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x3d2d1916761d7576 expref: -99 pid: 14802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788869530.857310:0:14802:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000040:00080000:1.0:1788869530.858540:0:14802:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788869530.858858:0:14802:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:1.0:1788869530.858983:0:14802:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 128 off8544 00000040:00080000:1.0:1788869530.859024:0:14802:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 112 off8656 00000040:00080000:1.0:1788869530.859074:0:14802:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8880 00000040:00080000:1.0:1788869530.859120:0:14802:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9104 00000040:00080000:1.0:1788869530.859155:0:14802:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 80 off9184 00000040:00080000:1.0:1788869530.859219:0:14802:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 224 off9408 00000040:00080000:1.0:1788869530.859227:0:14802:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000100:00100000:1.0:1788869530.859325:0:14802:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94c83c689500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cd496ea5-7761-4e68-8a6b-58e98659ad4a:14802:1875765421484672:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788869530.859382:0:14802:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869530.859429:0:14802:0:(client.c:2702:ptlrpc_set_wait()) set ffff94c840a8c9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788869530.859493:0:14163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765421484672 00000100:00100000:2.0:1788869530.859501:0:14163:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765421484672 00000100:00100000:2.0:1788869530.859546:0:14163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1788869530.859554:0:14163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c81f237c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cd496ea5-7761-4e68-8a6b-58e98659ad4a+14:14802:x1875765421484672:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788869530.860015:0:14163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c81f237c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cd496ea5-7761-4e68-8a6b-58e98659ad4a+14:14802:x1875765421484672:12345-0@lo:501:mount.lustre.0 Request processed in 458us (630us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869530.860024:0:14163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1788869530.860174:0:14802:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94c83c689500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cd496ea5-7761-4e68-8a6b-58e98659ad4a:14802:1875765421484672:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788869530.860213:0:14802:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94c83c689500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cd496ea5-7761-4e68-8a6b-58e98659ad4a:14802:1875765421484800:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788869530.860286:0:14802:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869530.860305:0:14802:0:(client.c:2702:ptlrpc_set_wait()) set ffff94c840a8c9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788869530.860353:0:14163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765421484800 00000100:00100000:2.0:1788869530.860358:0:14163:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765421484800 00000100:00100000:2.0:1788869530.860392:0:14163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1788869530.860399:0:14163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c81f236050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cd496ea5-7761-4e68-8a6b-58e98659ad4a+14:14802:x1875765421484800:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788869530.860701:0:14163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c81f236050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cd496ea5-7761-4e68-8a6b-58e98659ad4a+14:14802:x1875765421484800:12345-0@lo:503:mount.lustre.0 Request processed in 302us (414us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869530.860718:0:14163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1788869530.861026:0:14802:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94c83c689500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cd496ea5-7761-4e68-8a6b-58e98659ad4a:14802:1875765421484800:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1788869530.861984:0:14802:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1788869530.862054:0:14802:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94c83c689500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cd496ea5-7761-4e68-8a6b-58e98659ad4a:14802:1875765421484928:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788869530.862109:0:14802:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869530.862202:0:14802:0:(client.c:2702:ptlrpc_set_wait()) set ffff94c840a8c9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788869530.862401:0:14162:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765421484928 00000100:00100000:3.0:1788869530.862407:0:14162:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765421484928 00000100:00100000:3.0:1788869530.862485:0:14162:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1788869530.862494:0:14162:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c81f235850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cd496ea5-7761-4e68-8a6b-58e98659ad4a+14:14802:x1875765421484928:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788869530.862713:0:14162:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c81f235850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cd496ea5-7761-4e68-8a6b-58e98659ad4a+14:14802:x1875765421484928:12345-0@lo:502:mount.lustre.0 Request processed in 220us (603us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869530.862721:0:14162:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1788869530.863200:0:14802:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94c83c689500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cd496ea5-7761-4e68-8a6b-58e98659ad4a:14802:1875765421484928:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1788869530.863546:0:14802:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:1.0:1788869530.863608:0:14802:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 128 off8544 00000040:00080000:1.0:1788869530.863641:0:14802:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 112 off8656 00000040:00080000:1.0:1788869530.863685:0:14802:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8880 00000040:00080000:1.0:1788869530.863717:0:14802:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9104 00000040:00080000:1.0:1788869530.863742:0:14802:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 80 off9184 00000040:00080000:1.0:1788869530.863994:0:14802:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 224 off9408 00000040:00080000:1.0:1788869530.864032:0:14802:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9632 00000040:00080000:1.0:1788869530.864068:0:14802:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 80 off9712 00000040:00080000:1.0:1788869530.864114:0:14802:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 224 off9936 00000040:00080000:1.0:1788869530.864146:0:14802:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].11, 224 off10160 00000040:00080000:1.0:1788869530.864198:0:14802:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].12, 120 off10280 00000100:00100000:1.0:1788869530.864402:0:14802:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94c83c689500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cd496ea5-7761-4e68-8a6b-58e98659ad4a:14802:1875765421485056:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788869530.864456:0:14802:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869530.864543:0:14802:0:(client.c:2702:ptlrpc_set_wait()) set ffff94c840a8c9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788869530.864584:0:14161:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765421485056 00000100:00100000:3.0:1788869530.864590:0:14161:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765421485056 00000100:00100000:3.0:1788869530.864679:0:14161:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1788869530.864688:0:14161:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c81f234850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cd496ea5-7761-4e68-8a6b-58e98659ad4a+14:14802:x1875765421485056:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788869530.865036:0:14161:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c81f234850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cd496ea5-7761-4e68-8a6b-58e98659ad4a+14:14802:x1875765421485056:12345-0@lo:502:mount.lustre.0 Request processed in 349us (578us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869530.865044:0:14161:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1788869530.865120:0:14802:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94c83c689500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cd496ea5-7761-4e68-8a6b-58e98659ad4a:14802:1875765421485056:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1788869530.865195:0:14802:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].13, 224 off10504 00000040:00080000:1.0:1788869530.865206:0:14802:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 13 count 14 00000020:01000000:0.0:1788869530.866177:0:14817:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1788869530.866186:0:14817:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-ost1/ost1 00000020:00000080:0.0:1788869530.866197:0:14817:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788869530.866200:0:14817:0:(obd_config.c:1561:class_process_config()) marker 11 (0x1) lustre-OST0000 add ost 00000020:00000080:0.0:1788869530.866206:0:14817:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1788869530.866221:0:14817:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff94c82ded8000) 00000020:00000080:0.0:1788869530.866246:0:14817:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type obdfilter with refcount 2 00000020:00000080:0.0:1788869530.866277:0:14817:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:0.0:1788869530.866341:0:14817:0:(tgt_mount.c:153:server_get_mount()) get mount ffff94c8101da800 from lustre-OST0000, refs=2 00080000:01000000:0.0:1788869530.866350:0:14817:0:(osd_handler.c:1569:osd_obd_connect()) connect #1 00000020:00000080:0.0:1788869530.866356:0:14817:0:(genops.c:1406:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x3d2d1916761d7584 00010000:00010000:1.0:1788869530.873184:0:14817:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-2 is initialized 00000001:00000004:1.0:1788869530.873640:0:14817:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 4294967310 00080000:10000000:1.0:1788869530.875678:0:14817:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00000020:00000080:1.0:1788869530.877196:0:14817:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:1.0:1788869530.877209:0:14817:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788869530.877216:0:14817:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788869530.877218:0:14817:0:(obd_config.c:1561:class_process_config()) marker 11 (0x2) lustre-OST0000 add ost 00000020:01000000:1.0:1788869530.877222:0:14817:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1788869530.877225:0:14817:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #16 00000020:01000000:1.0:1788869530.877227:0:14817:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1788869530.877229:0:14817:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1788869530.877230:0:14817:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1788869530.877246:0:14817:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788869530.877281:0:14817:0:(obd_config.c:1561:class_process_config()) marker 16 (0x6) lustre sys.timeout 00000020:01000000:1.0:1788869530.877287:0:14817:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788869530.877291:0:14817:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788869530.877292:0:14817:0:(obd_config.c:1561:class_process_config()) marker 23 (0x1) lustre sys.timeout 00000020:00000080:1.0:1788869530.877295:0:14817:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1788869530.877297:0:14817:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1788869530.877299:0:14817:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788869530.877302:0:14817:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788869530.877304:0:14817:0:(obd_config.c:1561:class_process_config()) marker 23 (0x2) lustre sys.timeout 00000020:01000000:1.0:1788869530.877306:0:14817:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788869530.877308:0:14817:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788869530.877309:0:14817:0:(obd_config.c:1561:class_process_config()) marker 27 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1788869530.877312:0:14817:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000020:01000000:1.0:1788869530.877374:0:14817:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788869530.877378:0:14817:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788869530.877379:0:14817:0:(obd_config.c:1561:class_process_config()) marker 27 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1788869530.877383:0:14817:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 14 count 14 00000020:01000000:3.0:1788869530.877554:0:14802:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-13 (rc=0) 10000000:01000000:3.0:1788869530.877589:0:14802:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.139@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:3.0:1788869530.877617:0:14802:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.139@tcp lock: ffff94c83fde6000/0x3d2d1916761d756f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x3d2d1916761d7576 expref: -99 pid: 14802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869530.877629:0:14802:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.139@tcp lock: ffff94c83fde6000/0x3d2d1916761d756f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x3d2d1916761d7576 expref: -99 pid: 14802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788869530.877637:0:14802:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff94c8101da800 from 1 10000000:01000000:3.0:1788869530.877640:0:14802:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788869530.877680:0:14802:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.139@tcp lock: ffff94c83504c600/0x3d2d1916761d758b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869530.877689:0:14802:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.139@tcp lock: ffff94c83504c600/0x3d2d1916761d758b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869530.877700:0:14802:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.139@tcp lock: ffff94c83504c600/0x3d2d1916761d758b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788869530.877738:0:14802:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94c835a14a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cd496ea5-7761-4e68-8a6b-58e98659ad4a:14802:1875765421485184:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788869530.877819:0:14802:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869530.877863:0:14162:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765421485184 00000100:00100000:3.0:1788869530.877870:0:14162:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765421485184 00000100:00100000:3.0:1788869530.878041:0:14162:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1788869530.878050:0:14162:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c81f235450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cd496ea5-7761-4e68-8a6b-58e98659ad4a+14:14802:x1875765421485184:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788869530.878064:0:14162:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788869530.878088:0:14162:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff94c83504d600/0x3d2d1916761d7592 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x3d2d1916761d758b expref: -99 pid: 14162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869530.878117:0:14162:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff94c83504d600/0x3d2d1916761d7592 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3d2d1916761d758b expref: 15 pid: 14162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869530.878128:0:14162:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff94c83504d600/0x3d2d1916761d7592 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3d2d1916761d758b expref: 15 pid: 14162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869530.878137:0:14162:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94c83504d600, rc 0) 00000100:00100000:3.0:1788869530.878172:0:14162:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c81f235450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cd496ea5-7761-4e68-8a6b-58e98659ad4a+15:14802:x1875765421485184:12345-0@lo:101:mount.lustre.0 Request processed in 124us (353us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869530.878180:0:14162:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1788869530.878221:0:14802:0:(client.c:2702:ptlrpc_set_wait()) set ffff94c818300480 going to sleep for 11 seconds 00000100:00100000:3.0:1788869530.878244:0:14802:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94c835a14a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cd496ea5-7761-4e68-8a6b-58e98659ad4a:14802:1875765421485184:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788869530.878284:0:14802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.139@tcp lock: ffff94c83504c600/0x3d2d1916761d758b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x3d2d1916761d7592 expref: -99 pid: 14802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869530.878293:0:14802:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.139@tcp lock: ffff94c83504c600/0x3d2d1916761d758b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x3d2d1916761d7592 expref: -99 pid: 14802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788869530.878875:0:14802:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:3.0:1788869530.879880:0:14802:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788869530.880201:0:14802:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:3.0:1788869530.880354:0:14802:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 112 off8528 00000040:00080000:3.0:1788869530.880428:0:14802:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 224 off8752 00000040:00080000:3.0:1788869530.880436:0:14802:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000100:00100000:3.0:1788869530.880509:0:14802:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94c835a14a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cd496ea5-7761-4e68-8a6b-58e98659ad4a:14802:1875765421485312:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788869530.880561:0:14802:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869530.880645:0:14802:0:(client.c:2702:ptlrpc_set_wait()) set ffff94c818300480 going to sleep for 11 seconds 00000100:00100000:0.0:1788869530.883519:0:14161:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765421485312 00000100:00100000:0.0:1788869530.883531:0:14161:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765421485312 00000100:00100000:0.0:1788869530.883582:0:14161:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1788869530.883592:0:14161:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c81f234450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cd496ea5-7761-4e68-8a6b-58e98659ad4a+15:14802:x1875765421485312:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788869530.883882:0:14161:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c81f234450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cd496ea5-7761-4e68-8a6b-58e98659ad4a+15:14802:x1875765421485312:12345-0@lo:501:mount.lustre.0 Request processed in 290us (3320us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869530.883891:0:14161:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1788869530.884143:0:14802:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94c835a14a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cd496ea5-7761-4e68-8a6b-58e98659ad4a:14802:1875765421485312:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788869530.884191:0:14802:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94c835157b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cd496ea5-7761-4e68-8a6b-58e98659ad4a:14802:1875765421485440:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788869530.884234:0:14802:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869530.884293:0:14802:0:(client.c:2702:ptlrpc_set_wait()) set ffff94c80904f540 going to sleep for 11 seconds 00000100:00100000:1.0:1788869530.884347:0:14163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765421485440 00000100:00100000:1.0:1788869530.884352:0:14163:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765421485440 00000100:00100000:1.0:1788869530.884381:0:14163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1788869530.884388:0:14163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c81f234c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cd496ea5-7761-4e68-8a6b-58e98659ad4a+15:14802:x1875765421485440:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788869530.884539:0:14163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c81f234c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cd496ea5-7761-4e68-8a6b-58e98659ad4a+15:14802:x1875765421485440:12345-0@lo:503:mount.lustre.0 Request processed in 151us (305us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869530.884547:0:14163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1788869530.884708:0:14802:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94c835157b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cd496ea5-7761-4e68-8a6b-58e98659ad4a:14802:1875765421485440:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1788869530.885478:0:14802:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1788869530.885547:0:14802:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94c835157b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cd496ea5-7761-4e68-8a6b-58e98659ad4a:14802:1875765421485568:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788869530.885588:0:14802:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869530.885614:0:14802:0:(client.c:2702:ptlrpc_set_wait()) set ffff94c802c3f6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788869530.885686:0:14162:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765421485568 00000100:00100000:1.0:1788869530.885691:0:14162:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765421485568 00000100:00100000:1.0:1788869530.885740:0:14162:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1788869530.885759:0:14162:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c81f235050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cd496ea5-7761-4e68-8a6b-58e98659ad4a+15:14802:x1875765421485568:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788869530.886025:0:14162:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c81f235050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cd496ea5-7761-4e68-8a6b-58e98659ad4a+15:14802:x1875765421485568:12345-0@lo:502:mount.lustre.0 Request processed in 266us (436us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869530.886041:0:14162:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1788869530.887327:0:14802:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94c835157b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cd496ea5-7761-4e68-8a6b-58e98659ad4a:14802:1875765421485568:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788869530.887602:0:14802:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:0.0:1788869530.887651:0:14802:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 112 off8528 00000040:00080000:0.0:1788869530.887694:0:14802:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 224 off8752 00000040:00080000:0.0:1788869530.887741:0:14802:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8976 00000040:00080000:0.0:1788869530.887792:0:14802:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 112 off9088 00000040:00080000:0.0:1788869530.887838:0:14802:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 224 off9312 00000040:00080000:0.0:1788869530.887869:0:14802:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9536 00000040:00080000:0.0:1788869530.888019:0:14802:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 128 off9664 00000100:00100000:0.0:1788869530.888055:0:14802:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94c83661e300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cd496ea5-7761-4e68-8a6b-58e98659ad4a:14802:1875765421485696:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788869530.888110:0:14802:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869530.888147:0:14802:0:(client.c:2702:ptlrpc_set_wait()) set ffff94c802c3f6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788869530.888827:0:14161:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765421485696 00000100:00100000:1.0:1788869530.888834:0:14161:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765421485696 00000100:00100000:1.0:1788869530.888875:0:14161:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1788869530.888883:0:14161:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c81f237050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cd496ea5-7761-4e68-8a6b-58e98659ad4a+15:14802:x1875765421485696:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788869530.889087:0:14161:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c81f237050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cd496ea5-7761-4e68-8a6b-58e98659ad4a+15:14802:x1875765421485696:12345-0@lo:502:mount.lustre.0 Request processed in 203us (976us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869530.889095:0:14161:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1788869530.889343:0:14802:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94c83661e300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cd496ea5-7761-4e68-8a6b-58e98659ad4a:14802:1875765421485696:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788869530.889460:0:14802:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9888 00000040:00080000:0.0:1788869530.889471:0:14802:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 9 count 10 00000020:01000000:1.0:1788869530.891035:0:14821:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788869530.891046:0:14821:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788869530.891049:0:14821:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1788869530.891057:0:14821:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff94c8101da800 00000020:00000080:1.0:1788869530.891060:0:14821:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1788869530.891066:0:14821:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788869530.891069:0:14821:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788869530.891070:0:14821:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:1.0:1788869530.891072:0:14821:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788869530.891075:0:14821:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788869530.891076:0:14821:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1788869530.891079:0:14821:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff94c8101da800 00000020:00000080:1.0:1788869530.891081:0:14821:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1788869530.891140:0:14821:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788869530.891144:0:14821:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788869530.891146:0:14821:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:1.0:1788869530.891148:0:14821:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788869530.891150:0:14821:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788869530.891151:0:14821:0:(obd_config.c:1561:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1788869530.891154:0:14821:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff94c8101da800 00000020:00000080:1.0:1788869530.891156:0:14821:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1788869530.891189:0:14821:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788869530.891199:0:14821:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788869530.891201:0:14821:0:(obd_config.c:1561:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:1.0:1788869530.891203:0:14821:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 10 count 10 00000020:01000000:0.0:1788869530.891994:0:14802:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:0.0:1788869530.892019:0:14802:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.139@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788869530.892043:0:14802:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.139@tcp lock: ffff94c83504c600/0x3d2d1916761d758b lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x3d2d1916761d7592 expref: -99 pid: 14802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869530.892053:0:14802:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.139@tcp lock: ffff94c83504c600/0x3d2d1916761d758b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x3d2d1916761d7592 expref: -99 pid: 14802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788869530.892098:0:14802:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1788869530.892100:0:14802:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff94c8101da800 10000000:01000000:0.0:1788869530.892103:0:14802:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff94c8101da800 10000000:01000000:0.0:1788869530.892107:0:14802:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1788869530.892112:0:14802:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff94c8101da800 from 1 10000000:01000000:0.0:1788869530.892114:0:14802:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1788869530.892144:0:14802:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.139@tcp lock: ffff94c818d1ea00/0x3d2d1916761d7599 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869530.892151:0:14802:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.139@tcp lock: ffff94c818d1ea00/0x3d2d1916761d7599 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869530.892160:0:14802:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.139@tcp lock: ffff94c818d1ea00/0x3d2d1916761d7599 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788869530.892181:0:14802:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94c83661e300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cd496ea5-7761-4e68-8a6b-58e98659ad4a:14802:1875765421485824:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788869530.892231:0:14802:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869530.892287:0:14802:0:(client.c:2702:ptlrpc_set_wait()) set ffff94c820d66d80 going to sleep for 11 seconds 00000100:00100000:1.0:1788869530.895074:0:14163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765421485824 00000100:00100000:1.0:1788869530.895086:0:14163:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765421485824 00000100:00100000:1.0:1788869530.895152:0:14163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1788869530.895162:0:14163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c834d3b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cd496ea5-7761-4e68-8a6b-58e98659ad4a+15:14802:x1875765421485824:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788869530.895178:0:14163:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788869530.895196:0:14163:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff94c83fde7a00/0x3d2d1916761d75a0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x3d2d1916761d7599 expref: -99 pid: 14163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869530.895225:0:14163:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff94c83fde7a00/0x3d2d1916761d75a0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3d2d1916761d7599 expref: 16 pid: 14163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869530.895237:0:14163:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff94c83fde7a00/0x3d2d1916761d75a0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3d2d1916761d7599 expref: 16 pid: 14163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869530.895246:0:14163:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94c83fde7a00, rc 0) 00000100:00100000:1.0:1788869530.895331:0:14163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c834d3b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cd496ea5-7761-4e68-8a6b-58e98659ad4a+16:14802:x1875765421485824:12345-0@lo:101:mount.lustre.0 Request processed in 171us (3099us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869530.895338:0:14163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1788869530.895922:0:14802:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94c83661e300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cd496ea5-7761-4e68-8a6b-58e98659ad4a:14802:1875765421485824:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788869530.895952:0:14802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.139@tcp lock: ffff94c818d1ea00/0x3d2d1916761d7599 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x3d2d1916761d75a0 expref: -99 pid: 14802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869530.895962:0:14802:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.139@tcp lock: ffff94c818d1ea00/0x3d2d1916761d7599 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x3d2d1916761d75a0 expref: -99 pid: 14802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788869530.896646:0:14802:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 00000040:00080000:0.0:1788869530.899966:0:14802:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788869530.900240:0:14802:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:0.0:1788869530.900306:0:14802:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:0.0:1788869530.900334:0:14802:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:0.0:1788869530.900372:0:14802:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:0.0:1788869530.900413:0:14802:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:0.0:1788869530.900467:0:14802:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:0.0:1788869530.900495:0:14802:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:0.0:1788869530.900520:0:14802:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:0.0:1788869530.900556:0:14802:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:0.0:1788869530.900583:0:14802:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:0.0:1788869530.900608:0:14802:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:0.0:1788869530.900653:0:14802:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:0.0:1788869530.900683:0:14802:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:0.0:1788869530.900709:0:14802:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:0.0:1788869530.900745:0:14802:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:0.0:1788869530.900772:0:14802:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:0.0:1788869530.900798:0:14802:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:0.0:1788869530.900837:0:14802:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:0.0:1788869530.900864:0:14802:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:0.0:1788869530.900890:0:14802:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:0.0:1788869530.904002:0:14802:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:0.0:1788869530.904080:0:14802:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:0.0:1788869530.904115:0:14802:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:0.0:1788869530.904158:0:14802:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:0.0:1788869530.904198:0:14802:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 128 off12440 00000040:00080000:0.0:1788869530.904838:0:14802:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12664 00000040:00080000:0.0:1788869530.905033:0:14802:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12888 00000040:00080000:0.0:1788869530.905076:0:14802:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off12968 00000040:00080000:0.0:1788869530.905171:0:14802:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13192 00000040:00080000:0.0:1788869530.905179:0:14802:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 29 count 30 00000100:00100000:0.0:1788869530.906992:0:14802:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94c83661e300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cd496ea5-7761-4e68-8a6b-58e98659ad4a:14802:1875765421485952:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788869530.907067:0:14802:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869530.907677:0:14802:0:(client.c:2702:ptlrpc_set_wait()) set ffff94c820d66d80 going to sleep for 11 seconds 00000100:00100000:2.0:1788869530.916009:0:14162:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765421485952 00000100:00100000:2.0:1788869530.916025:0:14162:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765421485952 00000100:00100000:2.0:1788869530.917857:0:14162:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1788869530.917875:0:14162:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c834d3a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cd496ea5-7761-4e68-8a6b-58e98659ad4a+16:14802:x1875765421485952:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788869530.918211:0:14162:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c834d3a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cd496ea5-7761-4e68-8a6b-58e98659ad4a+16:14802:x1875765421485952:12345-0@lo:501:mount.lustre.0 Request processed in 343us (11143us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869530.918220:0:14162:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1788869530.923075:0:14802:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94c83661e300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cd496ea5-7761-4e68-8a6b-58e98659ad4a:14802:1875765421485952:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788869530.923140:0:14802:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94c83661e300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cd496ea5-7761-4e68-8a6b-58e98659ad4a:14802:1875765421486080:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788869530.923216:0:14802:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869530.923979:0:14802:0:(client.c:2702:ptlrpc_set_wait()) set ffff94c820d66d80 going to sleep for 11 seconds 00000100:00100000:1.0:1788869530.924113:0:14161:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765421486080 00000100:00100000:1.0:1788869530.924120:0:14161:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765421486080 00000100:00100000:1.0:1788869530.924176:0:14161:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1788869530.924185:0:14161:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c834d3b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cd496ea5-7761-4e68-8a6b-58e98659ad4a+16:14802:x1875765421486080:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788869530.931270:0:14161:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c834d3b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cd496ea5-7761-4e68-8a6b-58e98659ad4a+16:14802:x1875765421486080:12345-0@lo:503:mount.lustre.0 Request processed in 7060us (8027us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869530.931286:0:14161:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1788869530.931380:0:14802:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94c83661e300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cd496ea5-7761-4e68-8a6b-58e98659ad4a:14802:1875765421486080:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1788869530.933124:0:14802:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1788869530.933235:0:14802:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94c83661e300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cd496ea5-7761-4e68-8a6b-58e98659ad4a:14802:1875765421486208:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788869530.934041:0:14802:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869530.934087:0:14163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765421486208 00000100:00100000:0.0:1788869530.934094:0:14163:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765421486208 00000100:00100000:0.0:1788869530.935005:0:14163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1788869530.935018:0:14163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c834d3ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cd496ea5-7761-4e68-8a6b-58e98659ad4a+16:14802:x1875765421486208:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788869530.935300:0:14163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c834d3ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cd496ea5-7761-4e68-8a6b-58e98659ad4a+16:14802:x1875765421486208:12345-0@lo:502:mount.lustre.0 Request processed in 285us (1259us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869530.935319:0:14163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1788869530.943417:0:14802:0:(client.c:2702:ptlrpc_set_wait()) set ffff94c820d66d80 going to sleep for 11 seconds 00000100:00100000:2.0:1788869530.943461:0:14802:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94c83661e300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cd496ea5-7761-4e68-8a6b-58e98659ad4a:14802:1875765421486208:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788869530.943814:0:14802:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:2.0:1788869530.943878:0:14802:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:2.0:1788869530.943940:0:14802:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:2.0:1788869530.943995:0:14802:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:2.0:1788869530.944034:0:14802:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:2.0:1788869530.944082:0:14802:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:2.0:1788869530.944129:0:14802:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:2.0:1788869530.944160:0:14802:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:2.0:1788869530.944203:0:14802:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:2.0:1788869530.944240:0:14802:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:2.0:1788869530.944318:0:14802:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:2.0:1788869530.944384:0:14802:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:2.0:1788869530.944425:0:14802:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:2.0:1788869530.944463:0:14802:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:2.0:1788869530.944516:0:14802:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:2.0:1788869530.944558:0:14802:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:2.0:1788869530.944610:0:14802:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:2.0:1788869530.944673:0:14802:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:2.0:1788869530.944714:0:14802:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:2.0:1788869530.944763:0:14802:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:2.0:1788869530.944813:0:14802:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:2.0:1788869530.944850:0:14802:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:2.0:1788869530.944889:0:14802:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:2.0:1788869530.944972:0:14802:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:2.0:1788869530.945014:0:14802:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 128 off12440 00000040:00080000:2.0:1788869530.945049:0:14802:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12664 00000040:00080000:2.0:1788869530.945097:0:14802:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12888 00000040:00080000:2.0:1788869530.945131:0:14802:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off12968 00000040:00080000:2.0:1788869530.945162:0:14802:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13192 00000040:00080000:2.0:1788869530.945204:0:14802:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13416 00000040:00080000:2.0:1788869530.945241:0:14802:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13504 00000040:00080000:2.0:1788869530.945306:0:14802:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13632 00000040:00080000:2.0:1788869530.945362:0:14802:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13776 00000040:00080000:2.0:1788869530.945414:0:14802:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13904 00000040:00080000:2.0:1788869530.945450:0:14802:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14128 00000040:00080000:2.0:1788869530.945497:0:14802:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14352 00000040:00080000:2.0:1788869530.945533:0:14802:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14432 00000040:00080000:2.0:1788869530.945571:0:14802:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14656 00000040:00080000:2.0:1788869530.945634:0:14802:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14880 00000040:00080000:2.0:1788869530.945683:0:14802:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 120 off15000 00000100:00100000:2.0:1788869530.945736:0:14802:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94c835157b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cd496ea5-7761-4e68-8a6b-58e98659ad4a:14802:1875765421486336:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788869530.945813:0:14802:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869530.945859:0:14802:0:(client.c:2702:ptlrpc_set_wait()) set ffff94c807f6bc00 going to sleep for 11 seconds 00000100:00100000:3.0:1788869530.946155:0:14161:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765421486336 00000100:00100000:3.0:1788869530.946163:0:14161:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765421486336 00000100:00100000:3.0:1788869530.946216:0:14161:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1788869530.946227:0:14161:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c83e0c8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cd496ea5-7761-4e68-8a6b-58e98659ad4a+16:14802:x1875765421486336:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788869530.946507:0:14161:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c83e0c8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cd496ea5-7761-4e68-8a6b-58e98659ad4a+16:14802:x1875765421486336:12345-0@lo:502:mount.lustre.0 Request processed in 281us (693us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869530.946516:0:14161:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1788869530.946730:0:14802:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94c835157b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cd496ea5-7761-4e68-8a6b-58e98659ad4a:14802:1875765421486336:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788869530.946822:0:14802:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 224 off15224 00000040:00080000:2.0:1788869530.946834:0:14802:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 41 count 42 00000020:01000004:0.0:1788869530.948219:0:14825:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:0.0:1788869530.948473:0:14825:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff94c82ded99c0) 00000020:00000080:0.0:1788869530.948501:0:14825:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type lwp with refcount 2 00000020:01000004:0.0:1788869530.948689:0:14825:0:(tgt_mount.c:153:server_get_mount()) get mount ffff94c8101da800 from lustre-OST0000, refs=3 00000020:01000004:0.0:1788869530.948694:0:14825:0:(tgt_mount.c:187:server_put_mount()) put mount ffff94c8101da800 from lustre-OST0000, refs=3 00000020:01000004:0.0:1788869530.948697:0:14825:0:(obd_mount.c:710:lustre_put_lsi()) put ffff94c8101da800 3 00010000:00080000:0.0:1788869530.948724:0:14825:0:(ldlm_lib.c:102:import_set_conn()) imp ffff94c83cbf0800@lustre-MDT0000-lwp-OST0000: add connection 192.168.201.139@tcp at head 00010000:00010000:0.0:1788869530.954209:0:14825:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-4 is initialized 00000020:00000080:0.0:1788869530.954331:0:14825:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:0.0:1788869530.954373:0:14825:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1788869530.954387:0:14825:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0x3d2d1916761d75ae 00000100:00080000:0.0:1788869530.954399:0:14825:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1788869530.954406:0:14825:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff94c83cbf0800 using connection 192.168.201.139@tcp/0@lo 00000100:00100000:0.0:1788869530.954444:0:14825:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff94c83661fb80 x1875765421486464/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788869530.954473:0:14825:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000040:00080000:0.0:1788869530.954988:0:14825:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 42 count 42 00000100:00100000:1.0:1788869530.955181:0:3282:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94c83661fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3282:1875765421486464:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1788869530.955281:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1788869530.955340:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788869530.955353:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788869530.955356:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788869530.955359:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1788869530.955405:0:3286:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94c83c688700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3286:1875765421486592:0@lo:400:kworker.0 00000100:00100000:1.0:1788869530.955433:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869530.955470:0:14170:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765421486464 00000100:00100000:1.0:1788869530.955478:0:14170:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765421486464 00000100:00100000:1.0:1788869530.955502:0:14170:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765421486592 00000100:00100000:1.0:1788869530.955504:0:14170:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765421486592 00000100:00100000:1.0:1788869530.955527:0:14170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788869530.955535:0:14170:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c83c689180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3286:x1875765421486592:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788869530.955582:0:14170:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c83c689180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3286:x1875765421486592:12345-0@lo:400:kworker.0 Request processed in 47us (148us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869530.955589:0:14170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788869530.955603:0:14170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788869530.955607:0:14170:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c83c689500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3282:x1875765421486464:12345-0@lo:38:llog_process_th.0 00010000:00080000:1.0:1788869530.955639:0:14170:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 279 last 0 00000020:00000080:1.0:1788869530.955690:0:14170:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0x3d2d1916761d75b5 00000004:00100000:1.0:1788869530.955706:0:14170:0:(mdt_handler.c:7366:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1788869530.955739:0:14170:0:(import.c:65:import_set_state_nolock()) ffff94c81f21b800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788869530.955778:0:14170:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c83c689500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3282:x1875765421486464:12345-0@lo:38:llog_process_th.0 Request processed in 169us (497us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869530.955785:0:14170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:1.0:1788869530.955821:0:3286:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff94c83c688700 x1875765421486592/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788869546 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788869530.955848:0:3286:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94c83c688700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3286:1875765421486592:0@lo:400:kworker.0 00010000:00080000:1.0:1788869530.955876:0:3282:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff94c83661fb80 x1875765421486464/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788869540 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788869530.955884:0:3282:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1788869530.955890:0:3282:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 2 00000100:00080000:1.0:1788869530.955896:0:3282:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000020:01000000:3.0:1788869530.955961:0:14802:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:3.0:1788869530.955989:0:14802:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.139@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1788869530.956005:0:14802:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.139@tcp lock: ffff94c818d1ea00/0x3d2d1916761d7599 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x3d2d1916761d75a0 expref: -99 pid: 14802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869530.956015:0:14802:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.139@tcp lock: ffff94c818d1ea00/0x3d2d1916761d7599 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x3d2d1916761d75a0 expref: -99 pid: 14802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1788869530.956066:0:14802:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:3.0:1788869530.956068:0:14802:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1788869530.956070:0:14802:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788869530.956071:0:14802:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788869530.956076:0:14802:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788869530.956078:0:14802:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788869530.956079:0:14802:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788869530.956081:0:14802:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788869530.956082:0:14802:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1788869530.956086:0:14802:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020002 00000020:01000004:3.0:1788869530.956088:0:14802:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1788869530.956089:0:14802:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1788869530.956090:0:14802:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788869530.956091:0:14802:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788869530.956092:0:14802:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788869530.956094:0:14802:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788869530.956094:0:14802:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788869530.956095:0:14802:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788869530.956096:0:14802:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1788869530.956110:0:14802:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:3.0:1788869530.956121:0:14802:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94c835a14a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cd496ea5-7761-4e68-8a6b-58e98659ad4a:14802:1875765421486720:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1788869530.956157:0:14802:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869530.956172:0:14802:0:(client.c:2702:ptlrpc_set_wait()) set ffff94c808e29780 going to sleep for 11 seconds 00000100:00080000:1.0:1788869530.956210:0:3282:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1788869530.956213:0:3282:0:(import.c:65:import_set_state_nolock()) ffff94c83cbf0800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1788869530.956220:0:3282:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94c83661fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3282:1875765421486464:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1788869530.956309:0:14163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765421486720 00000100:00100000:0.0:1788869530.956314:0:14163:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765421486720 00000100:00100000:0.0:1788869530.956342:0:14163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1788869530.956349:0:14163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c83e0ca850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cd496ea5-7761-4e68-8a6b-58e98659ad4a+16:14802:x1875765421486720:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1788869530.956367:0:14163:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:0.0:1788869530.956379:0:14163:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:2.0:1788869530.987060:0:14163:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1788869530.987083:0:14163:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:1.0:1788869530.987296:0:14184:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1788869530.987303:0:14184:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1788869530.987334:0:14184:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff94c83fde6800/0x3d2d1916761d75bc lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869530.987360:0:14184:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff94c83504c400/0x3d2d1916761d7529 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3d2d1916761d7522 expref: 16 pid: 14162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869530.987372:0:14184:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff94c83fde6800/0x3d2d1916761d75bc lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869530.987425:0:14184:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff94c83504c400/0x3d2d1916761d7529 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x3d2d1916761d7522 expref: 16 pid: 14162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869530.987443:0:14184:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff94c83504c400/0x3d2d1916761d7529 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x3d2d1916761d7522 expref: 16 pid: 14162 timeout: 379 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788869530.987464:0:14184:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94c83c688700 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14184:1875765421486848:0@lo:104: 00000100:00100000:1.0:1788869530.987573:0:14184:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869530.987629:0:14184:0:(client.c:2702:ptlrpc_set_wait()) set ffff94c807dff840 going to sleep for 11 seconds 00000100:00100000:0.0:1788869530.987777:0:14152:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765421486848 00000100:00100000:0.0:1788869530.987787:0:14152:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765421486848 00000100:00100000:0.0:1788869530.987847:0:14152:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788869530.987858:0:14152:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c83c688000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:cd496ea5-7761-4e68-8a6b-58e98659ad4a+3:14184:x1875765421486848:12345-0@lo:104: 00010000:00010000:0.0:1788869530.987880:0:14152:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.139@tcp lock: ffff94c83fde6c00/0x3d2d1916761d7522 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x3d2d1916761d7529 expref: -99 pid: 14165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869530.987961:0:14152:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788869530.987969:0:14152:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c83c688000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:cd496ea5-7761-4e68-8a6b-58e98659ad4a+3:14184:x1875765421486848:12345-0@lo:104: Request processed in 113us (396us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869530.987978:0:14152:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00010000:0.0:1788869530.988004:0:14157:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788869530.988012:0:14157:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.139@tcp lock: ffff94c83fde6c00/0x3d2d1916761d7522 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x3d2d1916761d7529 expref: -99 pid: 14165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869530.988020:0:14157:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94c83fde6c00 already unused, calling callback (ffffffffc1ce9c20) 10000000:00010000:0.0:1788869530.988024:0:14157:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.139@tcp lock: ffff94c83fde6c00/0x3d2d1916761d7522 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x3d2d1916761d7529 expref: -99 pid: 14165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869530.988033:0:14157:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.139@tcp lock: ffff94c83fde6c00/0x3d2d1916761d7522 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x3d2d1916761d7529 expref: -99 pid: 14165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788869530.988040:0:14157:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.139@tcp lock: ffff94c83fde6c00/0x3d2d1916761d7522 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x3d2d1916761d7529 expref: -99 pid: 14165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788869530.988046:0:14157:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1788869530.988078:0:14157:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.139@tcp lock: ffff94c83fde6c00/0x3d2d1916761d7522 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3d2d1916761d7529 expref: -99 pid: 14165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869530.988085:0:14157:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788869530.988106:0:14157:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.139@tcp lock: ffff94c83fde6c00/0x3d2d1916761d7522 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3d2d1916761d7529 expref: -99 pid: 14165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869530.988113:0:14157:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.139@tcp lock: ffff94c83fde6c00/0x3d2d1916761d7522 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3d2d1916761d7529 expref: -99 pid: 14165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869530.988153:0:14157:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788869530.988155:0:14157:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788869530.988157:0:14157:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788869530.988783:0:3284:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788869530.988803:0:3284:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94c83661e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:cd496ea5-7761-4e68-8a6b-58e98659ad4a:3284:1875765421486976:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788869530.988856:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869530.988937:0:14154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765421486976 00000100:00100000:2.0:1788869530.988944:0:14154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765421486976 00010000:00010000:2.0:1788869530.988973:0:14154:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff94c83504c400/0x3d2d1916761d7529 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3d2d1916761d7522 expref: 17 pid: 14162 timeout: 379 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788869530.989004:0:14154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788869530.989012:0:14154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c835157b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cd496ea5-7761-4e68-8a6b-58e98659ad4a+17:3284:x1875765421486976:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788869530.989026:0:14154:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788869530.989032:0:14154:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff94c83504c400/0x3d2d1916761d7529 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3d2d1916761d7522 expref: 17 pid: 14162 timeout: 379 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869530.989044:0:14154:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff94c83504c400/0x3d2d1916761d7529 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x3d2d1916761d7522 expref: 17 pid: 14162 timeout: 379 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869530.989067:0:14154:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff94c83fde6800/0x3d2d1916761d75bc lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869530.989094:0:14154:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff94c83fde6800/0x3d2d1916761d75bc lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1788869530.989114:0:14154:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001811752s 00010000:00010000:2.0:1788869530.989119:0:14154:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff94c83fde6800/0x3d2d1916761d75bc lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869530.989918:0:14154:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff94c83fde6800/0x3d2d1916761d75bc lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869530.989929:0:14154:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff94c83fde6800/0x3d2d1916761d75bc lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869530.989936:0:14154:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff94c83fde6800/0x3d2d1916761d75bc lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869530.989942:0:14154:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94c83fde6800 already unused, calling callback (ffffffffc1703220) 00010000:00010000:2.0:1788869530.989947:0:14154:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff94c83fde6800/0x3d2d1916761d75bc lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869530.989957:0:14154:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff94c83fde6800/0x3d2d1916761d75bc lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869530.989970:0:14154:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff94c83fde6800/0x3d2d1916761d75bc lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869530.989984:0:14154:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788869530.990059:0:14154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c835157b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cd496ea5-7761-4e68-8a6b-58e98659ad4a+17:3284:x1875765421486976:12345-0@lo:103:ldlm_bl.0 Request processed in 1045us (1199us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869530.990069:0:14154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00010000:1.0:1788869530.990340:0:14184:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff94c83504c400/0x3d2d1916761d7529 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x3d2d1916761d7522 expref: 16 pid: 14162 timeout: 379 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788869530.990358:0:14184:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94c83c688700 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14184:1875765421486848:0@lo:104: 00010000:00010000:1.0:1788869530.990384:0:14184:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff94c83fde6800/0x3d2d1916761d75bc lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869530.990395:0:14184:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff94c83fde6800/0x3d2d1916761d75bc lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869530.990401:0:14184:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff94c83fde6800/0x3d2d1916761d75bc lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869530.990408:0:14184:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff94c83fde6800/0x3d2d1916761d75bc lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788869530.990836:0:3284:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94c83661e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:cd496ea5-7761-4e68-8a6b-58e98659ad4a:3284:1875765421486976:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788869531.040436:0:14163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c83e0ca850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cd496ea5-7761-4e68-8a6b-58e98659ad4a+15:14802:x1875765421486720:12345-0@lo:253:mount.lustre.0 Request processed in 84073us (84264us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869531.040457:0:14163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1788869531.040661:0:14802:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94c835a14a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cd496ea5-7761-4e68-8a6b-58e98659ad4a:14802:1875765421486720:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1788869531.040684:0:14802:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:3.0:1788869531.040689:0:14802:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1788869531.040691:0:14802:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1788869531.040693:0:14802:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788869531.040694:0:14802:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788869531.040695:0:14802:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788869531.040697:0:14802:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788869531.040698:0:14802:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788869531.040701:0:14802:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788869531.040703:0:14802:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:3.0:1788869531.040728:0:14802:0:(tgt_mount.c:2689:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:2.0:1788869531.060971:0:14802:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:2.0:1788869531.061160:0:14802:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:2.0:1788869531.061358:0:14802:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:2.0:1788869531.061481:0:14802:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:2.0:1788869531.061616:0:14802:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:2.0:1788869531.061833:0:14802:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:1.0:1788869531.072677:0:14802:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934592 00010000:00010000:3.0:1788869531.163603:0:14156:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00080000:0.0:1788869531.227939:0:14802:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:0.0:1788869531.227954:0:14802:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:0.0:1788869531.228000:0:14802:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1788869531.228089:0:14802:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.201.139@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1788869531.228109:0:14802:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=48 00000080:00000004:0.0:1788869531.228603:0:14802:0:(super25.c:181:lustre_fill_super()) lustre-ost1/ost1: Mount complete 00010000:00010000:0.0:1788869532.187457:0:14157:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1788869532.706950:0:14165:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1788869532.706960:0:14165:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff94c83f9d2800 from 7 10000000:01000000:2.0:1788869532.706965:0:14165:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1788869532.707027:0:14165:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.139@tcp lock: ffff94c805039c00/0x3d2d1916761d75c3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869532.707043:0:14165:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.139@tcp lock: ffff94c805039c00/0x3d2d1916761d75c3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869532.707057:0:14165:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.139@tcp lock: ffff94c805039c00/0x3d2d1916761d75c3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788869532.707103:0:14165:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94c835154700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cd496ea5-7761-4e68-8a6b-58e98659ad4a:14165:1875765421487104:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788869532.707199:0:14165:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869532.707294:0:14165:0:(client.c:2702:ptlrpc_set_wait()) set ffff94c81042e6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788869532.710190:0:14162:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765421487104 00000100:00100000:3.0:1788869532.710212:0:14162:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765421487104 00000100:00100000:3.0:1788869532.710333:0:14162:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1788869532.710347:0:14162:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c83e0c9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cd496ea5-7761-4e68-8a6b-58e98659ad4a+15:14165:x1875765421487104:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788869532.710381:0:14162:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788869532.710408:0:14162:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff94c83504c400/0x3d2d1916761d75ca lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x3d2d1916761d75c3 expref: -99 pid: 14162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869532.710444:0:14162:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff94c83504c400/0x3d2d1916761d75ca lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3d2d1916761d75c3 expref: 16 pid: 14162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869532.710457:0:14162:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff94c83504c400/0x3d2d1916761d75ca lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3d2d1916761d75c3 expref: 16 pid: 14162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869532.710467:0:14162:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94c83504c400, rc 0) 00000100:00100000:3.0:1788869532.710565:0:14162:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c83e0c9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cd496ea5-7761-4e68-8a6b-58e98659ad4a+16:14165:x1875765421487104:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 221us (3365us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869532.710573:0:14162:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1788869532.711359:0:14165:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94c835154700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cd496ea5-7761-4e68-8a6b-58e98659ad4a:14165:1875765421487104:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788869532.711386:0:14165:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.139@tcp lock: ffff94c805039c00/0x3d2d1916761d75c3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3d2d1916761d75ca expref: -99 pid: 14165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869532.711400:0:14165:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.139@tcp lock: ffff94c805039c00/0x3d2d1916761d75c3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x3d2d1916761d75ca expref: -99 pid: 14165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788869532.711502:0:14165:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94c835154700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cd496ea5-7761-4e68-8a6b-58e98659ad4a:14165:1875765421487232:0@lo:256:ll_cfg_requeue.0 00000100:00100000:2.0:1788869532.711570:0:14165:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869532.711624:0:14165:0:(client.c:2702:ptlrpc_set_wait()) set ffff94c81042e6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788869532.712374:0:14163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765421487232 00000100:00100000:2.0:1788869532.712387:0:14163:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765421487232 00000100:00100000:2.0:1788869532.712446:0:14163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1788869532.712456:0:14163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c83e0cb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cd496ea5-7761-4e68-8a6b-58e98659ad4a+16:14165:x1875765421487232:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:2.0:1788869532.712494:0:14163:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1788869532.712514:0:14163:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1788869532.712517:0:14163:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 7 00000100:00100000:2.0:1788869532.712633:0:14163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c83e0cb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cd496ea5-7761-4e68-8a6b-58e98659ad4a+16:14165:x1875765421487232:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 178us (1062us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869532.712642:0:14163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1788869532.712691:0:14165:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94c835154700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cd496ea5-7761-4e68-8a6b-58e98659ad4a:14165:1875765421487232:0@lo:256:ll_cfg_requeue.0 10000000:01000000:2.0:1788869532.712776:0:14165:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.139@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1788869532.712787:0:14165:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.139@tcp lock: ffff94c805039c00/0x3d2d1916761d75c3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3d2d1916761d75ca expref: -99 pid: 14165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869532.712797:0:14165:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.139@tcp lock: ffff94c805039c00/0x3d2d1916761d75c3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3d2d1916761d75ca expref: -99 pid: 14165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869533.211419:0:14156:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788869534.236427:0:14157:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788869535.265034:0:14156:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788869536.283500:0:14157:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1788869536.352704:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788869536.352712:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788869536.352716:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788869536.352719:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1788869536.352764:0:3284:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94c83661e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:cd496ea5-7761-4e68-8a6b-58e98659ad4a:3284:1875765421487360:0@lo:400:kworker.0 00000100:00100000:0.0:1788869536.353015:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869536.353100:0:14161:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765421487360 00000100:00100000:3.0:1788869536.353108:0:14161:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765421487360 00000100:00100000:0.0:1788869536.353162:0:3285:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94c83661c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3285:1875765421487488:0@lo:400:kworker.0 00000100:00100000:0.0:1788869536.353194:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869536.353220:0:3285:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788869536.353227:0:3285:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94c83661c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3285:1875765421487616:0@lo:400:kworker.0 00000100:00100000:3.0:1788869536.353246:0:14161:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1788869536.353282:0:14161:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c83e0cb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cd496ea5-7761-4e68-8a6b-58e98659ad4a+16:3284:x1875765421487360:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788869536.353309:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869536.353352:0:14161:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c83e0cb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cd496ea5-7761-4e68-8a6b-58e98659ad4a+16:3284:x1875765421487360:12345-0@lo:400:kworker.0 Request processed in 74us (336us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869536.353362:0:14161:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1788869536.353417:0:3284:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94c83661e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:cd496ea5-7761-4e68-8a6b-58e98659ad4a:3284:1875765421487360:0@lo:400:kworker.0 00000100:00100000:3.0:1788869536.353463:0:14170:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765421487488 00000100:00100000:3.0:1788869536.353468:0:14170:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765421487488 00000100:00100000:3.0:1788869536.353497:0:14170:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765421487616 00000100:00100000:3.0:1788869536.353501:0:14170:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765421487616 00000100:00100000:3.0:1788869536.353528:0:14170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788869536.353544:0:14170:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c83661f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3285:x1875765421487488:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788869536.353561:0:14169:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:0.0:1788869536.353570:0:14169:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:0.0:1788869536.353587:0:14168:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:3.0:1788869536.353588:0:14170:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c83661f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3285:x1875765421487488:12345-0@lo:400:kworker.0 Request processed in 45us (391us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869536.353598:0:14170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788869536.353604:0:14168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788869536.353613:0:14168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c83661dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3285:x1875765421487616:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788869536.353703:0:14168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c83661dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3285:x1875765421487616:12345-0@lo:400:kworker.0 Request processed in 91us (394us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869536.353711:0:14168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:0.0:1788869536.353745:0:3285:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff94c83661c000 x1875765421487616/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788869552 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788869536.353756:0:3285:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94c83661c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3285:1875765421487616:0@lo:400:kworker.0 00010000:00080000:0.0:1788869536.353765:0:3285:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff94c83661c380 x1875765421487488/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788869552 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788869536.353774:0:3285:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94c83661c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3285:1875765421487488:0@lo:400:kworker.0 00000100:00080000:0.0:1788869536.353825:0:14164:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000040:00080000:0.0:1788869536.994625:0:14201:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1788869537.316231:0:14156:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788869538.371561:0:14157:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788869539.167937:0:3282:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788869524/real 1788869524] req@ffff94c83c68b480 x1875765421483008/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788869539 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788869539.167986:0:3282:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff94c83c68b480 x1875765421483008/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788869539 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788869539.167997:0:3282:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788869524/real 1788869524] req@ffff94c83c68ad80 x1875765421483136/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788869539 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788869539.168009:0:3282:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff94c83c68ad80 x1875765421483136/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788869539 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788869539.168034:0:3282:0:(import.c:65:import_set_state_nolock()) ffff94c839dd5000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788869539.168066:0:3282:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1788869539.168071:0:3282:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94c83c68b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3282:1875765421483008:0@lo:8:kworker.0 00000100:00080000:3.0:1788869539.168077:0:3282:0:(import.c:65:import_set_state_nolock()) ffff94c80f9b5000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788869539.168084:0:3282:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1788869539.168086:0:3282:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94c83c68ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3282:1875765421483136:0@lo:8:kworker.0 00000100:00080000:1.0:1788869539.168594:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788869539.168600:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:1.0:1788869539.168603:0:36:0:(import.c:65:import_set_state_nolock()) ffff94c839dd5000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788869539.168609:0:36:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 272 00000100:00080000:1.0:1788869539.168616:0:36:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:1.0:1788869539.168625:0:36:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff94c839dd5000 using connection 192.168.201.139@tcp/0@lo 00000100:00100000:1.0:1788869539.168651:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff94c83c688380 x1875765421487872/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788869539.168690:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788869539.168694:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1788869539.168696:0:36:0:(import.c:65:import_set_state_nolock()) ffff94c80f9b5000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788869539.168700:0:36:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 272 00000100:00100000:2.0:1788869539.168851:0:3284:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788869539.168873:0:3284:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94c83c688700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:cd496ea5-7761-4e68-8a6b-58e98659ad4a:3284:1875765421487744:0@lo:400:kworker.0 00000100:00100000:2.0:1788869539.168972:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869539.169052:0:14162:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765421487744 00000100:00100000:2.0:1788869539.169061:0:14162:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765421487744 00000100:00100000:2.0:1788869539.169114:0:14162:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1788869539.169123:0:14162:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c83e0cac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cd496ea5-7761-4e68-8a6b-58e98659ad4a+16:3284:x1875765421487744:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788869539.169189:0:14162:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c83e0cac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cd496ea5-7761-4e68-8a6b-58e98659ad4a+16:3284:x1875765421487744:12345-0@lo:400:kworker.0 Request processed in 66us (216us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869539.169196:0:14162:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1788869539.169276:0:3284:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94c83c688700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:cd496ea5-7761-4e68-8a6b-58e98659ad4a:3284:1875765421487744:0@lo:400:kworker.0 00000100:00080000:1.0:1788869539.169330:0:36:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:1.0:1788869539.169336:0:36:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff94c80f9b5000 using connection 192.168.201.139@tcp/0@lo 00000100:00100000:1.0:1788869539.169355:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff94c83c68b800 x1875765421488000/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788869539.169420:0:3285:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94c83c688a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3285:1875765421488256:0@lo:400:kworker.0 00000100:00100000:1.0:1788869539.169463:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869539.169506:0:14170:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765421488256 00000100:00100000:1.0:1788869539.169511:0:14170:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765421488256 00000100:00100000:1.0:1788869539.169557:0:14170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788869539.169564:0:14170:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c83c689880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3285:x1875765421488256:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788869539.169616:0:14170:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c83c689880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3285:x1875765421488256:12345-0@lo:400:kworker.0 Request processed in 53us (152us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869539.169623:0:14170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00080000:1.0:1788869539.169642:0:14164:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1788869539.169667:0:3285:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff94c83c688a80 x1875765421488256/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788869555 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788869539.169678:0:3285:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94c83c688a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3285:1875765421488256:0@lo:400:kworker.0 00000100:00100000:1.0:1788869539.169697:0:3282:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94c83c688380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3282:1875765421487872:0@lo:8:kworker.0 00000100:00100000:1.0:1788869539.169877:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869539.169923:0:3284:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94c83c688e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3284:1875765421488128:0@lo:400:kworker.0 00000100:00100000:2.0:1788869539.169953:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869539.169990:0:14169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765421488128 00000100:00100000:2.0:1788869539.169994:0:14169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765421488128 00000100:00100000:2.0:1788869539.170019:0:14169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788869539.170026:0:14169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c835154700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3284:x1875765421488128:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788869539.170065:0:14169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c835154700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3284:x1875765421488128:12345-0@lo:400:kworker.0 Request processed in 40us (111us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869539.170072:0:14169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:2.0:1788869539.170097:0:3284:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff94c83c688e00 x1875765421488128/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788869555 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788869539.170107:0:3284:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94c83c688e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3284:1875765421488128:0@lo:400:kworker.0 00000100:00100000:1.0:1788869539.172532:0:3282:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94c83c68b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3282:1875765421488000:0@lo:8:kworker.0 00000100:00100000:1.0:1788869539.172862:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869539.172926:0:14805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765421487872 00000100:00100000:0.0:1788869539.172937:0:14805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765421487872 00000100:00100000:2.0:1788869539.173071:0:14806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765421488000 00000100:00100000:2.0:1788869539.173077:0:14806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765421488000 00000100:00100000:2.0:1788869539.173118:0:14806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788869539.173127:0:14806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c83c688a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3282:x1875765421487872:12345-0@lo:8:kworker.0 00010000:00080000:2.0:1788869539.173169:0:14806:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 287 last 0 00000020:00000080:2.0:1788869539.173210:0:14806:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x3d2d1916761d75d1 00002000:00100000:2.0:1788869539.173230:0:14806:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff94c83c6a5000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113718 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:2.0:1788869539.173236:0:14806:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:2.0:1788869539.177109:0:14806:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:2.0:1788869539.177742:0:14806:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1788869539.177790:0:14806:0:(import.c:65:import_set_state_nolock()) ffff94c83c6a7800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788869539.177966:0:14806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c83c688a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3282:x1875765421487872:12345-0@lo:8:kworker.0 Request processed in 4835us (8085us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869539.177978:0:14806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788869539.178012:0:14806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788869539.178019:0:14806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c83c68bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3282:x1875765421488000:12345-0@lo:8:kworker.0 00010000:00020000:2.0:1788869539.178040:0:14806:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1788869539.178074:0:14806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c83c68bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3282:x1875765421488000:12345-0@lo:8:kworker.0 Request processed in 54us (5212us total) trans 0 rc -19/-19 00000100:00100000:2.0:1788869539.178081:0:14806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1788869539.178499:0:3282:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff94c83c688380 x1875765421487872/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788869559 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788869539.178513:0:3282:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1788869539.178524:0:3282:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 2 00000100:00080000:3.0:1788869539.178536:0:3282:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:3.0:1788869539.178543:0:3282:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:3.0:1788869539.178563:0:3282:0:(import.c:65:import_set_state_nolock()) ffff94c839dd5000 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:3.0:1788869539.178597:0:3282:0:(osp_dev.c:1705:osp_import_event()) got connected 00000100:00100000:3.0:1788869539.178604:0:3282:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94c83c688380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3282:1875765421487872:0@lo:8:kworker.0 00000100:00080000:3.0:1788869539.178623:0:3282:0:(import.c:65:import_set_state_nolock()) ffff94c80f9b5000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788869539.178628:0:3282:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1788869539.178631:0:3282:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94c83c68b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3282:1875765421488000:0@lo:8:kworker.0 00000004:00080000:1.0:1788869539.178871:0:14191:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x240000400:0x5:0x0] 00000100:00100000:1.0:1788869539.178902:0:14191:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94c83c68a680 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14191:1875765421488512:0@lo:5:osp-pre-0-0.0 00000100:00100000:1.0:1788869539.178952:0:14191:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869539.178979:0:14191:0:(client.c:2702:ptlrpc_set_wait()) set ffff94c807dff600 going to sleep for 11 seconds 00000100:00100000:1.0:1788869539.178996:0:3285:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788869539.179006:0:3285:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94c83c689f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3285:1875765421488384:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788869539.179035:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:2.0:1788869539.179100:0:14190:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:2.0:1788869539.179528:0:14190:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 287471277249ns, next at 0ns, rc = 0 00000100:00100000:2.0:1788869539.179566:0:14806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765421488512 00000100:00100000:2.0:1788869539.179585:0:14806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765421488512 00000100:00100000:2.0:1788869539.179642:0:14806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788869539.179651:0:14806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c83c68a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:14191:x1875765421488512:12345-0@lo:5:osp-pre-0-0.0 00000100:00080000:1.0:1788869539.180693:0:14164:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788869539.181773:0:14807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765421488384 00000100:00100000:3.0:1788869539.181786:0:14807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765421488384 00000100:00100000:3.0:1788869539.181847:0:14807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788869539.181857:0:14807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c83c68aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3285:x1875765421488384:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788869539.181904:0:14807:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788869539.182005:0:14807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c83c68aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3285:x1875765421488384:12345-0@lo:13:osp-pre-0-0.0 Request processed in 149us (2968us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869539.182013:0:14807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00002000:00080000:2.0:1788869539.189328:0:14806:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x240000400 00002000:00080000:2.0:1788869539.189345:0:14806:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = -28 00002000:02000040:2.0:1788869539.189351:0:14806:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x240000400:6 to 0x240000400:33) 00010000:00080000:3.0:1788869539.190881:0:3285:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff94c83c689f80 x1875765421488384/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788869555 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788869539.190915:0:3285:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94c83c689f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3285:1875765421488384:0@lo:13:osp-pre-0-0.0 00002000:00010000:2.0:1788869539.210794:0:14806:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788869539.210806:0:14806:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fa07de0f/0x3d2d1916761d75d8 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869539.210824:0:14806:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x21:0x0].0x0 since=287s v=(0 0) 00010000:00010000:2.0:1788869539.210828:0:14806:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788869539.210842:0:14806:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fa07de0f/0x3d2d1916761d75d8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869539.210859:0:14806:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fa07de0f/0x3d2d1916761d75d8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869539.210872:0:14806:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fa07de0f/0x3d2d1916761d75d8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869539.210879:0:14806:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fa07de0f/0x3d2d1916761d75d8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869539.210900:0:14806:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788869539.210913:0:14156:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788869539.210919:0:14156:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fa07de0f/0x3d2d1916761d75d8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869539.210928:0:14156:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94c805039800 already unused, calling callback (ffffffffc1703220) 00010000:00010000:2.0:1788869539.210932:0:14156:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fa07de0f/0x3d2d1916761d75d8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869539.210942:0:14156:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fa07de0f/0x3d2d1916761d75d8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869539.210960:0:14156:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fa07de0f/0x3d2d1916761d75d8 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869539.210980:0:14156:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fa07de0f/0x3d2d1916761d75d8 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869539.211009:0:14156:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788869539.211011:0:14156:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788869539.211013:0:14156:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788869539.229938:0:14806:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788869539.229955:0:14806:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fa07de0f/0x3d2d1916761d75df lrc: 3/0,1 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869539.229971:0:14806:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x20:0x0].0x0 since=287s v=(0 0) 00010000:00010000:2.0:1788869539.229976:0:14806:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788869539.229983:0:14806:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fa07de0f/0x3d2d1916761d75df lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869539.230011:0:14806:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fa07de0f/0x3d2d1916761d75df lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869539.230021:0:14806:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fa07de0f/0x3d2d1916761d75df lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869539.230028:0:14806:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fa07de0f/0x3d2d1916761d75df lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869539.230053:0:14806:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788869539.230104:0:14157:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788869539.230119:0:14157:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fa07de0f/0x3d2d1916761d75df lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869539.230134:0:14157:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94c805039800 already unused, calling callback (ffffffffc1703220) 00010000:00010000:3.0:1788869539.230140:0:14157:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fa07de0f/0x3d2d1916761d75df lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869539.230153:0:14157:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fa07de0f/0x3d2d1916761d75df lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869539.230190:0:14157:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fa07de0f/0x3d2d1916761d75df lrc: 1/0,0 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869539.230199:0:14157:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fa07de0f/0x3d2d1916761d75df lrc: 0/0,0 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869539.230223:0:14157:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788869539.230225:0:14157:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788869539.230227:0:14157:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788869539.232842:0:14806:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788869539.232863:0:14806:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001638e2b2/0x3d2d1916761d75e6 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869539.232881:0:14806:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1f:0x0].0x0 since=287s v=(0 0) 00010000:00010000:2.0:1788869539.232887:0:14806:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788869539.232896:0:14806:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001638e2b2/0x3d2d1916761d75e6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869539.232914:0:14806:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001638e2b2/0x3d2d1916761d75e6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869539.232925:0:14806:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001638e2b2/0x3d2d1916761d75e6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869539.232934:0:14806:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001638e2b2/0x3d2d1916761d75e6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869539.232970:0:14806:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788869539.232988:0:14156:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00002000:00010000:3.0:1788869539.236150:0:14806:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788869539.236168:0:14806:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fb48b48d/0x3d2d1916761d75ed lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869539.236189:0:14806:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1e:0x0].0x0 since=287s v=(0 0) 00010000:00010000:3.0:1788869539.236194:0:14806:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788869539.236202:0:14806:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fb48b48d/0x3d2d1916761d75ed lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869539.236219:0:14806:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fb48b48d/0x3d2d1916761d75ed lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869539.236230:0:14806:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fb48b48d/0x3d2d1916761d75ed lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869539.236239:0:14806:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fb48b48d/0x3d2d1916761d75ed lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869539.236302:0:14806:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788869539.236318:0:14157:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00002000:00010000:3.0:1788869539.236849:0:14806:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788869539.236856:0:14806:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000075e1b7c5/0x3d2d1916761d75f4 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869539.236866:0:14806:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1d:0x0].0x0 since=287s v=(0 0) 00010000:00010000:3.0:1788869539.236869:0:14806:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788869539.236873:0:14806:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000075e1b7c5/0x3d2d1916761d75f4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869539.236884:0:14806:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000075e1b7c5/0x3d2d1916761d75f4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869539.236893:0:14806:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000075e1b7c5/0x3d2d1916761d75f4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869539.236901:0:14806:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000075e1b7c5/0x3d2d1916761d75f4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869539.236910:0:14806:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788869539.238488:0:14156:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001638e2b2/0x3d2d1916761d75e6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869539.238515:0:14156:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94c805038000 already unused, calling callback (ffffffffc1703220) 00010000:00010000:2.0:1788869539.238530:0:14156:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001638e2b2/0x3d2d1916761d75e6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869539.238543:0:14156:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001638e2b2/0x3d2d1916761d75e6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869539.238588:0:14156:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001638e2b2/0x3d2d1916761d75e6 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869539.238596:0:14156:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001638e2b2/0x3d2d1916761d75e6 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788869539.238797:0:14806:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788869539.238808:0:14806:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000021c907ec/0x3d2d1916761d75fb lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869539.238824:0:14806:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1c:0x0].0x0 since=287s v=(0 0) 00010000:00010000:2.0:1788869539.238828:0:14156:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788869539.238836:0:14156:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000075e1b7c5/0x3d2d1916761d75f4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869539.238840:0:14806:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788869539.238857:0:14156:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94c83504d000 already unused, calling callback (ffffffffc1703220) 00010000:00010000:3.0:1788869539.238859:0:14806:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000021c907ec/0x3d2d1916761d75fb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869539.238864:0:14156:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000075e1b7c5/0x3d2d1916761d75f4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869539.238894:0:14156:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000075e1b7c5/0x3d2d1916761d75f4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869539.238895:0:14806:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000021c907ec/0x3d2d1916761d75fb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869539.238935:0:14806:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000021c907ec/0x3d2d1916761d75fb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869539.238940:0:14156:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000075e1b7c5/0x3d2d1916761d75f4 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869539.238952:0:14806:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000021c907ec/0x3d2d1916761d75fb lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869539.238957:0:14156:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000075e1b7c5/0x3d2d1916761d75f4 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869539.238986:0:14806:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788869539.239075:0:14156:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788869539.239080:0:14156:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000021c907ec/0x3d2d1916761d75fb lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869539.239094:0:14156:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94c83504de00 already unused, calling callback (ffffffffc1703220) 00010000:00010000:2.0:1788869539.239097:0:14156:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000021c907ec/0x3d2d1916761d75fb lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869539.239106:0:14156:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000021c907ec/0x3d2d1916761d75fb lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869539.239117:0:14156:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000021c907ec/0x3d2d1916761d75fb lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869539.239125:0:14156:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000021c907ec/0x3d2d1916761d75fb lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869539.239203:0:14156:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788869539.239208:0:14156:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788869539.239211:0:14156:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788869539.241274:0:15140:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788869539.241281:0:15140:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788869539.241284:0:15140:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:1.0:1788869539.241830:0:5777:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00002000:00010000:3.0:1788869539.243599:0:14806:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788869539.243617:0:14806:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a90cffa0/0x3d2d1916761d7602 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869539.243640:0:14806:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1b:0x0].0x0 since=287s v=(0 0) 00010000:00010000:3.0:1788869539.243647:0:14806:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788869539.243655:0:14806:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a90cffa0/0x3d2d1916761d7602 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869539.243673:0:14806:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a90cffa0/0x3d2d1916761d7602 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869539.243700:0:14806:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a90cffa0/0x3d2d1916761d7602 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869539.243709:0:14806:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a90cffa0/0x3d2d1916761d7602 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869539.245679:0:14157:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fb48b48d/0x3d2d1916761d75ed lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869539.245701:0:14157:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94c83504c000 already unused, calling callback (ffffffffc1703220) 00010000:00010000:2.0:1788869539.245706:0:14157:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fb48b48d/0x3d2d1916761d75ed lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869539.245719:0:14157:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fb48b48d/0x3d2d1916761d75ed lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869539.245780:0:14157:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fb48b48d/0x3d2d1916761d75ed lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869539.245788:0:14157:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fb48b48d/0x3d2d1916761d75ed lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869539.245804:0:14806:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788869539.245823:0:14157:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788869539.245830:0:14157:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a90cffa0/0x3d2d1916761d7602 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869539.245837:0:14157:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94c83504da00 already unused, calling callback (ffffffffc1703220) 00010000:00010000:2.0:1788869539.245841:0:14157:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a90cffa0/0x3d2d1916761d7602 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869539.245851:0:14157:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a90cffa0/0x3d2d1916761d7602 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869539.245863:0:14157:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a90cffa0/0x3d2d1916761d7602 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869539.245871:0:14157:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a90cffa0/0x3d2d1916761d7602 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869539.245891:0:14157:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788869539.245893:0:14157:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788869539.246582:0:14806:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788869539.246593:0:14806:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a947f004/0x3d2d1916761d7609 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869539.246610:0:14806:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1a:0x0].0x0 since=287s v=(0 0) 00010000:00010000:3.0:1788869539.246615:0:14806:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788869539.246622:0:14806:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a947f004/0x3d2d1916761d7609 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869539.246638:0:14806:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a947f004/0x3d2d1916761d7609 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869539.246648:0:14806:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a947f004/0x3d2d1916761d7609 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869539.246656:0:14806:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a947f004/0x3d2d1916761d7609 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869539.249664:0:14156:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788869539.249684:0:14156:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a947f004/0x3d2d1916761d7609 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869539.249702:0:14156:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94c83504dc00 already unused, calling callback (ffffffffc1703220) 00010000:00010000:0.0:1788869539.249708:0:14156:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a947f004/0x3d2d1916761d7609 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869539.249747:0:14156:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a947f004/0x3d2d1916761d7609 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869539.249782:0:14156:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a947f004/0x3d2d1916761d7609 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869539.251620:0:14156:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788869539.251629:0:14156:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788869539.251634:0:14156:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788869539.253368:0:14157:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788869539.255506:0:14806:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1788869539.255529:0:14806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a947f004/0x3d2d1916761d7609 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869539.256086:0:15140:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788869539.256754:0:14806:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788869539.256766:0:14806:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fc3e9826/0x3d2d1916761d7610 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869539.256785:0:14806:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x19:0x0].0x0 since=287s v=(0 0) 00010000:00010000:3.0:1788869539.256790:0:14806:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788869539.256799:0:14806:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fc3e9826/0x3d2d1916761d7610 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869539.256814:0:14806:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fc3e9826/0x3d2d1916761d7610 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869539.256824:0:14806:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fc3e9826/0x3d2d1916761d7610 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869539.256832:0:14806:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fc3e9826/0x3d2d1916761d7610 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869539.256894:0:14806:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1788869539.257481:0:14806:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788869539.257489:0:14806:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001f1f776a/0x3d2d1916761d7617 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869539.257507:0:14806:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x18:0x0].0x0 since=287s v=(0 0) 00010000:00010000:3.0:1788869539.257511:0:14806:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788869539.257515:0:14806:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001f1f776a/0x3d2d1916761d7617 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869539.257526:0:14806:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001f1f776a/0x3d2d1916761d7617 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869539.257535:0:14806:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001f1f776a/0x3d2d1916761d7617 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869539.257543:0:14806:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001f1f776a/0x3d2d1916761d7617 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869539.259492:0:14156:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788869539.259511:0:14156:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fc3e9826/0x3d2d1916761d7610 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869539.259527:0:14156:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94c83504d200 already unused, calling callback (ffffffffc1703220) 00010000:00010000:0.0:1788869539.259533:0:14156:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fc3e9826/0x3d2d1916761d7610 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869539.259546:0:14156:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fc3e9826/0x3d2d1916761d7610 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869539.259570:0:14156:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fc3e9826/0x3d2d1916761d7610 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869539.259579:0:14156:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fc3e9826/0x3d2d1916761d7610 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869539.259623:0:14156:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788869539.259626:0:14156:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001f1f776a/0x3d2d1916761d7617 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869539.259633:0:14156:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94c83504cc00 already unused, calling callback (ffffffffc1703220) 00010000:00010000:0.0:1788869539.259636:0:14156:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001f1f776a/0x3d2d1916761d7617 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869539.259644:0:14156:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001f1f776a/0x3d2d1916761d7617 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869539.259654:0:14156:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001f1f776a/0x3d2d1916761d7617 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869539.259673:0:14156:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788869539.259675:0:14156:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788869539.259677:0:14156:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788869539.268269:0:14806:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1788869539.268290:0:14806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001f1f776a/0x3d2d1916761d7617 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788869539.269133:0:14806:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788869539.269144:0:14806:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008b0be560/0x3d2d1916761d761e lrc: 3/0,1 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869539.269163:0:14806:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17:0x0].0x0 since=287s v=(0 0) 00010000:00010000:3.0:1788869539.269169:0:14806:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788869539.269177:0:14806:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008b0be560/0x3d2d1916761d761e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869539.269208:0:14806:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008b0be560/0x3d2d1916761d761e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869539.269221:0:14806:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008b0be560/0x3d2d1916761d761e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869539.269230:0:14806:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008b0be560/0x3d2d1916761d761e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869539.269289:0:14806:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1788869539.269708:0:14806:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788869539.269714:0:14806:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000996abe03/0x3d2d1916761d7625 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869539.269722:0:14806:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x16:0x0].0x0 since=287s v=(0 0) 00010000:00010000:3.0:1788869539.269738:0:14806:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788869539.269743:0:14806:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000996abe03/0x3d2d1916761d7625 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869539.269752:0:14806:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000996abe03/0x3d2d1916761d7625 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869539.269760:0:14806:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000996abe03/0x3d2d1916761d7625 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869539.269778:0:14806:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000996abe03/0x3d2d1916761d7625 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869539.269793:0:14806:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:3.0:1788869539.270191:0:14806:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788869539.270198:0:14806:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006c3853f7/0x3d2d1916761d762c lrc: 3/0,1 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869539.270207:0:14806:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x15:0x0].0x0 since=287s v=(0 0) 00010000:00010000:3.0:1788869539.270211:0:14806:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788869539.270215:0:14806:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006c3853f7/0x3d2d1916761d762c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869539.270224:0:14806:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006c3853f7/0x3d2d1916761d762c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869539.270233:0:14806:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006c3853f7/0x3d2d1916761d762c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869539.270239:0:14806:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006c3853f7/0x3d2d1916761d762c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869539.270277:0:14806:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00002000:00010000:3.0:1788869539.270657:0:14806:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788869539.270664:0:14806:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009e7de17b/0x3d2d1916761d7633 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869539.270677:0:14806:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=287s v=(0 0) 00010000:00010000:3.0:1788869539.270681:0:14806:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788869539.270685:0:14806:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009e7de17b/0x3d2d1916761d7633 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869539.270695:0:14806:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009e7de17b/0x3d2d1916761d7633 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869539.270704:0:14806:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009e7de17b/0x3d2d1916761d7633 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869539.270712:0:14806:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009e7de17b/0x3d2d1916761d7633 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869539.270720:0:14806:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00002000:00010000:3.0:1788869539.271099:0:14806:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788869539.271104:0:14806:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003aff45d0/0x3d2d1916761d763a lrc: 3/0,1 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869539.271111:0:14806:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x13:0x0].0x0 since=287s v=(0 0) 00010000:00010000:3.0:1788869539.271114:0:14806:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788869539.271118:0:14806:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003aff45d0/0x3d2d1916761d763a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869539.271126:0:14806:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003aff45d0/0x3d2d1916761d763a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869539.271144:0:14806:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003aff45d0/0x3d2d1916761d763a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869539.271150:0:14806:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003aff45d0/0x3d2d1916761d763a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869539.271158:0:14806:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to regular blp list, 5 blwis in pool 00010000:00010000:0.0:1788869539.272872:0:15140:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:0.0:1788869539.272888:0:15140:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008b0be560/0x3d2d1916761d761e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869539.272903:0:15140:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94c83504c800 already unused, calling callback (ffffffffc1703220) 00010000:00010000:0.0:1788869539.272909:0:15140:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008b0be560/0x3d2d1916761d761e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869539.272947:0:15140:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008b0be560/0x3d2d1916761d761e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869539.272974:0:15140:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008b0be560/0x3d2d1916761d761e lrc: 1/0,0 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869539.272983:0:15140:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008b0be560/0x3d2d1916761d761e lrc: 0/0,0 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869539.273024:0:15140:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:0.0:1788869539.273029:0:15140:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000996abe03/0x3d2d1916761d7625 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869539.273036:0:15140:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94c800030200 already unused, calling callback (ffffffffc1703220) 00010000:00010000:0.0:1788869539.273039:0:15140:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000996abe03/0x3d2d1916761d7625 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869539.273047:0:15140:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000996abe03/0x3d2d1916761d7625 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869539.273057:0:15140:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000996abe03/0x3d2d1916761d7625 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869539.273065:0:15140:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000996abe03/0x3d2d1916761d7625 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869539.273091:0:15140:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1788869539.273094:0:15140:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006c3853f7/0x3d2d1916761d762c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869539.273101:0:15140:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94c800031400 already unused, calling callback (ffffffffc1703220) 00010000:00010000:0.0:1788869539.273104:0:15140:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006c3853f7/0x3d2d1916761d762c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869539.273112:0:15140:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006c3853f7/0x3d2d1916761d762c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869539.273121:0:15140:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006c3853f7/0x3d2d1916761d762c lrc: 1/0,0 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869539.273128:0:15140:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006c3853f7/0x3d2d1916761d762c lrc: 0/0,0 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869539.273140:0:15140:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788869539.273145:0:15140:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009e7de17b/0x3d2d1916761d7633 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869539.273151:0:15140:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94c800031000 already unused, calling callback (ffffffffc1703220) 00010000:00010000:0.0:1788869539.273154:0:15140:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009e7de17b/0x3d2d1916761d7633 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869539.273172:0:15140:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009e7de17b/0x3d2d1916761d7633 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869539.273183:0:15140:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009e7de17b/0x3d2d1916761d7633 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869539.273190:0:15140:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009e7de17b/0x3d2d1916761d7633 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869539.273203:0:15140:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788869539.273207:0:15140:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003aff45d0/0x3d2d1916761d763a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869539.273214:0:15140:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94c800030c00 already unused, calling callback (ffffffffc1703220) 00010000:00010000:0.0:1788869539.273217:0:15140:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003aff45d0/0x3d2d1916761d763a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869539.273226:0:15140:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003aff45d0/0x3d2d1916761d763a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869539.273236:0:15140:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003aff45d0/0x3d2d1916761d763a lrc: 1/0,0 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869539.273243:0:15140:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003aff45d0/0x3d2d1916761d763a lrc: 0/0,0 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869539.273288:0:15140:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788869539.273290:0:15140:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788869539.273292:0:15140:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788869539.273302:0:14156:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788869539.273471:0:14157:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788869539.282824:0:14806:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788869539.282841:0:14806:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c7420936/0x3d2d1916761d7641 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869539.282862:0:14806:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x12:0x0].0x0 since=287s v=(0 0) 00010000:00010000:2.0:1788869539.282868:0:14806:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788869539.282877:0:14806:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c7420936/0x3d2d1916761d7641 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869539.282895:0:14806:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c7420936/0x3d2d1916761d7641 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869539.282908:0:14806:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c7420936/0x3d2d1916761d7641 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869539.282918:0:14806:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c7420936/0x3d2d1916761d7641 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869539.282945:0:14806:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1788869539.283486:0:14806:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788869539.283495:0:14806:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e2b6a638/0x3d2d1916761d7648 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869539.283506:0:14806:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=287s v=(0 0) 00010000:00010000:2.0:1788869539.283510:0:14806:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788869539.283523:0:14806:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e2b6a638/0x3d2d1916761d7648 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869539.283535:0:14806:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e2b6a638/0x3d2d1916761d7648 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869539.283544:0:14806:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e2b6a638/0x3d2d1916761d7648 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869539.283552:0:14806:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e2b6a638/0x3d2d1916761d7648 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869539.283578:0:14806:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:2.0:1788869539.284004:0:14806:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788869539.284010:0:14806:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a4c3e783/0x3d2d1916761d764f lrc: 3/0,1 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869539.284019:0:14806:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x10:0x0].0x0 since=287s v=(0 0) 00010000:00010000:2.0:1788869539.284022:0:14806:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788869539.284027:0:14806:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a4c3e783/0x3d2d1916761d764f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869539.284038:0:14806:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a4c3e783/0x3d2d1916761d764f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869539.284045:0:14806:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a4c3e783/0x3d2d1916761d764f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869539.284063:0:14806:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a4c3e783/0x3d2d1916761d764f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869539.284087:0:14806:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:2.0:1788869539.284109:0:14157:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1788869539.284117:0:14157:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c7420936/0x3d2d1916761d7641 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869539.284126:0:14157:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94c805038200 already unused, calling callback (ffffffffc1703220) 00010000:00010000:2.0:1788869539.284131:0:14157:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c7420936/0x3d2d1916761d7641 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869539.284141:0:14157:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c7420936/0x3d2d1916761d7641 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869539.284162:0:14157:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c7420936/0x3d2d1916761d7641 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869539.284170:0:14157:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c7420936/0x3d2d1916761d7641 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869539.284190:0:14157:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788869539.284194:0:14157:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e2b6a638/0x3d2d1916761d7648 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869539.284213:0:14157:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94c805038400 already unused, calling callback (ffffffffc1703220) 00010000:00010000:2.0:1788869539.284216:0:14157:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e2b6a638/0x3d2d1916761d7648 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869539.284224:0:14157:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e2b6a638/0x3d2d1916761d7648 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869539.284236:0:14157:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e2b6a638/0x3d2d1916761d7648 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869539.284243:0:14157:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e2b6a638/0x3d2d1916761d7648 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869539.284286:0:14157:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788869539.284290:0:14157:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a4c3e783/0x3d2d1916761d764f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869539.284297:0:14157:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94c805039a00 already unused, calling callback (ffffffffc1703220) 00010000:00010000:2.0:1788869539.284301:0:14157:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a4c3e783/0x3d2d1916761d764f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869539.284309:0:14157:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a4c3e783/0x3d2d1916761d764f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869539.284318:0:14157:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a4c3e783/0x3d2d1916761d764f lrc: 1/0,0 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869539.284331:0:14157:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a4c3e783/0x3d2d1916761d764f lrc: 0/0,0 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869539.284345:0:14157:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788869539.284347:0:14157:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788869539.284349:0:14157:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788869539.284833:0:14806:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788869539.284840:0:14806:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000052cb237f/0x3d2d1916761d7656 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869539.284850:0:14806:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xf:0x0].0x0 since=287s v=(0 0) 00010000:00010000:2.0:1788869539.284854:0:14806:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788869539.284859:0:14806:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000052cb237f/0x3d2d1916761d7656 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869539.284870:0:14806:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000052cb237f/0x3d2d1916761d7656 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869539.284879:0:14806:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000052cb237f/0x3d2d1916761d7656 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869539.284887:0:14806:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000052cb237f/0x3d2d1916761d7656 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869539.284906:0:14806:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788869539.284916:0:14157:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788869539.284926:0:14157:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000052cb237f/0x3d2d1916761d7656 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869539.284934:0:14157:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94c805038600 already unused, calling callback (ffffffffc1703220) 00010000:00010000:2.0:1788869539.284938:0:14157:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000052cb237f/0x3d2d1916761d7656 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869539.284946:0:14157:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000052cb237f/0x3d2d1916761d7656 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869539.284958:0:14157:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000052cb237f/0x3d2d1916761d7656 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869539.284966:0:14157:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000052cb237f/0x3d2d1916761d7656 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869539.284980:0:14157:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788869539.284982:0:14157:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788869539.284983:0:14157:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788869539.285432:0:14806:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788869539.285438:0:14806:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f4378d24/0x3d2d1916761d765d lrc: 3/0,1 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869539.285449:0:14806:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=287s v=(0 0) 00010000:00010000:2.0:1788869539.285452:0:14806:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788869539.285457:0:14806:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f4378d24/0x3d2d1916761d765d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869539.285479:0:14806:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f4378d24/0x3d2d1916761d765d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869539.285488:0:14806:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f4378d24/0x3d2d1916761d765d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869539.285496:0:14806:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f4378d24/0x3d2d1916761d765d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869539.285512:0:14806:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788869539.285520:0:14157:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788869539.285524:0:14157:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f4378d24/0x3d2d1916761d765d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869539.285531:0:14157:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94c805038a00 already unused, calling callback (ffffffffc1703220) 00010000:00010000:2.0:1788869539.285535:0:14157:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f4378d24/0x3d2d1916761d765d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869539.285543:0:14157:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f4378d24/0x3d2d1916761d765d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869539.285554:0:14157:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f4378d24/0x3d2d1916761d765d lrc: 1/0,0 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869539.285562:0:14157:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f4378d24/0x3d2d1916761d765d lrc: 0/0,0 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869539.285581:0:14157:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788869539.285583:0:14157:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788869539.285585:0:14157:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788869539.285832:0:15140:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788869539.289896:0:14156:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788869539.295370:0:14806:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788869539.295388:0:14806:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001638e2b2/0x3d2d1916761d7664 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869539.295410:0:14806:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=287s v=(0 0) 00010000:00010000:2.0:1788869539.295416:0:14806:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788869539.295424:0:14806:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001638e2b2/0x3d2d1916761d7664 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869539.295442:0:14806:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001638e2b2/0x3d2d1916761d7664 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869539.295454:0:14806:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001638e2b2/0x3d2d1916761d7664 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869539.295463:0:14806:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001638e2b2/0x3d2d1916761d7664 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869539.295494:0:14806:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1788869539.297937:0:14806:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788869539.297958:0:14806:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a1bb1fc7/0x3d2d1916761d766b lrc: 3/0,1 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869539.297991:0:14806:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc:0x0].0x0 since=287s v=(0 0) 00010000:00010000:2.0:1788869539.297996:0:14806:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788869539.298004:0:14806:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a1bb1fc7/0x3d2d1916761d766b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869539.298020:0:14806:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a1bb1fc7/0x3d2d1916761d766b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869539.298031:0:14806:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a1bb1fc7/0x3d2d1916761d766b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869539.298038:0:14806:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a1bb1fc7/0x3d2d1916761d766b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869539.298068:0:14806:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:2.0:1788869539.298748:0:14806:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788869539.298755:0:14806:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000674b1d3a/0x3d2d1916761d7672 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869539.298765:0:14806:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=287s v=(0 0) 00010000:00010000:2.0:1788869539.298769:0:14806:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788869539.298773:0:14806:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000674b1d3a/0x3d2d1916761d7672 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869539.298785:0:14806:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000674b1d3a/0x3d2d1916761d7672 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869539.298804:0:14806:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000674b1d3a/0x3d2d1916761d7672 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869539.298811:0:14806:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000674b1d3a/0x3d2d1916761d7672 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869539.298832:0:14806:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00002000:00010000:2.0:1788869539.299290:0:14806:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788869539.299297:0:14806:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a046f8e3/0x3d2d1916761d7679 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869539.299306:0:14806:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=287s v=(0 0) 00010000:00010000:2.0:1788869539.299309:0:14806:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788869539.299314:0:14806:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a046f8e3/0x3d2d1916761d7679 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869539.299324:0:14806:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a046f8e3/0x3d2d1916761d7679 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869539.299332:0:14806:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a046f8e3/0x3d2d1916761d7679 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869539.299339:0:14806:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a046f8e3/0x3d2d1916761d7679 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869539.299359:0:14806:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00010000:00010000:0.0:1788869539.300084:0:14157:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:0.0:1788869539.300095:0:14157:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001638e2b2/0x3d2d1916761d7664 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869539.300106:0:14157:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94c805038000 already unused, calling callback (ffffffffc1703220) 00010000:00010000:0.0:1788869539.300112:0:14157:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001638e2b2/0x3d2d1916761d7664 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869539.300122:0:14157:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001638e2b2/0x3d2d1916761d7664 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869539.300144:0:14157:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001638e2b2/0x3d2d1916761d7664 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869539.300152:0:14157:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001638e2b2/0x3d2d1916761d7664 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869539.300173:0:14157:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1788869539.300177:0:14157:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a1bb1fc7/0x3d2d1916761d766b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869539.300197:0:14157:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94c805039600 already unused, calling callback (ffffffffc1703220) 00010000:00010000:0.0:1788869539.300200:0:14157:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a1bb1fc7/0x3d2d1916761d766b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869539.300208:0:14157:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a1bb1fc7/0x3d2d1916761d766b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869539.300218:0:14157:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a1bb1fc7/0x3d2d1916761d766b lrc: 1/0,0 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869539.300225:0:14157:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a1bb1fc7/0x3d2d1916761d766b lrc: 0/0,0 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869539.300239:0:14157:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788869539.300243:0:14157:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000674b1d3a/0x3d2d1916761d7672 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869539.300274:0:14157:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94c805039400 already unused, calling callback (ffffffffc1703220) 00010000:00010000:0.0:1788869539.300278:0:14157:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000674b1d3a/0x3d2d1916761d7672 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869539.300285:0:14157:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000674b1d3a/0x3d2d1916761d7672 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869539.300295:0:14157:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000674b1d3a/0x3d2d1916761d7672 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869539.300308:0:14157:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000674b1d3a/0x3d2d1916761d7672 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869539.300321:0:14157:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788869539.300324:0:14157:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a046f8e3/0x3d2d1916761d7679 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869539.300331:0:14157:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94c805039000 already unused, calling callback (ffffffffc1703220) 00010000:00010000:0.0:1788869539.300335:0:14157:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a046f8e3/0x3d2d1916761d7679 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869539.300343:0:14157:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a046f8e3/0x3d2d1916761d7679 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869539.300352:0:14157:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a046f8e3/0x3d2d1916761d7679 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869539.300360:0:14157:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a046f8e3/0x3d2d1916761d7679 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869539.300371:0:14157:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788869539.300373:0:14157:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788869539.300375:0:14157:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788869539.300532:0:15140:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788869539.304740:0:14156:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788869539.304860:0:14806:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788869539.304871:0:14806:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f4378d24/0x3d2d1916761d7680 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869539.304893:0:14806:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x9:0x0].0x0 since=287s v=(0 0) 00010000:00010000:2.0:1788869539.304897:0:14806:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788869539.304904:0:14806:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f4378d24/0x3d2d1916761d7680 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869539.304920:0:14806:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f4378d24/0x3d2d1916761d7680 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869539.304932:0:14806:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f4378d24/0x3d2d1916761d7680 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869539.304940:0:14806:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f4378d24/0x3d2d1916761d7680 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869539.304958:0:14806:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1788869539.305700:0:14806:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788869539.305709:0:14806:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000052cb237f/0x3d2d1916761d7687 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869539.305733:0:14806:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=287s v=(0 0) 00010000:00010000:2.0:1788869539.305745:0:14806:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788869539.305750:0:14806:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000052cb237f/0x3d2d1916761d7687 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869539.305762:0:14806:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000052cb237f/0x3d2d1916761d7687 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869539.305770:0:14806:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000052cb237f/0x3d2d1916761d7687 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869539.305777:0:14806:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000052cb237f/0x3d2d1916761d7687 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869539.305801:0:14806:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:2.0:1788869539.306209:0:14806:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788869539.306215:0:14806:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a4c3e783/0x3d2d1916761d768e lrc: 3/0,1 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869539.306225:0:14806:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=287s v=(0 0) 00010000:00010000:2.0:1788869539.306228:0:14806:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788869539.306232:0:14806:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a4c3e783/0x3d2d1916761d768e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869539.306241:0:14806:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a4c3e783/0x3d2d1916761d768e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869539.306276:0:14806:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a4c3e783/0x3d2d1916761d768e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869539.306291:0:14806:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a4c3e783/0x3d2d1916761d768e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869539.306305:0:14806:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00002000:00010000:2.0:1788869539.306720:0:14806:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788869539.306738:0:14806:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e2b6a638/0x3d2d1916761d7695 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869539.306746:0:14806:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=287s v=(0 0) 00010000:00010000:2.0:1788869539.306749:0:14806:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788869539.306754:0:14806:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e2b6a638/0x3d2d1916761d7695 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869539.306764:0:14806:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e2b6a638/0x3d2d1916761d7695 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869539.306772:0:14806:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e2b6a638/0x3d2d1916761d7695 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869539.306779:0:14806:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e2b6a638/0x3d2d1916761d7695 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869539.306788:0:14806:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00002000:00080000:2.0:1788869539.306970:0:14806:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0000: after destroy: set last_id to 0x240000400:5 00000100:00100000:2.0:1788869539.307104:0:14806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c83c68a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:14191:x1875765421488512:12345-0@lo:5:osp-pre-0-0.0 Request processed in 127449us (128146us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869539.307122:0:14806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00010000:2.0:1788869539.307171:0:15140:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:2.0:1788869539.307178:0:15140:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f4378d24/0x3d2d1916761d7680 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869539.307187:0:15140:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94c805038a00 already unused, calling callback (ffffffffc1703220) 00010000:00010000:2.0:1788869539.307192:0:15140:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f4378d24/0x3d2d1916761d7680 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869539.307202:0:15140:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f4378d24/0x3d2d1916761d7680 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869539.307220:0:15140:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f4378d24/0x3d2d1916761d7680 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869539.307228:0:15140:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f4378d24/0x3d2d1916761d7680 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869539.307247:0:15140:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1788869539.307272:0:15140:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000052cb237f/0x3d2d1916761d7687 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869539.307279:0:15140:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94c805038600 already unused, calling callback (ffffffffc1703220) 00010000:00010000:2.0:1788869539.307283:0:15140:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000052cb237f/0x3d2d1916761d7687 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869539.307302:0:15140:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000052cb237f/0x3d2d1916761d7687 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869539.307313:0:15140:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000052cb237f/0x3d2d1916761d7687 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869539.307320:0:15140:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000052cb237f/0x3d2d1916761d7687 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869539.307332:0:15140:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788869539.307336:0:15140:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a4c3e783/0x3d2d1916761d768e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869539.307342:0:15140:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94c805039a00 already unused, calling callback (ffffffffc1703220) 00010000:00010000:2.0:1788869539.307346:0:15140:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a4c3e783/0x3d2d1916761d768e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869539.307353:0:15140:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a4c3e783/0x3d2d1916761d768e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869539.307362:0:15140:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a4c3e783/0x3d2d1916761d768e lrc: 1/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869539.307369:0:15140:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a4c3e783/0x3d2d1916761d768e lrc: 0/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869539.307393:0:15140:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788869539.307397:0:15140:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e2b6a638/0x3d2d1916761d7695 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869539.307403:0:15140:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94c805038400 already unused, calling callback (ffffffffc1703220) 00010000:00010000:2.0:1788869539.307407:0:15140:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e2b6a638/0x3d2d1916761d7695 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869539.307414:0:15140:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e2b6a638/0x3d2d1916761d7695 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869539.307424:0:15140:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e2b6a638/0x3d2d1916761d7695 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869539.307431:0:15140:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e2b6a638/0x3d2d1916761d7695 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869539.307441:0:15140:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788869539.307442:0:15140:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788869539.307444:0:15140:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788869539.307450:0:14156:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788869539.308127:0:14157:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788869539.308410:0:14191:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94c83c68a680 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14191:1875765421488512:0@lo:5:osp-pre-0-0.0 00000004:00080000:1.0:1788869539.308431:0:14191:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x240000400:0x21:0x0] from OST, last_created [0x240000400:0x21:0x0]last_used is [0x240000400:0x5:0x0] 00000100:00100000:1.0:1788869539.308494:0:14191:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94c83c68a680 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14191:1875765421488640:0@lo:5:osp-pre-0-0.0 00000100:00100000:1.0:1788869539.308549:0:14191:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869539.308606:0:14191:0:(client.c:2702:ptlrpc_set_wait()) set ffff94c808e29780 going to sleep for 11 seconds 00000100:00100000:2.0:1788869539.315971:0:14804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765421488640 00000100:00100000:2.0:1788869539.316004:0:14804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765421488640 00000100:00100000:2.0:1788869539.316765:0:14804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788869539.316781:0:14804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c83c689f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:14191:x1875765421488640:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:2.0:1788869539.316854:0:14804:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x240000400 at 34 00000100:00100000:3.0:1788869539.347338:0:14804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c83c689f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:14191:x1875765421488640:12345-0@lo:5:osp-pre-0-0.0 Request processed in 30553us (38780us total) trans 8589934593 rc 0/0 00000100:00100000:3.0:1788869539.347361:0:14804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788869539.347497:0:14191:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94c83c68a680 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14191:1875765421488640:0@lo:5:osp-pre-0-0.0 00000004:00080000:1.0:1788869539.347519:0:14191:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x240000400:0x21:0x0]-[0x240000400:0x41:0x0] 00010000:00010000:0.0:1788869539.421631:0:15140:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1788869539.604808:0:15171:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg139-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:2.0:1788869540.444958:0:14156:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788869541.474199:0:14157:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1788869541.627462:0:6571:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934593 is committed 00000001:00100000:3.0:1788869541.627659:0:6571:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00010000:00010000:0.0:1788869542.493525:0:15140:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788869543.516822:0:14156:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788869544.539505:0:14157:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788869544.540589:0:3284:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788869544.540610:0:3284:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94c83c68b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3284:1875765421488768:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788869544.540696:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1788869544.540737:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788869544.540742:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1788869544.540746:0:36:0:(import.c:65:import_set_state_nolock()) ffff94c80f9b5000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788869544.540751:0:36:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 287 00000100:00100000:2.0:1788869544.540753:0:3284:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94c835a14a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:cd496ea5-7761-4e68-8a6b-58e98659ad4a:3284:1875765421488896:0@lo:400:kworker.0 00000100:00080000:3.0:1788869544.540757:0:36:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:3.0:1788869544.540764:0:36:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff94c80f9b5000 using connection 192.168.201.139@tcp/0@lo 00000100:00100000:2.0:1788869544.540782:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869544.540788:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff94c835a17b80 x1875765421489024/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788869544.540816:0:14163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765421488896 00000100:00100000:3.0:1788869544.540823:0:14163:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765421488896 00000100:00100000:3.0:1788869544.540868:0:14163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1788869544.540885:0:14163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c83e0ca450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cd496ea5-7761-4e68-8a6b-58e98659ad4a+16:3284:x1875765421488896:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788869544.540940:0:14163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c83e0ca450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cd496ea5-7761-4e68-8a6b-58e98659ad4a+16:3284:x1875765421488896:12345-0@lo:400:kworker.0 Request processed in 56us (156us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869544.540948:0:14163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1788869544.540995:0:3282:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94c835a17b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3282:1875765421489024:0@lo:8:kworker.0 00000100:00100000:3.0:1788869544.541021:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869544.541046:0:14806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765421489024 00000100:00100000:2.0:1788869544.541051:0:14806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765421489024 00000100:00100000:3.0:1788869544.541074:0:3284:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94c835a14a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:cd496ea5-7761-4e68-8a6b-58e98659ad4a:3284:1875765421488896:0@lo:400:kworker.0 00000100:00100000:2.0:1788869544.541074:0:14806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788869544.541079:0:14806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c835a16a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3282:x1875765421489024:12345-0@lo:8:kworker.0 00010000:00020000:2.0:1788869544.541095:0:14806:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1788869544.541114:0:3285:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94c835a14a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3285:1875765421489152:0@lo:400:kworker.0 00000100:00100000:3.0:1788869544.541141:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869544.541184:0:3286:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94c835a16300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3286:1875765421489280:0@lo:400:kworker.0 00000100:00100000:3.0:1788869544.541211:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869544.544561:0:14807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765421488768 00000100:00100000:1.0:1788869544.544578:0:14807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765421488768 00000100:00100000:1.0:1788869544.544680:0:14807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788869544.544692:0:14807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c835157100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3284:x1875765421488768:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788869544.544731:0:14807:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788869544.544819:0:14807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c835157100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3284:x1875765421488768:12345-0@lo:13:osp-pre-0-0.0 Request processed in 130us (4123us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869544.544826:0:14807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788869544.544869:0:14170:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765421489152 00000100:00100000:1.0:1788869544.544873:0:14170:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765421489152 00000100:00100000:1.0:1788869544.544902:0:14170:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765421489280 00000100:00100000:1.0:1788869544.544906:0:14170:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765421489280 00000100:00100000:1.0:1788869544.544931:0:14170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788869544.544938:0:14170:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c835a15f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3285:x1875765421489152:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788869544.544986:0:14170:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c835a15f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3285:x1875765421489152:12345-0@lo:400:kworker.0 Request processed in 48us (3843us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869544.544994:0:14170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788869544.545005:0:14170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788869544.545011:0:14170:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c835a14700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3286:x1875765421489280:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788869544.545060:0:14170:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c835a14700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3286:x1875765421489280:12345-0@lo:400:kworker.0 Request processed in 49us (3847us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869544.545066:0:14170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00080000:1.0:1788869544.545119:0:3286:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff94c835a16300 x1875765421489280/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788869560 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788869544.545134:0:3286:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94c835a16300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3286:1875765421489280:0@lo:400:kworker.0 00010000:00080000:1.0:1788869544.545168:0:3285:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff94c835a14a80 x1875765421489152/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788869560 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788869544.545177:0:3285:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94c835a14a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3285:1875765421489152:0@lo:400:kworker.0 00000100:00100000:1.0:1788869544.545201:0:3284:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934593 gen 2 00000100:00100000:1.0:1788869544.545216:0:3284:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94c83c68b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3284:1875765421488768:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1788869544.545680:0:14164:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788869544.545685:0:14164:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788869544.571424:0:14806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c835a16a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3282:x1875765421489024:12345-0@lo:8:kworker.0 Request processed in 30331us (30389us total) trans 0 rc -19/-19 00000100:00100000:2.0:1788869544.571445:0:14806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:1.0:1788869544.571959:0:3282:0:(import.c:65:import_set_state_nolock()) ffff94c80f9b5000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788869544.571974:0:3282:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1788869544.571980:0:3282:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94c835a17b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3282:1875765421489024:0@lo:8:kworker.0 00010000:00010000:2.0:1788869545.564757:0:15140:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788869546.203902:0:14201:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1788869546.589539:0:14156:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1788869547.239091:0:15475:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1788869547.239097:0:15475:0:(obd_mount.c:926:lmd_print()) device: lustre-ost2/ost2 00000080:01200004:3.0:1788869547.239228:0:15475:0:(super25.c:130:lustre_fill_super()) VFS Op: sb ffff94c810e50000 00000020:01000004:3.0:1788869547.239284:0:15475:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-OST0001, type=osd-zfs, lsifl=200002, mountfl=0 00000020:01000004:3.0:1788869547.239303:0:15475:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-zfs) 00000020:00000080:3.0:1788869547.239323:0:15475:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff94c82c848000) 00000020:00000080:3.0:1788869547.239346:0:15475:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type osd-zfs with refcount 2 00100000:10000000:3.0:1788869547.276917:0:15475:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:3.0:1788869547.277246:0:15475:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0001: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:3.0:1788869547.278142:0:15475:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:3.0:1788869547.280664:0:15475:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00100000:10000000:3.0:1788869547.280972:0:15475:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0001: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:3.0:1788869547.282081:0:15475:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled params under 465: rc = 0 00100000:10000000:3.0:1788869547.282247:0:15475:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled lustre-OST0001 under 465: rc = 0 00100000:10000000:3.0:1788869547.283180:0:15475:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled lustre-client under 465: rc = 0 00100000:10000000:3.0:1788869547.284031:0:15475:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x2020000-OST0001 under 768: rc = 0 00100000:10000000:3.0:1788869547.289045:0:15475:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x20000-OST0001 under 768: rc = 0 00100000:10000000:3.0:1788869547.289576:0:15475:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x20000 under 768: rc = 0 00100000:10000000:3.0:1788869547.289828:0:15475:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x2020000 under 768: rc = 0 00100000:10000000:3.0:1788869547.290074:0:15475:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x1020000-OST0001 under 768: rc = 0 00100000:10000000:3.0:1788869547.290375:0:15475:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x1020000 under 768: rc = 0 00000020:00000080:3.0:1788869547.292414:0:15475:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:3.0:1788869547.292439:0:15475:0:(osd_handler.c:1569:osd_obd_connect()) connect #0 00000020:00000080:3.0:1788869547.292459:0:15475:0:(genops.c:1406:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x3d2d1916761d76a3 00000020:01000004:3.0:1788869547.292473:0:15475:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-OST0001 on device lustre-ost2/ost2 00000020:01000004:3.0:1788869547.292502:0:15475:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.201.139@tcp:Set MGC reconnect 1 10000000:01000000:3.0:1788869547.292506:0:15475:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.201.139@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:3.0:1788869547.292513:0:15475:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0001 00000020:01000004:3.0:1788869547.292549:0:15475:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost2/ost2 10000000:01000000:3.0:1788869547.292564:0:15475:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.201.139@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:1.0:1788869547.321183:0:15475:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.201.139@tcp ctxt 0 is initialized 00000020:01000004:1.0:1788869547.321285:0:15475:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.201.139@tcp, index=0001, flags=0x20002 00000020:01000004:1.0:1788869547.321292:0:15475:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:1.0:1788869547.321295:0:15475:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1788869547.321296:0:15475:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788869547.321298:0:15475:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788869547.321300:0:15475:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788869547.321301:0:15475:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788869547.321303:0:15475:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788869547.321306:0:15475:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788869547.321308:0:15475:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1788869547.321314:0:15475:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020002 00000020:01000004:1.0:1788869547.321317:0:15475:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1788869547.321318:0:15475:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1788869547.321320:0:15475:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788869547.321321:0:15475:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788869547.321322:0:15475:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788869547.321323:0:15475:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788869547.321324:0:15475:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788869547.321325:0:15475:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788869547.321327:0:15475:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1788869547.321367:0:15475:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:1.0:1788869547.321861:0:15475:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94c83c68b800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cd496ea5-7761-4e68-8a6b-58e98659ad4a:15475:1875765421489408:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1788869547.321965:0:15475:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869547.322085:0:15475:0:(client.c:2702:ptlrpc_set_wait()) set ffff94c808e29f00 going to sleep for 11 seconds 00000100:00100000:3.0:1788869547.324614:0:14161:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765421489408 00000100:00100000:3.0:1788869547.324634:0:14161:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765421489408 00000100:00100000:2.0:1788869547.324825:0:14161:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1788869547.324840:0:14161:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c83e0cbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cd496ea5-7761-4e68-8a6b-58e98659ad4a+16:15475:x1875765421489408:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1788869547.324926:0:14161:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:2.0:1788869547.324930:0:14161:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0001 is running on 0@lo 20000000:01000000:2.0:1788869547.324935:0:14161:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:0.0:1788869547.336112:0:14161:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c83e0cbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cd496ea5-7761-4e68-8a6b-58e98659ad4a+16:15475:x1875765421489408:12345-0@lo:253:mount.lustre.0 Request processed in 11263us (14133us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869547.336132:0:14161:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1788869547.336283:0:15475:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94c83c68b800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cd496ea5-7761-4e68-8a6b-58e98659ad4a:15475:1875765421489408:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1788869547.336304:0:15475:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:1.0:1788869547.336309:0:15475:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1788869547.336311:0:15475:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1788869547.336312:0:15475:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788869547.336314:0:15475:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788869547.336315:0:15475:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788869547.336316:0:15475:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788869547.336318:0:15475:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788869547.336320:0:15475:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788869547.336339:0:15475:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:1.0:1788869547.336368:0:15475:0:(tgt_mount.c:101:server_register_mount()) register mount ffff94c810e50000 from lustre-OST0001 10000000:01000000:1.0:1788869547.336418:0:15475:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:1.0:1788869547.336422:0:15475:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:1.0:1788869547.336433:0:15475:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff94c8060ab380 local copy 00010000:00010000:1.0:1788869547.336447:0:15475:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.139@tcp lock: ffff94c805039200/0x3d2d1916761d7449 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x3d2d1916761d7450 expref: -99 pid: 14150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788869547.336704:0:15475:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94c83c68b800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cd496ea5-7761-4e68-8a6b-58e98659ad4a:15475:1875765421489536:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788869547.336745:0:15475:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869547.336790:0:15475:0:(client.c:2702:ptlrpc_set_wait()) set ffff94c808e29e40 going to sleep for 11 seconds 00000100:00100000:2.0:1788869547.339132:0:14162:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765421489536 00000100:00100000:2.0:1788869547.339150:0:14162:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765421489536 00000100:00100000:2.0:1788869547.339247:0:14162:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1788869547.339302:0:14162:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c83e0ca050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cd496ea5-7761-4e68-8a6b-58e98659ad4a+16:15475:x1875765421489536:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788869547.339808:0:14162:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c83e0ca050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cd496ea5-7761-4e68-8a6b-58e98659ad4a+16:15475:x1875765421489536:12345-0@lo:501:mount.lustre.0 Request processed in 509us (3060us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788869547.339818:0:14162:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1788869547.339996:0:15475:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94c83c68b800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cd496ea5-7761-4e68-8a6b-58e98659ad4a:15475:1875765421489536:0@lo:501:mount.lustre.0 10000000:01000000:1.0:1788869547.340029:0:15475:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.201.139@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:1.0:1788869547.340185:0:15475:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.201.139@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:1.0:1788869547.340196:0:15475:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.139@tcp lock: ffff94c805039200/0x3d2d1916761d7449 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x3d2d1916761d7450 expref: -99 pid: 14150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869547.340208:0:15475:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.139@tcp lock: ffff94c805039200/0x3d2d1916761d7449 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x3d2d1916761d7450 expref: -99 pid: 14150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788869547.340241:0:15475:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff94c810e50000 10000000:01000000:1.0:1788869547.340247:0:15475:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1788869547.340284:0:15475:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:1.0:1788869547.340287:0:15475:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1788869547.340292:0:15475:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:1.0:1788869547.340296:0:15475:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:1.0:1788869547.340339:0:15475:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.139@tcp lock: ffff94c83fde6a00/0x3d2d1916761d76aa lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869547.340347:0:15475:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.139@tcp lock: ffff94c83fde6a00/0x3d2d1916761d76aa lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869547.340366:0:15475:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.139@tcp lock: ffff94c83fde6a00/0x3d2d1916761d76aa lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788869547.340390:0:15475:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94c83c68b800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cd496ea5-7761-4e68-8a6b-58e98659ad4a:15475:1875765421489664:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788869547.340436:0:15475:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869547.340476:0:15475:0:(client.c:2702:ptlrpc_set_wait()) set ffff94c808e29e40 going to sleep for 11 seconds 00000100:00100000:2.0:1788869547.340761:0:14161:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765421489664 00000100:00100000:2.0:1788869547.340769:0:14161:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765421489664 00000100:00100000:2.0:1788869547.340816:0:14161:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1788869547.340824:0:14161:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c83e0c9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cd496ea5-7761-4e68-8a6b-58e98659ad4a+16:15475:x1875765421489664:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788869547.340838:0:14161:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788869547.340855:0:14161:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff94c805039800/0x3d2d1916761d76b1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x3d2d1916761d76aa expref: -99 pid: 14161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869547.340880:0:14161:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff94c805039800/0x3d2d1916761d76b1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3d2d1916761d76aa expref: 17 pid: 14161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869547.340891:0:14161:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff94c805039800/0x3d2d1916761d76b1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3d2d1916761d76aa expref: 17 pid: 14161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869547.340902:0:14161:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94c805039800, rc 0) 00000100:00100000:2.0:1788869547.340937:0:14161:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c83e0c9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cd496ea5-7761-4e68-8a6b-58e98659ad4a+17:15475:x1875765421489664:12345-0@lo:101:mount.lustre.0 Request processed in 113us (501us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869547.340944:0:14161:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1788869547.345142:0:15475:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94c83c68b800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cd496ea5-7761-4e68-8a6b-58e98659ad4a:15475:1875765421489664:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788869547.345185:0:15475:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.139@tcp lock: ffff94c83fde6a00/0x3d2d1916761d76aa lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x3d2d1916761d76b1 expref: -99 pid: 15475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869547.345204:0:15475:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.139@tcp lock: ffff94c83fde6a00/0x3d2d1916761d76aa lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x3d2d1916761d76b1 expref: -99 pid: 15475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788869547.346174:0:15475:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000040:00080000:0.0:1788869547.362215:0:15475:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788869547.362576:0:15475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:0.0:1788869547.362621:0:15475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 128 off8544 00000040:00080000:0.0:1788869547.362650:0:15475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 112 off8656 00000040:00080000:0.0:1788869547.362690:0:15475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8880 00000040:00080000:0.0:1788869547.362720:0:15475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9104 00000040:00080000:0.0:1788869547.362747:0:15475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 80 off9184 00000040:00080000:0.0:1788869547.362801:0:15475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 224 off9408 00000040:00080000:0.0:1788869547.362809:0:15475:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000100:00100000:0.0:1788869547.362941:0:15475:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94c83661c380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cd496ea5-7761-4e68-8a6b-58e98659ad4a:15475:1875765421489792:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788869547.363030:0:15475:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869547.363097:0:15475:0:(client.c:2702:ptlrpc_set_wait()) set ffff94c820d5d480 going to sleep for 11 seconds 00000100:00100000:2.0:1788869547.363433:0:14161:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765421489792 00000100:00100000:2.0:1788869547.363443:0:14161:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765421489792 00000100:00100000:2.0:1788869547.363506:0:14161:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1788869547.363517:0:14161:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c83e0c8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cd496ea5-7761-4e68-8a6b-58e98659ad4a+17:15475:x1875765421489792:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788869547.364069:0:14161:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c83e0c8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cd496ea5-7761-4e68-8a6b-58e98659ad4a+17:15475:x1875765421489792:12345-0@lo:501:mount.lustre.0 Request processed in 552us (1037us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869547.364090:0:14161:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1788869547.365641:0:15475:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94c83661c380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cd496ea5-7761-4e68-8a6b-58e98659ad4a:15475:1875765421489792:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788869547.365720:0:15475:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94c83661c380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cd496ea5-7761-4e68-8a6b-58e98659ad4a:15475:1875765421489920:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788869547.365808:0:15475:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869547.365972:0:15475:0:(client.c:2702:ptlrpc_set_wait()) set ffff94c820d5d480 going to sleep for 11 seconds 00000100:00100000:3.0:1788869547.366142:0:14163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765421489920 00000100:00100000:3.0:1788869547.366150:0:14163:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765421489920 00000100:00100000:3.0:1788869547.366215:0:14163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1788869547.366640:0:14163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c83e0c9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cd496ea5-7761-4e68-8a6b-58e98659ad4a+17:15475:x1875765421489920:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788869547.367124:0:14163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c83e0c9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cd496ea5-7761-4e68-8a6b-58e98659ad4a+17:15475:x1875765421489920:12345-0@lo:503:mount.lustre.0 Request processed in 487us (1315us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869547.367199:0:15475:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94c83661c380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cd496ea5-7761-4e68-8a6b-58e98659ad4a:15475:1875765421489920:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788869547.368802:0:14163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000040:00080000:0.0:1788869547.372803:0:15475:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1788869547.372934:0:15475:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94c83661c380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cd496ea5-7761-4e68-8a6b-58e98659ad4a:15475:1875765421490048:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788869547.373064:0:15475:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869547.373122:0:15475:0:(client.c:2702:ptlrpc_set_wait()) set ffff94c820d5d480 going to sleep for 11 seconds 00000100:00100000:1.0:1788869547.373445:0:14162:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765421490048 00000100:00100000:1.0:1788869547.373457:0:14162:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765421490048 00000100:00100000:1.0:1788869547.373513:0:14162:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1788869547.373524:0:14162:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c83e0c8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cd496ea5-7761-4e68-8a6b-58e98659ad4a+17:15475:x1875765421490048:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788869547.373817:0:14162:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c83e0c8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cd496ea5-7761-4e68-8a6b-58e98659ad4a+17:15475:x1875765421490048:12345-0@lo:502:mount.lustre.0 Request processed in 294us (753us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869547.373825:0:14162:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1788869547.374359:0:15475:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94c83661c380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cd496ea5-7761-4e68-8a6b-58e98659ad4a:15475:1875765421490048:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788869547.374807:0:15475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:0.0:1788869547.374874:0:15475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 128 off8544 00000040:00080000:0.0:1788869547.374907:0:15475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 112 off8656 00000040:00080000:0.0:1788869547.374956:0:15475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8880 00000040:00080000:0.0:1788869547.374991:0:15475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9104 00000040:00080000:0.0:1788869547.375023:0:15475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 80 off9184 00000040:00080000:0.0:1788869547.375073:0:15475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 224 off9408 00000040:00080000:0.0:1788869547.375112:0:15475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9632 00000040:00080000:0.0:1788869547.375163:0:15475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 120 off9752 00000100:00100000:0.0:1788869547.377126:0:15475:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94c83661c380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cd496ea5-7761-4e68-8a6b-58e98659ad4a:15475:1875765421490176:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788869547.377304:0:15475:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869547.377370:0:15475:0:(client.c:2702:ptlrpc_set_wait()) set ffff94c820d5d480 going to sleep for 11 seconds 00000100:00100000:1.0:1788869547.377527:0:14163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765421490176 00000100:00100000:1.0:1788869547.377539:0:14163:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765421490176 00000100:00100000:1.0:1788869547.377613:0:14163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1788869547.377624:0:14163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c83e0c9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cd496ea5-7761-4e68-8a6b-58e98659ad4a+17:15475:x1875765421490176:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788869547.377919:0:14163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c83e0c9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cd496ea5-7761-4e68-8a6b-58e98659ad4a+17:15475:x1875765421490176:12345-0@lo:502:mount.lustre.0 Request processed in 296us (617us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869547.377934:0:14163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1788869547.379896:0:15475:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94c83661c380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cd496ea5-7761-4e68-8a6b-58e98659ad4a:15475:1875765421490176:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788869547.380096:0:15475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 224 off9976 00000040:00080000:0.0:1788869547.380115:0:15475:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 10 count 11 00000020:01000000:0.0:1788869547.381813:0:15476:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1788869547.381827:0:15476:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-ost2/ost2 00000020:00000080:0.0:1788869547.381834:0:15476:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788869547.381837:0:15476:0:(obd_config.c:1561:class_process_config()) marker 17 (0x1) lustre-OST0001 add ost 00000020:00000080:0.0:1788869547.381842:0:15476:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1788869547.381878:0:15476:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff94c701d63380) 00000020:00000080:0.0:1788869547.381920:0:15476:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type obdfilter with refcount 2 00000020:00000080:0.0:1788869547.381927:0:15476:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:0.0:1788869547.382009:0:15476:0:(tgt_mount.c:153:server_get_mount()) get mount ffff94c810e50000 from lustre-OST0001, refs=2 00080000:01000000:0.0:1788869547.382018:0:15476:0:(osd_handler.c:1569:osd_obd_connect()) connect #1 00000020:00000080:0.0:1788869547.382028:0:15476:0:(genops.c:1406:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x3d2d1916761d76bf 00010000:00010000:0.0:1788869547.389864:0:15476:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-3 is initialized 00000001:00000004:1.0:1788869547.392986:0:15476:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 4294967324 00080000:10000000:1.0:1788869547.404916:0:15476:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0xb:0x0] (8/8/4) registered 00000020:00000080:1.0:1788869547.409059:0:15476:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:1.0:1788869547.409079:0:15476:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788869547.409087:0:15476:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788869547.409089:0:15476:0:(obd_config.c:1561:class_process_config()) marker 17 (0x2) lustre-OST0001 add ost 00000020:01000000:1.0:1788869547.409093:0:15476:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788869547.409097:0:15476:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788869547.409098:0:15476:0:(obd_config.c:1561:class_process_config()) marker 22 (0x1) lustre sys.timeout 00000020:00000080:1.0:1788869547.409101:0:15476:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1788869547.409103:0:15476:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1788869547.409105:0:15476:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788869547.409108:0:15476:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788869547.409109:0:15476:0:(obd_config.c:1561:class_process_config()) marker 22 (0x2) lustre sys.timeout 00000020:01000000:1.0:1788869547.409111:0:15476:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788869547.409114:0:15476:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788869547.409115:0:15476:0:(obd_config.c:1561:class_process_config()) marker 26 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1788869547.409119:0:15476:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000020:01000000:1.0:1788869547.409207:0:15476:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788869547.409211:0:15476:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788869547.409213:0:15476:0:(obd_config.c:1561:class_process_config()) marker 26 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1788869547.409216:0:15476:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 11 count 11 00000020:01000000:0.0:1788869547.409868:0:15475:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-10 (rc=0) 10000000:01000000:0.0:1788869547.409904:0:15475:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.139@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:0.0:1788869547.409996:0:15475:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.139@tcp lock: ffff94c83fde6a00/0x3d2d1916761d76aa lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x3d2d1916761d76b1 expref: -99 pid: 15475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869547.410010:0:15475:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.139@tcp lock: ffff94c83fde6a00/0x3d2d1916761d76aa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x3d2d1916761d76b1 expref: -99 pid: 15475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788869547.410021:0:15475:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff94c810e50000 from 1 10000000:01000000:0.0:1788869547.410024:0:15475:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788869547.410077:0:15475:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.139@tcp lock: ffff94c818d1f600/0x3d2d1916761d76c6 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869547.410087:0:15475:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.139@tcp lock: ffff94c818d1f600/0x3d2d1916761d76c6 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869547.410100:0:15475:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.139@tcp lock: ffff94c818d1f600/0x3d2d1916761d76c6 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788869547.410131:0:15475:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94c83661c380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cd496ea5-7761-4e68-8a6b-58e98659ad4a:15475:1875765421490304:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788869547.410222:0:15475:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869547.410313:0:15475:0:(client.c:2702:ptlrpc_set_wait()) set ffff94c820d5d600 going to sleep for 11 seconds 00000100:00100000:1.0:1788869547.412637:0:14161:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765421490304 00000100:00100000:1.0:1788869547.412655:0:14161:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765421490304 00000100:00100000:1.0:1788869547.412729:0:14161:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1788869547.412742:0:14161:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c83e0c8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cd496ea5-7761-4e68-8a6b-58e98659ad4a+17:15475:x1875765421490304:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788869547.412766:0:14161:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788869547.412791:0:14161:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff94c83fde6200/0x3d2d1916761d76cd lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x3d2d1916761d76c6 expref: -99 pid: 14161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869547.412843:0:14161:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff94c83fde6200/0x3d2d1916761d76cd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3d2d1916761d76c6 expref: 18 pid: 14161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869547.412855:0:14161:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff94c83fde6200/0x3d2d1916761d76cd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3d2d1916761d76c6 expref: 18 pid: 14161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869547.412867:0:14161:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94c83fde6200, rc 0) 00000100:00100000:1.0:1788869547.412955:0:14161:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c83e0c8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cd496ea5-7761-4e68-8a6b-58e98659ad4a+18:15475:x1875765421490304:12345-0@lo:101:mount.lustre.0 Request processed in 215us (2731us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869547.412963:0:14161:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1788869547.413994:0:15475:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94c83661c380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cd496ea5-7761-4e68-8a6b-58e98659ad4a:15475:1875765421490304:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788869547.414023:0:15475:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.139@tcp lock: ffff94c818d1f600/0x3d2d1916761d76c6 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x3d2d1916761d76cd expref: -99 pid: 15475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869547.414036:0:15475:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.139@tcp lock: ffff94c818d1f600/0x3d2d1916761d76c6 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x3d2d1916761d76cd expref: -99 pid: 15475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788869547.423614:0:15475:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:2.0:1788869547.424160:0:15475:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788869547.424452:0:15475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:2.0:1788869547.424498:0:15475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 112 off8528 00000040:00080000:2.0:1788869547.424574:0:15475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 224 off8752 00000040:00080000:2.0:1788869547.424583:0:15475:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000100:00100000:2.0:1788869547.424685:0:15475:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94c835156d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cd496ea5-7761-4e68-8a6b-58e98659ad4a:15475:1875765421490432:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788869547.424776:0:15475:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869547.424843:0:15475:0:(client.c:2702:ptlrpc_set_wait()) set ffff94c8355376c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788869547.425135:0:14162:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765421490432 00000100:00100000:0.0:1788869547.425145:0:14162:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765421490432 00000100:00100000:0.0:1788869547.425205:0:14162:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1788869547.425228:0:14162:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c83e0cb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cd496ea5-7761-4e68-8a6b-58e98659ad4a+18:15475:x1875765421490432:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788869547.425573:0:14162:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c83e0cb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cd496ea5-7761-4e68-8a6b-58e98659ad4a+18:15475:x1875765421490432:12345-0@lo:501:mount.lustre.0 Request processed in 346us (795us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869547.425581:0:14162:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1788869547.425642:0:15475:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94c835156d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cd496ea5-7761-4e68-8a6b-58e98659ad4a:15475:1875765421490432:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788869547.425689:0:15475:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94c83661c380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cd496ea5-7761-4e68-8a6b-58e98659ad4a:15475:1875765421490560:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788869547.425735:0:15475:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869547.425768:0:15475:0:(client.c:2702:ptlrpc_set_wait()) set ffff94c820d5d240 going to sleep for 11 seconds 00000100:00100000:1.0:1788869547.426075:0:14163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765421490560 00000100:00100000:1.0:1788869547.426081:0:14163:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765421490560 00000100:00100000:1.0:1788869547.426114:0:14163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1788869547.426121:0:14163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c83fddac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cd496ea5-7761-4e68-8a6b-58e98659ad4a+18:15475:x1875765421490560:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788869547.426574:0:14163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c83fddac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cd496ea5-7761-4e68-8a6b-58e98659ad4a+18:15475:x1875765421490560:12345-0@lo:503:mount.lustre.0 Request processed in 451us (836us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869547.426583:0:14163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1788869547.428848:0:15475:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94c83661c380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cd496ea5-7761-4e68-8a6b-58e98659ad4a:15475:1875765421490560:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1788869547.429642:0:15475:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1788869547.429764:0:15475:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94c83661c380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cd496ea5-7761-4e68-8a6b-58e98659ad4a:15475:1875765421490688:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788869547.429863:0:15475:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869547.429916:0:15475:0:(client.c:2702:ptlrpc_set_wait()) set ffff94c820d5d240 going to sleep for 11 seconds 00000100:00100000:1.0:1788869547.430179:0:14163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765421490688 00000100:00100000:1.0:1788869547.430187:0:14163:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765421490688 00000100:00100000:1.0:1788869547.430241:0:14163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1788869547.430280:0:14163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c83fdd8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cd496ea5-7761-4e68-8a6b-58e98659ad4a+18:15475:x1875765421490688:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788869547.430575:0:14163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c83fdd8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cd496ea5-7761-4e68-8a6b-58e98659ad4a+18:15475:x1875765421490688:12345-0@lo:502:mount.lustre.0 Request processed in 324us (711us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869547.430583:0:14163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1788869547.430922:0:15475:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94c83661c380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cd496ea5-7761-4e68-8a6b-58e98659ad4a:15475:1875765421490688:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788869547.431194:0:15475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:0.0:1788869547.431503:0:15475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 112 off8528 00000040:00080000:0.0:1788869547.431578:0:15475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 224 off8752 00000040:00080000:0.0:1788869547.431618:0:15475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8976 00000040:00080000:0.0:1788869547.431653:0:15475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 112 off9088 00000040:00080000:0.0:1788869547.431703:0:15475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 224 off9312 00000040:00080000:0.0:1788869547.431741:0:15475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9536 00000040:00080000:0.0:1788869547.431776:0:15475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 128 off9664 00000100:00100000:0.0:1788869547.431819:0:15475:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94c83661c380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cd496ea5-7761-4e68-8a6b-58e98659ad4a:15475:1875765421490816:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788869547.431887:0:15475:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869547.432173:0:15475:0:(client.c:2702:ptlrpc_set_wait()) set ffff94c820d5d240 going to sleep for 11 seconds 00000100:00100000:2.0:1788869547.434625:0:14162:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765421490816 00000100:00100000:2.0:1788869547.434644:0:14162:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765421490816 00000100:00100000:2.0:1788869547.434722:0:14162:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1788869547.434733:0:14162:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c83fdd8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cd496ea5-7761-4e68-8a6b-58e98659ad4a+18:15475:x1875765421490816:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788869547.435129:0:14162:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c83fdd8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cd496ea5-7761-4e68-8a6b-58e98659ad4a+18:15475:x1875765421490816:12345-0@lo:502:mount.lustre.0 Request processed in 397us (3240us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869547.435139:0:14162:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1788869547.435665:0:15475:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94c83661c380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cd496ea5-7761-4e68-8a6b-58e98659ad4a:15475:1875765421490816:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788869547.435921:0:15475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9888 00000040:00080000:0.0:1788869547.435941:0:15475:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 9 count 10 00000020:01000000:0.0:1788869547.437808:0:15480:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788869547.437825:0:15480:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788869547.437828:0:15480:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1788869547.437836:0:15480:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff94c810e50000 00000020:00000080:0.0:1788869547.437838:0:15480:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1788869547.437848:0:15480:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788869547.437851:0:15480:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788869547.437853:0:15480:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:0.0:1788869547.437855:0:15480:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788869547.437858:0:15480:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788869547.437859:0:15480:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1788869547.437863:0:15480:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff94c810e50000 00000020:00000080:0.0:1788869547.437865:0:15480:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1788869547.437941:0:15480:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788869547.437945:0:15480:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788869547.437946:0:15480:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:0.0:1788869547.437949:0:15480:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788869547.437951:0:15480:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788869547.437953:0:15480:0:(obd_config.c:1561:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1788869547.437957:0:15480:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff94c810e50000 00000020:00000080:0.0:1788869547.437959:0:15480:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1788869547.437995:0:15480:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788869547.437999:0:15480:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788869547.438000:0:15480:0:(obd_config.c:1561:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:0.0:1788869547.438003:0:15480:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 10 count 10 00000020:01000000:2.0:1788869547.438172:0:15475:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:2.0:1788869547.438206:0:15475:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.139@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788869547.438237:0:15475:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.139@tcp lock: ffff94c818d1f600/0x3d2d1916761d76c6 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x3d2d1916761d76cd expref: -99 pid: 15475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869547.438283:0:15475:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.139@tcp lock: ffff94c818d1f600/0x3d2d1916761d76c6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x3d2d1916761d76cd expref: -99 pid: 15475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788869547.438338:0:15475:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1788869547.438341:0:15475:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff94c810e50000 10000000:01000000:2.0:1788869547.438346:0:15475:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff94c810e50000 10000000:01000000:2.0:1788869547.438369:0:15475:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1788869547.438377:0:15475:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff94c810e50000 from 1 10000000:01000000:2.0:1788869547.438380:0:15475:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1788869547.438444:0:15475:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.139@tcp lock: ffff94c805038000/0x3d2d1916761d76d4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869547.438455:0:15475:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.139@tcp lock: ffff94c805038000/0x3d2d1916761d76d4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869547.438469:0:15475:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.139@tcp lock: ffff94c805038000/0x3d2d1916761d76d4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788869547.438502:0:15475:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94c835155c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cd496ea5-7761-4e68-8a6b-58e98659ad4a:15475:1875765421490944:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788869547.438603:0:15475:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869547.438659:0:15475:0:(client.c:2702:ptlrpc_set_wait()) set ffff94c835537cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1788869547.438847:0:14161:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765421490944 00000100:00100000:1.0:1788869547.438857:0:14161:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765421490944 00000100:00100000:1.0:1788869547.438921:0:14161:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1788869547.438932:0:14161:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c833d6f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cd496ea5-7761-4e68-8a6b-58e98659ad4a+18:15475:x1875765421490944:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788869547.438949:0:14161:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788869547.438965:0:14161:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff94c83fde7800/0x3d2d1916761d76db lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x3d2d1916761d76d4 expref: -99 pid: 14161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869547.438995:0:14161:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff94c83fde7800/0x3d2d1916761d76db lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3d2d1916761d76d4 expref: 19 pid: 14161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869547.439008:0:14161:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff94c83fde7800/0x3d2d1916761d76db lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3d2d1916761d76d4 expref: 19 pid: 14161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869547.439018:0:14161:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94c83fde7800, rc 0) 00000100:00100000:1.0:1788869547.439070:0:14161:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c833d6f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cd496ea5-7761-4e68-8a6b-58e98659ad4a+19:15475:x1875765421490944:12345-0@lo:101:mount.lustre.0 Request processed in 140us (466us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869547.439077:0:14161:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1788869547.440768:0:15475:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94c835155c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cd496ea5-7761-4e68-8a6b-58e98659ad4a:15475:1875765421490944:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788869547.440813:0:15475:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.139@tcp lock: ffff94c805038000/0x3d2d1916761d76d4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x3d2d1916761d76db expref: -99 pid: 15475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869547.440829:0:15475:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.139@tcp lock: ffff94c805038000/0x3d2d1916761d76d4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x3d2d1916761d76db expref: -99 pid: 15475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788869547.443119:0:15475:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000040:00080000:2.0:1788869547.445037:0:15475:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788869547.449644:0:15475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:2.0:1788869547.449781:0:15475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:2.0:1788869547.449819:0:15475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:2.0:1788869547.449874:0:15475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:2.0:1788869547.449914:0:15475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:2.0:1788869547.449989:0:15475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:2.0:1788869547.450051:0:15475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:2.0:1788869547.450088:0:15475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:2.0:1788869547.450138:0:15475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:2.0:1788869547.450177:0:15475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:2.0:1788869547.450215:0:15475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:2.0:1788869547.450299:0:15475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:2.0:1788869547.450340:0:15475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:2.0:1788869547.450376:0:15475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:2.0:1788869547.457278:0:15475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:2.0:1788869547.457365:0:15475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:2.0:1788869547.457418:0:15475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:2.0:1788869547.457475:0:15475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:2.0:1788869547.457513:0:15475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:2.0:1788869547.457559:0:15475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:2.0:1788869547.457615:0:15475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:2.0:1788869547.457662:0:15475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:2.0:1788869547.457732:0:15475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:2.0:1788869547.457793:0:15475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:2.0:1788869547.457836:0:15475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 128 off12440 00000040:00080000:2.0:1788869547.457880:0:15475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12664 00000040:00080000:2.0:1788869547.457937:0:15475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12888 00000040:00080000:2.0:1788869547.457982:0:15475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off12968 00000040:00080000:2.0:1788869547.458025:0:15475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13192 00000040:00080000:2.0:1788869547.458083:0:15475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].30, 224 off13416 00000040:00080000:2.0:1788869547.458127:0:15475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].31, 88 off13504 00000040:00080000:2.0:1788869547.458165:0:15475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].32, 128 off13632 00000040:00080000:2.0:1788869547.458197:0:15475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].33, 144 off13776 00000040:00080000:2.0:1788869547.458243:0:15475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].34, 128 off13904 00000040:00080000:2.0:1788869547.458316:0:15475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].35, 224 off14128 00000040:00080000:2.0:1788869547.458368:0:15475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].36, 224 off14352 00000040:00080000:2.0:1788869547.458406:0:15475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].37, 80 off14432 00000040:00080000:2.0:1788869547.458525:0:15475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].38, 224 off14656 00000040:00080000:2.0:1788869547.458532:0:15475:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 38 count 39 00000100:00100000:2.0:1788869547.458691:0:15475:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94c835155c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cd496ea5-7761-4e68-8a6b-58e98659ad4a:15475:1875765421491072:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788869547.458791:0:15475:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869547.458864:0:15475:0:(client.c:2702:ptlrpc_set_wait()) set ffff94c835537cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788869547.463000:0:14163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765421491072 00000100:00100000:0.0:1788869547.463020:0:14163:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765421491072 00000100:00100000:0.0:1788869547.464359:0:14163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1788869547.464382:0:14163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c833d6e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cd496ea5-7761-4e68-8a6b-58e98659ad4a+19:15475:x1875765421491072:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788869547.464847:0:14163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c833d6e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cd496ea5-7761-4e68-8a6b-58e98659ad4a+19:15475:x1875765421491072:12345-0@lo:501:mount.lustre.0 Request processed in 473us (6054us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869547.464866:0:14163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1788869547.474834:0:15475:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94c835155c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cd496ea5-7761-4e68-8a6b-58e98659ad4a:15475:1875765421491072:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788869547.474923:0:15475:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94c83661c380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cd496ea5-7761-4e68-8a6b-58e98659ad4a:15475:1875765421491200:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788869547.475020:0:15475:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869547.475082:0:15475:0:(client.c:2702:ptlrpc_set_wait()) set ffff94c820d5d480 going to sleep for 11 seconds 00000100:00100000:1.0:1788869547.475135:0:14162:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765421491200 00000100:00100000:1.0:1788869547.475143:0:14162:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765421491200 00000100:00100000:1.0:1788869547.475199:0:14162:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1788869547.475209:0:14162:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c833d6fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cd496ea5-7761-4e68-8a6b-58e98659ad4a+19:15475:x1875765421491200:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788869547.475874:0:14162:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c833d6fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cd496ea5-7761-4e68-8a6b-58e98659ad4a+19:15475:x1875765421491200:12345-0@lo:503:mount.lustre.0 Request processed in 663us (851us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869547.475886:0:14162:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1788869547.479695:0:15475:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94c83661c380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cd496ea5-7761-4e68-8a6b-58e98659ad4a:15475:1875765421491200:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1788869547.482779:0:15475:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1788869547.482943:0:15475:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94c83661c380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cd496ea5-7761-4e68-8a6b-58e98659ad4a:15475:1875765421491328:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788869547.483072:0:15475:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869547.483150:0:14163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765421491328 00000100:00100000:0.0:1788869547.483160:0:14163:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765421491328 00000100:00100000:0.0:1788869547.483215:0:14163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1788869547.483226:0:14163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c833d6e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cd496ea5-7761-4e68-8a6b-58e98659ad4a+19:15475:x1875765421491328:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788869547.484208:0:14163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c833d6e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cd496ea5-7761-4e68-8a6b-58e98659ad4a+19:15475:x1875765421491328:12345-0@lo:502:mount.lustre.0 Request processed in 977us (1130us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869547.484222:0:14163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1788869547.484347:0:15475:0:(client.c:2702:ptlrpc_set_wait()) set ffff94c820d5d480 going to sleep for 11 seconds 00000100:00100000:0.0:1788869547.484383:0:15475:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94c83661c380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cd496ea5-7761-4e68-8a6b-58e98659ad4a:15475:1875765421491328:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788869547.484758:0:15475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:0.0:1788869547.484813:0:15475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:0.0:1788869547.484848:0:15475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:0.0:1788869547.484901:0:15475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:0.0:1788869547.484937:0:15475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:0.0:1788869547.484990:0:15475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:0.0:1788869547.485028:0:15475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:0.0:1788869547.485077:0:15475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:0.0:1788869547.485128:0:15475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:0.0:1788869547.485163:0:15475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:0.0:1788869547.485192:0:15475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:0.0:1788869547.485282:0:15475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:0.0:1788869547.485319:0:15475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:0.0:1788869547.485349:0:15475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:0.0:1788869547.494862:0:15475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:0.0:1788869547.494966:0:15475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:0.0:1788869547.494995:0:15475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:0.0:1788869547.495035:0:15475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:0.0:1788869547.495064:0:15475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:0.0:1788869547.495091:0:15475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:0.0:1788869547.495129:0:15475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:0.0:1788869547.495158:0:15475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:0.0:1788869547.495185:0:15475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:0.0:1788869547.499565:0:15475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:0.0:1788869547.499692:0:15475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 128 off12440 00000040:00080000:0.0:1788869547.499721:0:15475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12664 00000040:00080000:0.0:1788869547.499786:0:15475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12888 00000040:00080000:0.0:1788869547.499816:0:15475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off12968 00000040:00080000:0.0:1788869547.499844:0:15475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13192 00000040:00080000:0.0:1788869547.499883:0:15475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13416 00000040:00080000:0.0:1788869547.499946:0:15475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13504 00000040:00080000:0.0:1788869547.499981:0:15475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13632 00000040:00080000:0.0:1788869547.500016:0:15475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13776 00000040:00080000:0.0:1788869547.500065:0:15475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13904 00000040:00080000:0.0:1788869547.500102:0:15475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14128 00000040:00080000:0.0:1788869547.500149:0:15475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14352 00000040:00080000:0.0:1788869547.500194:0:15475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14432 00000040:00080000:0.0:1788869547.500234:0:15475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14656 00000040:00080000:0.0:1788869547.500331:0:15475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14880 00000040:00080000:0.0:1788869547.500367:0:15475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 120 off15000 00000100:00100000:0.0:1788869547.500630:0:15475:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94c83661c380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cd496ea5-7761-4e68-8a6b-58e98659ad4a:15475:1875765421491456:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788869547.500738:0:15475:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869547.500790:0:15475:0:(client.c:2702:ptlrpc_set_wait()) set ffff94c820d5d480 going to sleep for 11 seconds 00000100:00100000:1.0:1788869547.500874:0:14162:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765421491456 00000100:00100000:1.0:1788869547.500885:0:14162:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765421491456 00000100:00100000:1.0:1788869547.500944:0:14162:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1788869547.500955:0:14162:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c833d6d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cd496ea5-7761-4e68-8a6b-58e98659ad4a+19:15475:x1875765421491456:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788869547.501605:0:14162:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c833d6d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cd496ea5-7761-4e68-8a6b-58e98659ad4a+19:15475:x1875765421491456:12345-0@lo:502:mount.lustre.0 Request processed in 648us (863us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869547.501622:0:14162:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1788869547.505546:0:15475:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94c83661c380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cd496ea5-7761-4e68-8a6b-58e98659ad4a:15475:1875765421491456:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788869547.505783:0:15475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 224 off15224 00000040:00080000:2.0:1788869547.505802:0:15475:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 41 count 42 00000020:01000004:0.0:1788869547.507230:0:15485:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:0.0:1788869547.507284:0:15485:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff94c701d64d40) 00000020:00000080:0.0:1788869547.507319:0:15485:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type lwp with refcount 2 00000020:01000004:0.0:1788869547.507658:0:15485:0:(tgt_mount.c:153:server_get_mount()) get mount ffff94c810e50000 from lustre-OST0001, refs=3 00000020:01000004:0.0:1788869547.507663:0:15485:0:(tgt_mount.c:187:server_put_mount()) put mount ffff94c810e50000 from lustre-OST0001, refs=3 00000020:01000004:0.0:1788869547.507666:0:15485:0:(obd_mount.c:710:lustre_put_lsi()) put ffff94c810e50000 3 00010000:00080000:0.0:1788869547.507705:0:15485:0:(ldlm_lib.c:102:import_set_conn()) imp ffff94c702f89000@lustre-MDT0000-lwp-OST0001: add connection 192.168.201.139@tcp at head 00010000:00010000:0.0:1788869547.512833:0:15485:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-5 is initialized 00000020:00000080:0.0:1788869547.512973:0:15485:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:0.0:1788869547.513025:0:15485:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1788869547.513044:0:15485:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0x3d2d1916761d76e9 00000100:00080000:0.0:1788869547.513058:0:15485:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1788869547.513066:0:15485:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff94c702f89000 using connection 192.168.201.139@tcp/0@lo 00000100:00100000:0.0:1788869547.513114:0:15485:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff94c83661c000 x1875765421491584/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788869547.513154:0:15485:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00080000:0.0:1788869547.513222:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788869547.513228:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1788869547.513231:0:8:0:(import.c:65:import_set_state_nolock()) ffff94c80f9b5000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788869547.513237:0:8:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 292 00000100:00080000:0.0:1788869547.513240:0:8:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1788869547.513245:0:8:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff94c80f9b5000 using connection 192.168.201.139@tcp/0@lo 00000100:00100000:0.0:1788869547.513280:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff94c83661d500 x1875765421491840/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788869547.513358:0:3283:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94c83661ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3283:1875765421491712:0@lo:400:kworker.0 00000100:00100000:3.0:1788869547.515072:0:3285:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94c83661c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3285:1875765421492096:0@lo:400:kworker.0 00000100:00100000:3.0:1788869547.515174:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869547.515285:0:3284:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94c83661f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3284:1875765421491968:0@lo:400:kworker.0 00000100:00100000:3.0:1788869547.515315:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869547.515348:0:3282:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94c83661c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3282:1875765421491584:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1788869547.515382:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869547.516637:0:3282:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94c83661d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3282:1875765421491840:0@lo:8:kworker.0 00000100:00100000:3.0:1788869547.516692:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869547.516893:0:14170:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765421492096 00000100:00100000:1.0:1788869547.516904:0:14170:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765421492096 00000100:00100000:1.0:1788869547.516976:0:14170:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765421491968 00000100:00100000:1.0:1788869547.516980:0:14170:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765421491968 00000100:00100000:1.0:1788869547.516994:0:14170:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765421491584 00000100:00100000:1.0:1788869547.516997:0:14170:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765421491584 00000100:00100000:1.0:1788869547.517012:0:14170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788869547.517022:0:14170:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c835a15c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3285:x1875765421492096:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788869547.517100:0:14170:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c835a15c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3285:x1875765421492096:12345-0@lo:400:kworker.0 Request processed in 79us (1926us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869547.517108:0:14170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788869547.517126:0:14170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788869547.517132:0:14170:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c835a16680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3284:x1875765421491968:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788869547.517169:0:14170:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c835a16680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3284:x1875765421491968:12345-0@lo:400:kworker.0 Request processed in 37us (1853us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869547.517176:0:14170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788869547.517188:0:14170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788869547.517192:0:14170:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c835a14380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3282:x1875765421491584:12345-0@lo:38:llog_process_th.0 00010000:00080000:1.0:1788869547.517217:0:14170:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 295 last 0 00000020:00000080:1.0:1788869547.517294:0:14170:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0x3d2d1916761d76f0 00000004:00100000:1.0:1788869547.517315:0:14170:0:(mdt_handler.c:7366:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1788869547.517359:0:14170:0:(import.c:65:import_set_state_nolock()) ffff94c82da23000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788869547.517529:0:14170:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c835a14380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3282:x1875765421491584:12345-0@lo:38:llog_process_th.0 Request processed in 333us (2144us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869547.517536:0:14170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788869547.517597:0:14805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765421491840 00000100:00100000:1.0:1788869547.517602:0:14805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765421491840 00000100:00100000:1.0:1788869547.517624:0:14805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788869547.517628:0:14805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c835a16d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3282:x1875765421491840:12345-0@lo:8:kworker.0 00000100:00100000:1.0:1788869547.517669:0:14805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c835a16d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3282:x1875765421491840:12345-0@lo:8:kworker.0 Request processed in 40us (978us total) trans 0 rc -11/-11 00000100:00100000:1.0:1788869547.517676:0:14805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00080000:1.0:1788869547.517706:0:14164:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1788869547.517749:0:3285:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff94c83661c380 x1875765421492096/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788869563 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788869547.517767:0:3285:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94c83661c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3285:1875765421492096:0@lo:400:kworker.0 00010000:00080000:1.0:1788869547.517807:0:3284:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff94c83661f100 x1875765421491968/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788869563 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788869547.517817:0:3284:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94c83661f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3284:1875765421491968:0@lo:400:kworker.0 00000100:00100000:0.0:1788869547.517965:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869547.518015:0:14804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765421491712 00000100:00100000:0.0:1788869547.518020:0:14804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765421491712 00010000:00080000:1.0:1788869547.518075:0:3282:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff94c83661c000 x1875765421491584/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788869557 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788869547.518085:0:3282:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:1.0:1788869547.518094:0:3282:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 2 00000100:00080000:1.0:1788869547.518105:0:3282:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:1.0:1788869547.518112:0:3282:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1788869547.518114:0:3282:0:(import.c:65:import_set_state_nolock()) ffff94c702f89000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1788869547.518120:0:3282:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94c83661c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3282:1875765421491584:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1788869547.518132:0:3282:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1788869547.518136:0:3282:0:(import.c:65:import_set_state_nolock()) ffff94c80f9b5000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788869547.518141:0:3282:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-11) 00000100:00100000:1.0:1788869547.518155:0:3282:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94c83661d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3282:1875765421491840:0@lo:8:kworker.0 00000100:00100000:0.0:1788869547.519021:0:14804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788869547.519036:0:14804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c83661e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3283:x1875765421491712:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788869547.519115:0:14804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c83661e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3283:x1875765421491712:12345-0@lo:400:kworker.0 Request processed in 85us (1151us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869547.519122:0:14804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788869547.519272:0:3283:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94c83661ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3283:1875765421491712:0@lo:400:kworker.0 00000040:00080000:0.0:1788869547.519759:0:15485:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 42 count 42 00000100:00080000:1.0:1788869547.521163:0:14164:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000020:01000000:3.0:1788869547.522385:0:15475:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:3.0:1788869547.522518:0:15475:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.139@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1788869547.522561:0:15475:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.139@tcp lock: ffff94c805038000/0x3d2d1916761d76d4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x3d2d1916761d76db expref: -99 pid: 15475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869547.522577:0:15475:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.139@tcp lock: ffff94c805038000/0x3d2d1916761d76d4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x3d2d1916761d76db expref: -99 pid: 15475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1788869547.522663:0:15475:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:3.0:1788869547.522666:0:15475:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1788869547.522668:0:15475:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788869547.522669:0:15475:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788869547.522671:0:15475:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788869547.522672:0:15475:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788869547.522674:0:15475:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788869547.522676:0:15475:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788869547.522678:0:15475:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1788869547.522683:0:15475:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020002 00000020:01000004:3.0:1788869547.522686:0:15475:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1788869547.522688:0:15475:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1788869547.522689:0:15475:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788869547.522691:0:15475:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788869547.522692:0:15475:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788869547.522693:0:15475:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788869547.522695:0:15475:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788869547.522696:0:15475:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788869547.522697:0:15475:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1788869547.522746:0:15475:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:3.0:1788869547.522793:0:15475:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94c835a17100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cd496ea5-7761-4e68-8a6b-58e98659ad4a:15475:1875765421492224:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1788869547.523038:0:15475:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869547.523533:0:15475:0:(client.c:2702:ptlrpc_set_wait()) set ffff94c80634a6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788869547.525119:0:14161:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765421492224 00000100:00100000:0.0:1788869547.525137:0:14161:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765421492224 00000100:00100000:0.0:1788869547.525207:0:14161:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1788869547.525218:0:14161:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c833d6c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cd496ea5-7761-4e68-8a6b-58e98659ad4a+19:15475:x1875765421492224:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1788869547.525291:0:14161:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:0.0:1788869547.525312:0:14161:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:0.0:1788869547.557130:0:14161:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1788869547.557154:0:14161:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:1.0:1788869547.557216:0:14184:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1788869547.557223:0:14184:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1788869547.557280:0:14184:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff94c83fde7000/0x3d2d1916761d76f7 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869547.557304:0:14184:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff94c83504c400/0x3d2d1916761d75ca lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3d2d1916761d75c3 expref: 19 pid: 14162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869547.557315:0:14184:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff94c83fde7000/0x3d2d1916761d76f7 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869547.557368:0:14184:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff94c83504c400/0x3d2d1916761d75ca lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x3d2d1916761d75c3 expref: 19 pid: 14162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869547.557385:0:14184:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff94c83504c400/0x3d2d1916761d75ca lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x3d2d1916761d75c3 expref: 19 pid: 14162 timeout: 395 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788869547.557416:0:14184:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94c83c68b800 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14184:1875765421492352:0@lo:104: 00000100:00100000:1.0:1788869547.557638:0:14184:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869547.557750:0:14184:0:(client.c:2702:ptlrpc_set_wait()) set ffff94c804e5e600 going to sleep for 11 seconds 00000100:00100000:0.0:1788869547.566077:0:14151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765421492352 00000100:00100000:0.0:1788869547.566099:0:14151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765421492352 00000100:00100000:0.0:1788869547.566197:0:14151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788869547.566212:0:14151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c83c68a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:cd496ea5-7761-4e68-8a6b-58e98659ad4a+3:14184:x1875765421492352:12345-0@lo:104: 00010000:00010000:0.0:1788869547.566237:0:14151:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.139@tcp lock: ffff94c805039c00/0x3d2d1916761d75c3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x3d2d1916761d75ca expref: -99 pid: 14165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788869547.566452:0:14184:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94c83c68b800 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14184:1875765421492352:0@lo:104: 00010000:00010000:0.0:1788869547.566512:0:14184:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff94c83fde7000/0x3d2d1916761d76f7 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869547.566544:0:14151:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788869547.566565:0:14151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c83c68a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:cd496ea5-7761-4e68-8a6b-58e98659ad4a+3:14184:x1875765421492352:12345-0@lo:104: Request processed in 357us (8927us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869547.566573:0:14151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00010000:0.0:1788869547.566598:0:14157:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788869547.566610:0:14157:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.139@tcp lock: ffff94c805039c00/0x3d2d1916761d75c3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x3d2d1916761d75ca expref: -99 pid: 14165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869547.566620:0:14157:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94c805039c00 already unused, calling callback (ffffffffc1ce9c20) 10000000:00010000:0.0:1788869547.566625:0:14157:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.139@tcp lock: ffff94c805039c00/0x3d2d1916761d75c3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x3d2d1916761d75ca expref: -99 pid: 14165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869547.566635:0:14157:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.139@tcp lock: ffff94c805039c00/0x3d2d1916761d75c3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x3d2d1916761d75ca expref: -99 pid: 14165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788869547.566643:0:14157:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.139@tcp lock: ffff94c805039c00/0x3d2d1916761d75c3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x3d2d1916761d75ca expref: -99 pid: 14165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788869547.566649:0:14157:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1788869547.566698:0:14157:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.139@tcp lock: ffff94c805039c00/0x3d2d1916761d75c3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3d2d1916761d75ca expref: -99 pid: 14165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869547.566704:0:14157:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788869547.566733:0:14157:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.139@tcp lock: ffff94c805039c00/0x3d2d1916761d75c3 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3d2d1916761d75ca expref: -99 pid: 14165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869547.566740:0:14157:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.139@tcp lock: ffff94c805039c00/0x3d2d1916761d75c3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3d2d1916761d75ca expref: -99 pid: 14165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869547.566773:0:14157:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788869547.566776:0:14157:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788869547.566777:0:14157:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788869547.566809:0:3286:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94c83661ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:cd496ea5-7761-4e68-8a6b-58e98659ad4a:3286:1875765421492480:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788869547.566868:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869547.566933:0:14154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765421492480 00000100:00100000:0.0:1788869547.566938:0:14154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765421492480 00010000:00010000:0.0:1788869547.566962:0:14154:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff94c83504c400/0x3d2d1916761d75ca lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3d2d1916761d75c3 expref: 20 pid: 14162 timeout: 395 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788869547.566988:0:14154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788869547.566995:0:14154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c83661fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cd496ea5-7761-4e68-8a6b-58e98659ad4a+20:3286:x1875765421492480:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788869547.567008:0:14154:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788869547.567014:0:14154:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff94c83504c400/0x3d2d1916761d75ca lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3d2d1916761d75c3 expref: 20 pid: 14162 timeout: 395 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869547.567026:0:14154:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff94c83504c400/0x3d2d1916761d75ca lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x3d2d1916761d75c3 expref: 20 pid: 14162 timeout: 395 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869547.567045:0:14154:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff94c83504c400/0x3d2d1916761d75ca lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x3d2d1916761d75c3 expref: 20 pid: 14162 timeout: 395 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869547.567060:0:14154:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff94c83fde7000/0x3d2d1916761d76f7 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869547.567071:0:14154:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff94c83fde7000/0x3d2d1916761d76f7 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1788869547.567090:0:14154:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.009868350s 00010000:00010000:0.0:1788869547.567104:0:14154:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff94c83fde7000/0x3d2d1916761d76f7 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869547.567112:0:14154:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff94c83fde7000/0x3d2d1916761d76f7 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869547.567119:0:14154:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff94c83fde7000/0x3d2d1916761d76f7 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869547.567126:0:14154:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff94c83fde7000/0x3d2d1916761d76f7 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869547.567131:0:14154:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94c83fde7000 already unused, calling callback (ffffffffc1703220) 00010000:00010000:0.0:1788869547.567136:0:14154:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff94c83fde7000/0x3d2d1916761d76f7 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869547.567144:0:14154:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff94c83fde7000/0x3d2d1916761d76f7 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869547.567159:0:14154:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff94c83fde7000/0x3d2d1916761d76f7 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869547.567168:0:14154:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788869547.567201:0:14154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c83661fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cd496ea5-7761-4e68-8a6b-58e98659ad4a+19:3286:x1875765421492480:12345-0@lo:103:ldlm_bl.0 Request processed in 207us (333us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869547.567209:0:14154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788869547.567240:0:3286:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94c83661ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:cd496ea5-7761-4e68-8a6b-58e98659ad4a:3286:1875765421492480:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788869547.567288:0:14184:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff94c83fde7000/0x3d2d1916761d76f7 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869547.567296:0:14184:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff94c83fde7000/0x3d2d1916761d76f7 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869547.567309:0:14184:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff94c83fde7000/0x3d2d1916761d76f7 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788869547.586359:0:14161:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c833d6c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cd496ea5-7761-4e68-8a6b-58e98659ad4a+18:15475:x1875765421492224:12345-0@lo:253:mount.lustre.0 Request processed in 61123us (63303us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869547.586400:0:14161:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1788869547.586684:0:15475:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94c835a17100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cd496ea5-7761-4e68-8a6b-58e98659ad4a:15475:1875765421492224:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1788869547.586710:0:15475:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:3.0:1788869547.586714:0:15475:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1788869547.586717:0:15475:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1788869547.586718:0:15475:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788869547.586719:0:15475:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788869547.586721:0:15475:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788869547.586722:0:15475:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788869547.586724:0:15475:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788869547.586726:0:15475:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788869547.586728:0:15475:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:3.0:1788869547.586751:0:15475:0:(tgt_mount.c:2689:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:2.0:1788869547.593195:0:15475:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:2.0:1788869547.593566:0:15475:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:2.0:1788869547.593773:0:15475:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:2.0:1788869547.593905:0:15475:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:2.0:1788869547.594055:0:15475:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:2.0:1788869547.594373:0:15475:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:0.0:1788869547.596779:0:15475:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934592 00010000:00010000:0.0:1788869547.616224:0:15140:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00080000:0.0:1788869547.645119:0:15475:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:0.0:1788869547.645133:0:15475:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:0.0:1788869547.645184:0:15475:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1788869547.645300:0:15475:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.201.139@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1788869547.645322:0:15475:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=49 00000080:00000004:0.0:1788869547.645508:0:15475:0:(super25.c:181:lustre_fill_super()) lustre-ost2/ost2: Mount complete 00010000:00010000:2.0:1788869548.640550:0:14156:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1788869549.405339:0:14165:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1788869549.405347:0:14165:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff94c83f9d2800 from 8 10000000:01000000:0.0:1788869549.405580:0:14165:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1788869549.405629:0:14165:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.139@tcp lock: ffff94c818d1f800/0x3d2d1916761d76fe lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869549.405642:0:14165:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.139@tcp lock: ffff94c818d1f800/0x3d2d1916761d76fe lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869549.405654:0:14165:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.139@tcp lock: ffff94c818d1f800/0x3d2d1916761d76fe lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788869549.405685:0:14165:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94c83661ed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cd496ea5-7761-4e68-8a6b-58e98659ad4a:14165:1875765421492608:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788869549.405761:0:14165:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869549.405818:0:14165:0:(client.c:2702:ptlrpc_set_wait()) set ffff94c835537900 going to sleep for 11 seconds 00000100:00100000:2.0:1788869549.406146:0:14163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765421492608 00000100:00100000:2.0:1788869549.406287:0:14163:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765421492608 00000100:00100000:2.0:1788869549.406354:0:14163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1788869549.406363:0:14163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c833d6d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cd496ea5-7761-4e68-8a6b-58e98659ad4a+18:14165:x1875765421492608:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788869549.406378:0:14163:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788869549.406397:0:14163:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff94c805039000/0x3d2d1916761d7705 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x3d2d1916761d76fe expref: -99 pid: 14163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869549.406421:0:14163:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff94c805039000/0x3d2d1916761d7705 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3d2d1916761d76fe expref: 19 pid: 14163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869549.406431:0:14163:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff94c805039000/0x3d2d1916761d7705 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3d2d1916761d76fe expref: 19 pid: 14163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869549.406440:0:14163:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94c805039000, rc 0) 00000100:00100000:2.0:1788869549.406496:0:14163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c833d6d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cd496ea5-7761-4e68-8a6b-58e98659ad4a+19:14165:x1875765421492608:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 134us (734us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869549.406503:0:14163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1788869549.406568:0:14165:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94c83661ed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cd496ea5-7761-4e68-8a6b-58e98659ad4a:14165:1875765421492608:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788869549.406586:0:14165:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.139@tcp lock: ffff94c818d1f800/0x3d2d1916761d76fe lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3d2d1916761d7705 expref: -99 pid: 14165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869549.406595:0:14165:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.139@tcp lock: ffff94c818d1f800/0x3d2d1916761d76fe lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x3d2d1916761d7705 expref: -99 pid: 14165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788869549.406648:0:14165:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94c835155180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cd496ea5-7761-4e68-8a6b-58e98659ad4a:14165:1875765421492736:0@lo:256:ll_cfg_requeue.0 00000100:00100000:2.0:1788869549.406683:0:14165:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869549.406716:0:14165:0:(client.c:2702:ptlrpc_set_wait()) set ffff94c83cafa900 going to sleep for 11 seconds 00000100:00100000:3.0:1788869549.406726:0:14161:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765421492736 00000100:00100000:3.0:1788869549.406731:0:14161:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765421492736 00000100:00100000:3.0:1788869549.406767:0:14161:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1788869549.406775:0:14161:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c833d6c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cd496ea5-7761-4e68-8a6b-58e98659ad4a+19:14165:x1875765421492736:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:3.0:1788869549.406802:0:14161:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1788869549.406819:0:14161:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1788869549.406822:0:14161:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 8 00000100:00100000:3.0:1788869549.406915:0:14161:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c833d6c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cd496ea5-7761-4e68-8a6b-58e98659ad4a+19:14165:x1875765421492736:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 140us (230us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869549.406922:0:14161:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1788869549.407052:0:14165:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94c835155180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cd496ea5-7761-4e68-8a6b-58e98659ad4a:14165:1875765421492736:0@lo:256:ll_cfg_requeue.0 10000000:01000000:2.0:1788869549.407121:0:14165:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.139@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1788869549.407129:0:14165:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.139@tcp lock: ffff94c818d1f800/0x3d2d1916761d76fe lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3d2d1916761d7705 expref: -99 pid: 14165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869549.407138:0:14165:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.139@tcp lock: ffff94c818d1f800/0x3d2d1916761d76fe lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3d2d1916761d7705 expref: -99 pid: 14165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788869549.665851:0:3283:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94c83c688380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3283:1875765421492864:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788869549.665930:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869549.666006:0:14807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765421492864 00000100:00100000:1.0:1788869549.666014:0:14807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765421492864 00000100:00100000:1.0:1788869549.666062:0:14807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788869549.666070:0:14807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c83c688e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1875765421492864:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788869549.666103:0:14807:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788869549.666151:0:14807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c83c688e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1875765421492864:12345-0@lo:13:osp-pre-0-0.0 Request processed in 82us (221us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869549.666158:0:14807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:1.0:1788869549.666177:0:14164:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788869549.666206:0:3283:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94c83c688380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3283:1875765421492864:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1788869549.666996:0:14157:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788869550.685725:0:15140:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788869551.712417:0:14156:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788869552.734482:0:14157:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1788869552.736348:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788869552.736355:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1788869552.736363:0:8:0:(import.c:65:import_set_state_nolock()) ffff94c80f9b5000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788869552.736374:0:8:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff94c80f9b5000 using connection 192.168.201.139@tcp/0@lo 00000100:00100000:3.0:1788869552.736396:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff94c835a17480 x1875765421493248/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788869552.736481:0:3283:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94c835a15500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3283:1875765421493504:0@lo:400:kworker.0 00000100:00100000:3.0:1788869552.736543:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869552.736598:0:3283:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1788869552.736604:0:3283:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94c835a17100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:cd496ea5-7761-4e68-8a6b-58e98659ad4a:3283:1875765421492992:0@lo:400:kworker.0 00000100:00100000:3.0:1788869552.736633:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869552.736661:0:3283:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94c835a15880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3283:1875765421493632:0@lo:400:kworker.0 00000100:00100000:2.0:1788869552.736671:0:14162:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765421492992 00000100:00100000:2.0:1788869552.736678:0:14162:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765421492992 00000100:00100000:3.0:1788869552.736681:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869552.736703:0:3285:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94c835a14000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3285:1875765421493120:0@lo:400:kworker.0 00000100:00100000:2.0:1788869552.736718:0:14162:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1788869552.736727:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869552.736727:0:14162:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c833d6d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cd496ea5-7761-4e68-8a6b-58e98659ad4a+19:3283:x1875765421492992:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788869552.736745:0:3285:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788869552.736751:0:3285:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94c835a17800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3285:1875765421493376:0@lo:400:kworker.0 00000100:00100000:3.0:1788869552.736769:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869552.736776:0:14162:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c833d6d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cd496ea5-7761-4e68-8a6b-58e98659ad4a+19:3283:x1875765421492992:12345-0@lo:400:kworker.0 Request processed in 51us (142us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869552.736791:0:14162:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1788869552.736793:0:3282:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94c835a17480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3282:1875765421493248:0@lo:8:kworker.0 00000100:00100000:3.0:1788869552.736825:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869552.736868:0:14170:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765421493504 00000100:00100000:3.0:1788869552.736872:0:14170:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765421493504 00000100:00100000:3.0:1788869552.736906:0:14170:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765421493632 00000100:00100000:3.0:1788869552.736909:0:14170:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765421493632 00000100:00100000:3.0:1788869552.736921:0:14170:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765421493376 00000100:00100000:3.0:1788869552.736924:0:14170:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765421493376 00000100:00100000:3.0:1788869552.736937:0:14170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788869552.736943:0:14170:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c835a17b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3283:x1875765421493504:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788869552.736982:0:14170:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c835a17b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3283:x1875765421493504:12345-0@lo:400:kworker.0 Request processed in 39us (438us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869552.736988:0:14170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788869552.737001:0:14170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788869552.737006:0:14170:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c835a14a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3283:x1875765421493632:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788869552.737031:0:14170:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c835a14a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3283:x1875765421493632:12345-0@lo:400:kworker.0 Request processed in 24us (348us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869552.737037:0:14170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788869552.737047:0:14170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1788869552.737052:0:14170:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c8354d1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3285:x1875765421493376:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788869552.737080:0:14170:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c8354d1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3285:x1875765421493376:12345-0@lo:400:kworker.0 Request processed in 28us (309us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869552.737086:0:14170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1788869552.737109:0:14806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765421493120 00000100:00100000:3.0:1788869552.737113:0:14806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765421493120 00000100:00100000:3.0:1788869552.737135:0:14806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765421493248 00000100:00100000:3.0:1788869552.737138:0:14806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765421493248 00000100:00100000:3.0:1788869552.737149:0:14806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788869552.737154:0:14806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c835a16300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3285:x1875765421493120:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788869552.737181:0:14806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c835a16300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3285:x1875765421493120:12345-0@lo:400:kworker.0 Request processed in 27us (453us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869552.737186:0:14806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788869552.737197:0:14806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788869552.737201:0:14806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c8354d3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3282:x1875765421493248:12345-0@lo:8:kworker.0 00010000:00080000:3.0:1788869552.737222:0:14806:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 301 last 0 00000020:00000080:3.0:1788869552.737247:0:14806:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x3d2d1916761d770c 00002000:00100000:3.0:1788869552.737299:0:14806:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff94c8349df000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113718 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:3.0:1788869552.737303:0:14806:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:3.0:1788869552.737306:0:14806:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:3.0:1788869552.737625:0:14806:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1788869552.737648:0:14806:0:(import.c:65:import_set_state_nolock()) ffff94c8349db800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788869552.737687:0:14806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c8354d3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3282:x1875765421493248:12345-0@lo:8:kworker.0 Request processed in 484us (861us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869552.737694:0:14806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00080000:3.0:1788869552.737715:0:14164:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788869552.737719:0:14164:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1788869552.737747:0:3282:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff94c835a17480 x1875765421493248/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788869577 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788869552.737762:0:3282:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 2 00000100:00080000:3.0:1788869552.737769:0:3282:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:3.0:1788869552.737774:0:3282:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:3.0:1788869552.737776:0:3282:0:(import.c:65:import_set_state_nolock()) ffff94c80f9b5000 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:3.0:1788869552.737799:0:3282:0:(osp_dev.c:1705:osp_import_event()) got connected 00000100:00100000:3.0:1788869552.737805:0:3282:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94c835a17480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3282:1875765421493248:0@lo:8:kworker.0 00000040:00080000:3.0:1788869552.737847:0:14192:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x6:0x0] index 9 count 2 00000040:00080000:3.0:1788869552.737980:0:14192:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:3.0:1788869552.737984:0:14192:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xc:0x0] at index 2 of catalog [0x1:0x5:0x0] 00000004:00080000:3.0:1788869552.738109:0:14192:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:3.0:1788869552.738342:0:14192:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 301030091032ns, next at 0ns, rc = 0 00000100:00100000:3.0:1788869552.738362:0:3286:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788869552.738373:0:3286:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94c8354d0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3286:1875765421493760:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1788869552.738405:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:3.0:1788869552.738474:0:3285:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff94c835a17800 x1875765421493376/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788869568 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788869552.738490:0:3285:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94c835a17800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3285:1875765421493376:0@lo:400:kworker.0 00000100:00100000:2.0:1788869552.738510:0:14804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765421493760 00000100:00100000:2.0:1788869552.738515:0:14804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765421493760 00000100:00100000:2.0:1788869552.738548:0:14804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788869552.738556:0:14804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c8354d3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3286:x1875765421493760:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1788869552.738568:0:3285:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94c835a14000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3285:1875765421493120:0@lo:400:kworker.0 00000100:00080000:3.0:1788869552.738590:0:14164:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788869552.738909:0:3283:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94c835a17100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:cd496ea5-7761-4e68-8a6b-58e98659ad4a:3283:1875765421492992:0@lo:400:kworker.0 00010000:00080000:3.0:1788869552.738922:0:3283:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff94c835a15880 x1875765421493632/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788869568 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788869552.738932:0:3283:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94c835a15880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3283:1875765421493632:0@lo:400:kworker.0 00010000:00080000:3.0:1788869552.738941:0:3283:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff94c835a15500 x1875765421493504/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788869568 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788869552.738950:0:3283:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94c835a15500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3283:1875765421493504:0@lo:400:kworker.0 00000004:00080000:0.0:1788869552.739637:0:14193:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x280000400:0x6:0x0] 00000100:00100000:0.0:1788869552.739657:0:14193:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94c83661d180 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14193:1875765421494016:0@lo:5:osp-pre-1-0.0 00000100:00100000:0.0:1788869552.739699:0:14193:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869552.739720:0:14193:0:(client.c:2702:ptlrpc_set_wait()) set ffff94c820d5dc00 going to sleep for 11 seconds 00000100:00100000:0.0:1788869552.739735:0:14805:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:0.0:1788869552.739742:0:14805:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000100:00100000:0.0:1788869552.739820:0:3285:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788869552.739829:0:3285:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94c83661e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3285:1875765421493888:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788869552.739853:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869552.739895:0:14805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765421494016 00000100:00100000:0.0:1788869552.739900:0:14805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765421494016 00000100:00100000:0.0:1788869552.739977:0:15767:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788869552.739985:0:15767:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c83661ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:14193:x1875765421494016:12345-0@lo:5:osp-pre-1-0.0 00000100:00100000:1.0:1788869552.740683:0:14807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765421493888 00000100:00100000:1.0:1788869552.740689:0:14807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765421493888 00000100:00100000:1.0:1788869552.740717:0:14807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788869552.740724:0:14807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c83661ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+8:3285:x1875765421493888:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788869552.740748:0:14807:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788869552.740796:0:14807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c83661ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+8:3285:x1875765421493888:12345-0@lo:13:osp-pre-1-0.0 Request processed in 72us (942us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869552.740803:0:14807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:1.0:1788869552.740835:0:3285:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff94c83661e300 x1875765421493888/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788869568 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788869552.740852:0:3285:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94c83661e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3285:1875765421493888:0@lo:13:osp-pre-1-0.0 00002000:00080000:3.0:1788869552.766594:0:15767:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x280000400 00002000:00080000:3.0:1788869552.766608:0:15767:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = -27 00002000:02000040:3.0:1788869552.766613:0:15767:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000400:7 to 0x280000400:33) 00002000:00010000:3.0:1788869552.783223:0:15767:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788869552.783235:0:15767:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d6e986df/0x3d2d1916761d7713 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869552.783267:0:15767:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x21:0x0].0x0 since=301s v=(0 0) 00010000:00010000:3.0:1788869552.783273:0:15767:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788869552.783749:0:15767:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d6e986df/0x3d2d1916761d7713 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869552.783773:0:15767:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d6e986df/0x3d2d1916761d7713 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869552.783790:0:15767:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d6e986df/0x3d2d1916761d7713 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869552.783798:0:15767:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d6e986df/0x3d2d1916761d7713 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869552.784348:0:15767:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788869552.784363:0:15140:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788869552.784370:0:15140:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d6e986df/0x3d2d1916761d7713 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869552.784908:0:15140:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94c800030e00 already unused, calling callback (ffffffffc1703220) 00010000:00010000:3.0:1788869552.784913:0:15140:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d6e986df/0x3d2d1916761d7713 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869552.784924:0:15140:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d6e986df/0x3d2d1916761d7713 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869552.784942:0:15140:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d6e986df/0x3d2d1916761d7713 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869552.784950:0:15140:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d6e986df/0x3d2d1916761d7713 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869552.784969:0:15140:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788869552.784977:0:15140:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788869552.784979:0:15140:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1788869552.789988:0:5777:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00002000:00010000:3.0:1788869552.795516:0:15767:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788869552.795532:0:15767:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007d856c32/0x3d2d1916761d771a lrc: 3/0,1 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869552.795549:0:15767:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x20:0x0].0x0 since=301s v=(0 0) 00010000:00010000:3.0:1788869552.795555:0:15767:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788869552.795562:0:15767:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007d856c32/0x3d2d1916761d771a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869552.795577:0:15767:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007d856c32/0x3d2d1916761d771a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869552.795588:0:15767:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007d856c32/0x3d2d1916761d771a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869552.795595:0:15767:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007d856c32/0x3d2d1916761d771a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869552.795619:0:15767:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788869552.795634:0:14156:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788869552.795640:0:14156:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007d856c32/0x3d2d1916761d771a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869552.795648:0:14156:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94c800030400 already unused, calling callback (ffffffffc1703220) 00010000:00010000:3.0:1788869552.795653:0:14156:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007d856c32/0x3d2d1916761d771a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869552.795674:0:14156:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007d856c32/0x3d2d1916761d771a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869552.795691:0:14156:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007d856c32/0x3d2d1916761d771a lrc: 1/0,0 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869552.795698:0:14156:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007d856c32/0x3d2d1916761d771a lrc: 0/0,0 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869552.795717:0:14156:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788869552.795719:0:14156:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788869552.795721:0:14156:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788869552.796412:0:15767:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788869552.796419:0:15767:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003aff45d0/0x3d2d1916761d7721 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869552.796429:0:15767:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1f:0x0].0x0 since=301s v=(0 0) 00010000:00010000:3.0:1788869552.796432:0:15767:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788869552.796449:0:15767:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003aff45d0/0x3d2d1916761d7721 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869552.796461:0:15767:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003aff45d0/0x3d2d1916761d7721 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869552.796470:0:15767:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003aff45d0/0x3d2d1916761d7721 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869552.796483:0:15767:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003aff45d0/0x3d2d1916761d7721 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869552.796499:0:15767:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788869552.796509:0:14157:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788869552.796513:0:14157:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003aff45d0/0x3d2d1916761d7721 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869552.796521:0:14157:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94c800030c00 already unused, calling callback (ffffffffc1703220) 00010000:00010000:3.0:1788869552.796525:0:14157:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003aff45d0/0x3d2d1916761d7721 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869552.796534:0:14157:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003aff45d0/0x3d2d1916761d7721 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869552.796544:0:14157:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003aff45d0/0x3d2d1916761d7721 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869552.796551:0:14157:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003aff45d0/0x3d2d1916761d7721 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869552.796564:0:14157:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788869552.796566:0:14157:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788869552.796567:0:14157:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788869552.797052:0:15767:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788869552.797064:0:15767:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009e7de17b/0x3d2d1916761d7728 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869552.797072:0:15767:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1e:0x0].0x0 since=301s v=(0 0) 00010000:00010000:3.0:1788869552.797075:0:15767:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788869552.797079:0:15767:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009e7de17b/0x3d2d1916761d7728 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869552.797089:0:15767:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009e7de17b/0x3d2d1916761d7728 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869552.797097:0:15767:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009e7de17b/0x3d2d1916761d7728 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869552.797105:0:15767:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009e7de17b/0x3d2d1916761d7728 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869552.797119:0:15767:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788869552.797127:0:15140:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788869552.797131:0:15140:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009e7de17b/0x3d2d1916761d7728 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869552.797139:0:15140:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94c800031000 already unused, calling callback (ffffffffc1703220) 00010000:00010000:3.0:1788869552.797143:0:15140:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009e7de17b/0x3d2d1916761d7728 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869552.797151:0:15140:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009e7de17b/0x3d2d1916761d7728 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869552.797167:0:15140:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009e7de17b/0x3d2d1916761d7728 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869552.797174:0:15140:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009e7de17b/0x3d2d1916761d7728 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869552.797189:0:15140:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788869552.797190:0:15140:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788869552.797192:0:15140:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788869552.799568:0:15767:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788869552.799582:0:15767:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006c3853f7/0x3d2d1916761d772f lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869552.799598:0:15767:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1d:0x0].0x0 since=301s v=(0 0) 00010000:00010000:3.0:1788869552.799602:0:15767:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788869552.799609:0:15767:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006c3853f7/0x3d2d1916761d772f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869552.799622:0:15767:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006c3853f7/0x3d2d1916761d772f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869552.799631:0:15767:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006c3853f7/0x3d2d1916761d772f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869552.799640:0:15767:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006c3853f7/0x3d2d1916761d772f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869552.799668:0:15767:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788869552.799679:0:14156:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788869552.799685:0:14156:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006c3853f7/0x3d2d1916761d772f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869552.799692:0:14156:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94c800031400 already unused, calling callback (ffffffffc1703220) 00010000:00010000:3.0:1788869552.799697:0:14156:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006c3853f7/0x3d2d1916761d772f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869552.799705:0:14156:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006c3853f7/0x3d2d1916761d772f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869552.799721:0:14156:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006c3853f7/0x3d2d1916761d772f lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869552.799728:0:14156:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006c3853f7/0x3d2d1916761d772f lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869552.799747:0:14156:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788869552.799749:0:14156:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788869552.799751:0:14156:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1788869552.801602:0:7458:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934593 is committed 00000001:00100000:3.0:1788869552.801618:0:7458:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00002000:00010000:3.0:1788869552.803236:0:15767:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788869552.803247:0:15767:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000996abe03/0x3d2d1916761d7736 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869552.803475:0:15767:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1c:0x0].0x0 since=301s v=(0 0) 00010000:00010000:3.0:1788869552.803479:0:15767:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788869552.803486:0:15767:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000996abe03/0x3d2d1916761d7736 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869552.803500:0:15767:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000996abe03/0x3d2d1916761d7736 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869552.803511:0:15767:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000996abe03/0x3d2d1916761d7736 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869552.803518:0:15767:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000996abe03/0x3d2d1916761d7736 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869552.803537:0:15767:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788869552.803549:0:14157:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788869552.803553:0:14157:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000996abe03/0x3d2d1916761d7736 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869552.803561:0:14157:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94c800030200 already unused, calling callback (ffffffffc1703220) 00010000:00010000:3.0:1788869552.803565:0:14157:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000996abe03/0x3d2d1916761d7736 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869552.803573:0:14157:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000996abe03/0x3d2d1916761d7736 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869552.803598:0:14157:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000996abe03/0x3d2d1916761d7736 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869552.803605:0:14157:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000996abe03/0x3d2d1916761d7736 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869552.803622:0:14157:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788869552.803624:0:14157:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788869552.803626:0:14157:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788869552.803646:0:14804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c8354d3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3286:x1875765421493760:12345-0@lo:2:osp-syn-1-0.0 Request processed in 65086us (65235us total) trans 8589934593 rc 0/0 00000100:00100000:2.0:1788869552.803656:0:14804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000004:00080000:3.0:1788869552.803657:0:3286:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94c8354d0700, transno 8589934593 00000100:00100000:3.0:1788869552.803666:0:3286:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934593 gen 2 00000004:00080000:3.0:1788869552.803672:0:3286:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94c8354d0700/2, rc 0, transno 8589934593 00000100:00100000:3.0:1788869552.803677:0:3286:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94c8354d0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3286:1875765421493760:0@lo:2:osp-syn-1-0.0 00000040:00080000:3.0:1788869552.804833:0:14192:0:(llog_cat.c:403:llog_cat_set_first_idx()) catlog [0x1:0x5:0x0] first idx 1, last_idx 2 00000040:00080000:3.0:1788869552.805574:0:14192:0:(llog_cat_server.c:902:llog_cat_cleanup()) cancel plain log [0x1:0x6:0x0] at index 1 of catalog [0x1:0x5:0x0] 00002000:00010000:3.0:1788869552.806720:0:15767:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788869552.806730:0:15767:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a523839e/0x3d2d1916761d773d lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869552.806748:0:15767:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1b:0x0].0x0 since=301s v=(0 0) 00010000:00010000:3.0:1788869552.806752:0:15767:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788869552.806758:0:15767:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a523839e/0x3d2d1916761d773d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869552.806772:0:15767:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a523839e/0x3d2d1916761d773d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869552.806789:0:15767:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a523839e/0x3d2d1916761d773d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869552.806798:0:15767:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a523839e/0x3d2d1916761d773d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869552.806827:0:15767:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788869552.806838:0:15140:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788869552.807566:0:15140:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a523839e/0x3d2d1916761d773d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869552.807579:0:15140:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94c702256e00 already unused, calling callback (ffffffffc1703220) 00010000:00010000:3.0:1788869552.807584:0:15140:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a523839e/0x3d2d1916761d773d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869552.807593:0:15140:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a523839e/0x3d2d1916761d773d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869552.807611:0:15140:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a523839e/0x3d2d1916761d773d lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869552.807619:0:15140:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a523839e/0x3d2d1916761d773d lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869552.807638:0:15140:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788869552.807647:0:15140:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788869552.807649:0:15140:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788869552.808059:0:15767:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788869552.808068:0:15767:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a4c3e783/0x3d2d1916761d7744 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869552.808078:0:15767:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1a:0x0].0x0 since=301s v=(0 0) 00010000:00010000:2.0:1788869552.808082:0:15767:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788869552.808088:0:15767:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a4c3e783/0x3d2d1916761d7744 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869552.808100:0:15767:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a4c3e783/0x3d2d1916761d7744 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869552.808108:0:15767:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a4c3e783/0x3d2d1916761d7744 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869552.808117:0:15767:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a4c3e783/0x3d2d1916761d7744 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869552.808151:0:15767:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788869552.808503:0:14156:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788869552.808510:0:14156:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a4c3e783/0x3d2d1916761d7744 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869552.808518:0:14156:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94c805039a00 already unused, calling callback (ffffffffc1703220) 00010000:00010000:3.0:1788869552.808522:0:14156:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a4c3e783/0x3d2d1916761d7744 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869552.808530:0:14156:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a4c3e783/0x3d2d1916761d7744 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869552.808543:0:14156:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a4c3e783/0x3d2d1916761d7744 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869552.808551:0:14156:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a4c3e783/0x3d2d1916761d7744 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869552.808565:0:14156:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788869552.808567:0:14156:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788869552.808569:0:14156:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788869552.808639:0:15767:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788869552.808645:0:15767:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e2b6a638/0x3d2d1916761d774b lrc: 3/0,1 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869552.808655:0:15767:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x19:0x0].0x0 since=301s v=(0 0) 00010000:00010000:2.0:1788869552.808658:0:15767:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788869552.808662:0:15767:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e2b6a638/0x3d2d1916761d774b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869552.808672:0:15767:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e2b6a638/0x3d2d1916761d774b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869552.808680:0:15767:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e2b6a638/0x3d2d1916761d774b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869552.808687:0:15767:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e2b6a638/0x3d2d1916761d774b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869552.808709:0:15767:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788869552.808944:0:14157:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788869552.808950:0:14157:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e2b6a638/0x3d2d1916761d774b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869552.808958:0:14157:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94c805038400 already unused, calling callback (ffffffffc1703220) 00010000:00010000:3.0:1788869552.808961:0:14157:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e2b6a638/0x3d2d1916761d774b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869552.808975:0:14157:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e2b6a638/0x3d2d1916761d774b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869552.808986:0:14157:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e2b6a638/0x3d2d1916761d774b lrc: 1/0,0 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869552.808994:0:14157:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e2b6a638/0x3d2d1916761d774b lrc: 0/0,0 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869552.809007:0:14157:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788869552.809009:0:14157:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788869552.809010:0:14157:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788869552.809072:0:15767:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788869552.809079:0:15767:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000674b1d3a/0x3d2d1916761d7752 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869552.809087:0:15767:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18:0x0].0x0 since=301s v=(0 0) 00010000:00010000:2.0:1788869552.809095:0:15767:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788869552.809100:0:15767:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000674b1d3a/0x3d2d1916761d7752 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869552.809109:0:15767:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000674b1d3a/0x3d2d1916761d7752 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869552.809118:0:15767:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000674b1d3a/0x3d2d1916761d7752 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869552.809126:0:15767:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000674b1d3a/0x3d2d1916761d7752 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869552.809147:0:15767:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788869552.809285:0:15140:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788869552.809290:0:15140:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000674b1d3a/0x3d2d1916761d7752 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869552.809298:0:15140:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94c805039400 already unused, calling callback (ffffffffc1703220) 00010000:00010000:3.0:1788869552.809301:0:15140:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000674b1d3a/0x3d2d1916761d7752 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869552.809309:0:15140:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000674b1d3a/0x3d2d1916761d7752 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869552.809319:0:15140:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000674b1d3a/0x3d2d1916761d7752 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869552.809337:0:15140:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000674b1d3a/0x3d2d1916761d7752 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869552.809349:0:15140:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788869552.809351:0:15140:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788869552.809353:0:15140:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788869552.809566:0:15767:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788869552.809572:0:15767:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a1bb1fc7/0x3d2d1916761d7759 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869552.809581:0:15767:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17:0x0].0x0 since=301s v=(0 0) 00010000:00010000:2.0:1788869552.809584:0:15767:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788869552.809589:0:15767:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a1bb1fc7/0x3d2d1916761d7759 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869552.809599:0:15767:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a1bb1fc7/0x3d2d1916761d7759 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869552.809608:0:15767:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a1bb1fc7/0x3d2d1916761d7759 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869552.809621:0:15767:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a1bb1fc7/0x3d2d1916761d7759 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869552.809642:0:15767:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788869552.809940:0:14156:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788869552.809945:0:14156:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a1bb1fc7/0x3d2d1916761d7759 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869552.809952:0:14156:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94c805039600 already unused, calling callback (ffffffffc1703220) 00010000:00010000:3.0:1788869552.809955:0:14156:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a1bb1fc7/0x3d2d1916761d7759 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869552.809963:0:14156:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a1bb1fc7/0x3d2d1916761d7759 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869552.809975:0:14156:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a1bb1fc7/0x3d2d1916761d7759 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869552.809982:0:14156:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a1bb1fc7/0x3d2d1916761d7759 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869552.809995:0:14156:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788869552.809997:0:14156:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788869552.809999:0:14156:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788869552.814798:0:15767:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788869552.814812:0:15767:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000000ecb0b6/0x3d2d1916761d7760 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869552.814829:0:15767:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x16:0x0].0x0 since=301s v=(0 0) 00010000:00010000:3.0:1788869552.814834:0:15767:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788869552.814987:0:15767:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000000ecb0b6/0x3d2d1916761d7760 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869552.815005:0:15767:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000000ecb0b6/0x3d2d1916761d7760 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869552.815016:0:15767:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000000ecb0b6/0x3d2d1916761d7760 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869552.815024:0:15767:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000000ecb0b6/0x3d2d1916761d7760 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869552.815049:0:15767:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788869552.815065:0:14157:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788869552.815071:0:14157:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000000ecb0b6/0x3d2d1916761d7760 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869552.815079:0:14157:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94c702257000 already unused, calling callback (ffffffffc1703220) 00010000:00010000:3.0:1788869552.815083:0:14157:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000000ecb0b6/0x3d2d1916761d7760 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869552.815102:0:14157:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000000ecb0b6/0x3d2d1916761d7760 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869552.815119:0:14157:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000000ecb0b6/0x3d2d1916761d7760 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869552.815126:0:14157:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000000ecb0b6/0x3d2d1916761d7760 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869552.815146:0:14157:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788869552.815148:0:14157:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788869552.815150:0:14157:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788869552.815625:0:15767:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788869552.815632:0:15767:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c32b9986/0x3d2d1916761d7767 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869552.815642:0:15767:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x15:0x0].0x0 since=301s v=(0 0) 00010000:00010000:3.0:1788869552.815645:0:15767:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788869552.815649:0:15767:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c32b9986/0x3d2d1916761d7767 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869552.815659:0:15767:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c32b9986/0x3d2d1916761d7767 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869552.815667:0:15767:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c32b9986/0x3d2d1916761d7767 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869552.815681:0:15767:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c32b9986/0x3d2d1916761d7767 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869552.815697:0:15767:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788869552.815707:0:15140:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788869552.815712:0:15140:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c32b9986/0x3d2d1916761d7767 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869552.815719:0:15140:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94c702256200 already unused, calling callback (ffffffffc1703220) 00010000:00010000:3.0:1788869552.815723:0:15140:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c32b9986/0x3d2d1916761d7767 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869552.815731:0:15140:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c32b9986/0x3d2d1916761d7767 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869552.815742:0:15140:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c32b9986/0x3d2d1916761d7767 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869552.815750:0:15140:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c32b9986/0x3d2d1916761d7767 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869552.815764:0:15140:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788869552.815766:0:15140:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788869552.815767:0:15140:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788869552.817463:0:15767:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788869552.817481:0:15767:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000ab371e4/0x3d2d1916761d776e lrc: 3/0,1 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869552.817496:0:15767:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x14:0x0].0x0 since=301s v=(0 0) 00010000:00010000:3.0:1788869552.817500:0:15767:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788869552.817505:0:15767:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000ab371e4/0x3d2d1916761d776e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869552.817519:0:15767:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000ab371e4/0x3d2d1916761d776e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869552.817529:0:15767:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000ab371e4/0x3d2d1916761d776e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869552.817537:0:15767:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000ab371e4/0x3d2d1916761d776e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869552.817554:0:15767:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788869552.817565:0:14156:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788869552.817570:0:14156:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000ab371e4/0x3d2d1916761d776e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869552.817578:0:14156:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94c702257400 already unused, calling callback (ffffffffc1703220) 00010000:00010000:3.0:1788869552.817583:0:14156:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000ab371e4/0x3d2d1916761d776e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869552.817591:0:14156:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000ab371e4/0x3d2d1916761d776e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869552.817609:0:14156:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000ab371e4/0x3d2d1916761d776e lrc: 1/0,0 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869552.817616:0:14156:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000ab371e4/0x3d2d1916761d776e lrc: 0/0,0 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869552.817633:0:14156:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788869552.817634:0:14156:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788869552.817637:0:14156:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788869552.818043:0:15767:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788869552.818049:0:15767:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000519d6c7/0x3d2d1916761d7775 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869552.818058:0:15767:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x13:0x0].0x0 since=301s v=(0 0) 00010000:00010000:3.0:1788869552.818061:0:15767:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788869552.818065:0:15767:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000519d6c7/0x3d2d1916761d7775 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869552.818074:0:15767:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000519d6c7/0x3d2d1916761d7775 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869552.818082:0:15767:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000519d6c7/0x3d2d1916761d7775 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869552.818089:0:15767:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000519d6c7/0x3d2d1916761d7775 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869552.818123:0:15767:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788869552.818338:0:14157:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788869552.818345:0:14157:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000519d6c7/0x3d2d1916761d7775 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869552.818353:0:14157:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94c702257800 already unused, calling callback (ffffffffc1703220) 00010000:00010000:0.0:1788869552.818357:0:14157:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000519d6c7/0x3d2d1916761d7775 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869552.818365:0:14157:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000519d6c7/0x3d2d1916761d7775 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869552.818379:0:14157:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000519d6c7/0x3d2d1916761d7775 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869552.818396:0:14157:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000519d6c7/0x3d2d1916761d7775 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869552.818411:0:14157:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788869552.818412:0:14157:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788869552.818414:0:14157:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788869552.820520:0:15767:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788869552.820533:0:15767:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004a39e7e2/0x3d2d1916761d777c lrc: 3/0,1 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869552.820549:0:15767:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x12:0x0].0x0 since=301s v=(0 0) 00010000:00010000:3.0:1788869552.820553:0:15767:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788869552.820559:0:15767:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004a39e7e2/0x3d2d1916761d777c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869552.820572:0:15767:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004a39e7e2/0x3d2d1916761d777c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869552.820581:0:15767:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004a39e7e2/0x3d2d1916761d777c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869552.820588:0:15767:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004a39e7e2/0x3d2d1916761d777c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869552.820613:0:15767:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788869552.821380:0:15140:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788869552.821389:0:15140:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004a39e7e2/0x3d2d1916761d777c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869552.821399:0:15140:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94c702256000 already unused, calling callback (ffffffffc1703220) 00010000:00010000:1.0:1788869552.821404:0:15140:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004a39e7e2/0x3d2d1916761d777c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869552.821414:0:15140:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004a39e7e2/0x3d2d1916761d777c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869552.821456:0:15140:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004a39e7e2/0x3d2d1916761d777c lrc: 1/0,0 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869552.821466:0:15140:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004a39e7e2/0x3d2d1916761d777c lrc: 0/0,0 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869552.821485:0:15140:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788869552.821487:0:15140:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788869552.821489:0:15140:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788869552.822587:0:15767:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788869552.822597:0:15767:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000134727b5/0x3d2d1916761d7783 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869552.822609:0:15767:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x11:0x0].0x0 since=301s v=(0 0) 00010000:00010000:2.0:1788869552.822614:0:15767:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788869552.822619:0:15767:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000134727b5/0x3d2d1916761d7783 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869552.822631:0:15767:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000134727b5/0x3d2d1916761d7783 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869552.822640:0:15767:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000134727b5/0x3d2d1916761d7783 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869552.822649:0:15767:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000134727b5/0x3d2d1916761d7783 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869552.822673:0:15767:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788869552.822945:0:14156:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788869552.822951:0:14156:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000134727b5/0x3d2d1916761d7783 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869552.822959:0:14156:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94c805039c00 already unused, calling callback (ffffffffc1703220) 00010000:00010000:3.0:1788869552.822969:0:14156:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000134727b5/0x3d2d1916761d7783 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869552.822978:0:14156:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000134727b5/0x3d2d1916761d7783 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869552.822992:0:14156:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000134727b5/0x3d2d1916761d7783 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869552.822999:0:14156:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000134727b5/0x3d2d1916761d7783 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869552.823015:0:14156:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788869552.823017:0:14156:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788869552.823019:0:14156:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788869552.823101:0:15767:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788869552.823107:0:15767:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000052cb237f/0x3d2d1916761d778a lrc: 3/0,1 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869552.823120:0:15767:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x10:0x0].0x0 since=301s v=(0 0) 00010000:00010000:2.0:1788869552.823123:0:15767:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788869552.823128:0:15767:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000052cb237f/0x3d2d1916761d778a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869552.823137:0:15767:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000052cb237f/0x3d2d1916761d778a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869552.823146:0:15767:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000052cb237f/0x3d2d1916761d778a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869552.823154:0:15767:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000052cb237f/0x3d2d1916761d778a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869552.823176:0:15767:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788869552.823284:0:14157:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788869552.823289:0:14157:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000052cb237f/0x3d2d1916761d778a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869552.823296:0:14157:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94c805038600 already unused, calling callback (ffffffffc1703220) 00010000:00010000:3.0:1788869552.823299:0:14157:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000052cb237f/0x3d2d1916761d778a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869552.823306:0:14157:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000052cb237f/0x3d2d1916761d778a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869552.823316:0:14157:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000052cb237f/0x3d2d1916761d778a lrc: 1/0,0 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869552.823329:0:14157:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000052cb237f/0x3d2d1916761d778a lrc: 0/0,0 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869552.823343:0:14157:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788869552.823345:0:14157:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788869552.823346:0:14157:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788869552.823664:0:15767:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788869552.823671:0:15767:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f4378d24/0x3d2d1916761d7791 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869552.823679:0:15767:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xf:0x0].0x0 since=301s v=(0 0) 00010000:00010000:2.0:1788869552.823682:0:15767:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788869552.823687:0:15767:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f4378d24/0x3d2d1916761d7791 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869552.823696:0:15767:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f4378d24/0x3d2d1916761d7791 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869552.823716:0:15767:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f4378d24/0x3d2d1916761d7791 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869552.823724:0:15767:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f4378d24/0x3d2d1916761d7791 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869552.823747:0:15767:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788869552.823953:0:15140:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788869552.823958:0:15140:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f4378d24/0x3d2d1916761d7791 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869552.823966:0:15140:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94c805038a00 already unused, calling callback (ffffffffc1703220) 00010000:00010000:3.0:1788869552.823970:0:15140:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f4378d24/0x3d2d1916761d7791 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869552.823978:0:15140:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f4378d24/0x3d2d1916761d7791 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869552.823988:0:15140:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f4378d24/0x3d2d1916761d7791 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869552.823995:0:15140:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f4378d24/0x3d2d1916761d7791 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869552.824007:0:15140:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788869552.824008:0:15140:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788869552.824009:0:15140:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788869552.824154:0:15767:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788869552.824161:0:15767:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c7420936/0x3d2d1916761d7798 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869552.824169:0:15767:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xe:0x0].0x0 since=301s v=(0 0) 00010000:00010000:2.0:1788869552.824172:0:15767:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788869552.824177:0:15767:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c7420936/0x3d2d1916761d7798 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869552.824188:0:15767:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c7420936/0x3d2d1916761d7798 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869552.824197:0:15767:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c7420936/0x3d2d1916761d7798 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869552.824206:0:15767:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c7420936/0x3d2d1916761d7798 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869552.824237:0:15767:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788869552.824300:0:14156:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788869552.824305:0:14156:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c7420936/0x3d2d1916761d7798 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869552.824312:0:14156:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94c805038200 already unused, calling callback (ffffffffc1703220) 00010000:00010000:3.0:1788869552.824315:0:14156:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c7420936/0x3d2d1916761d7798 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869552.824322:0:14156:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c7420936/0x3d2d1916761d7798 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869552.824332:0:14156:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c7420936/0x3d2d1916761d7798 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869552.824340:0:14156:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c7420936/0x3d2d1916761d7798 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869552.824354:0:14156:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788869552.824356:0:14156:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788869552.824357:0:14156:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788869552.825090:0:15767:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788869552.825097:0:15767:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ca3c763a/0x3d2d1916761d779f lrc: 3/0,1 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869552.825107:0:15767:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xd:0x0].0x0 since=301s v=(0 0) 00010000:00010000:2.0:1788869552.825111:0:15767:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788869552.825116:0:15767:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ca3c763a/0x3d2d1916761d779f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869552.825126:0:15767:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ca3c763a/0x3d2d1916761d779f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869552.825134:0:15767:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ca3c763a/0x3d2d1916761d779f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869552.825143:0:15767:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ca3c763a/0x3d2d1916761d779f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869552.825165:0:15767:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788869552.825338:0:14157:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788869552.825343:0:14157:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ca3c763a/0x3d2d1916761d779f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869552.825352:0:14157:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94c805038e00 already unused, calling callback (ffffffffc1703220) 00010000:00010000:3.0:1788869552.825356:0:14157:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ca3c763a/0x3d2d1916761d779f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869552.825374:0:14157:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ca3c763a/0x3d2d1916761d779f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869552.825387:0:14157:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ca3c763a/0x3d2d1916761d779f lrc: 1/0,0 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869552.825394:0:14157:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ca3c763a/0x3d2d1916761d779f lrc: 0/0,0 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869552.825407:0:14157:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788869552.825409:0:14157:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788869552.825410:0:14157:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788869552.825711:0:15767:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788869552.825718:0:15767:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d37c5cbf/0x3d2d1916761d77a6 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869552.825727:0:15767:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc:0x0].0x0 since=301s v=(0 0) 00010000:00010000:2.0:1788869552.825734:0:15767:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788869552.825739:0:15767:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d37c5cbf/0x3d2d1916761d77a6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869552.825750:0:15767:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d37c5cbf/0x3d2d1916761d77a6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869552.825759:0:15767:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d37c5cbf/0x3d2d1916761d77a6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869552.825768:0:15767:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d37c5cbf/0x3d2d1916761d77a6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869552.825789:0:15767:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788869552.825950:0:15140:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788869552.825955:0:15140:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d37c5cbf/0x3d2d1916761d77a6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869552.825963:0:15140:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94c805038c00 already unused, calling callback (ffffffffc1703220) 00010000:00010000:3.0:1788869552.825966:0:15140:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d37c5cbf/0x3d2d1916761d77a6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869552.825973:0:15140:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d37c5cbf/0x3d2d1916761d77a6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869552.825984:0:15140:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d37c5cbf/0x3d2d1916761d77a6 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869552.826001:0:15140:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d37c5cbf/0x3d2d1916761d77a6 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869552.826013:0:15140:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788869552.826014:0:15140:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788869552.826016:0:15140:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788869552.826143:0:15767:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788869552.826149:0:15767:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a1bb1fc7/0x3d2d1916761d77ad lrc: 3/0,1 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869552.826158:0:15767:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xb:0x0].0x0 since=301s v=(0 0) 00010000:00010000:2.0:1788869552.826161:0:15767:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788869552.826165:0:15767:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a1bb1fc7/0x3d2d1916761d77ad lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869552.826175:0:15767:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a1bb1fc7/0x3d2d1916761d77ad lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869552.826184:0:15767:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a1bb1fc7/0x3d2d1916761d77ad lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869552.826197:0:15767:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a1bb1fc7/0x3d2d1916761d77ad lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869552.826217:0:15767:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788869552.826286:0:14156:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788869552.826291:0:14156:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a1bb1fc7/0x3d2d1916761d77ad lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869552.826298:0:14156:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94c805039600 already unused, calling callback (ffffffffc1703220) 00010000:00010000:3.0:1788869552.826301:0:14156:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a1bb1fc7/0x3d2d1916761d77ad lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869552.826308:0:14156:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a1bb1fc7/0x3d2d1916761d77ad lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869552.826318:0:14156:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a1bb1fc7/0x3d2d1916761d77ad lrc: 1/0,0 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869552.826335:0:14156:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a1bb1fc7/0x3d2d1916761d77ad lrc: 0/0,0 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869552.826349:0:14156:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788869552.826350:0:14156:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788869552.826352:0:14156:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788869552.827598:0:15767:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788869552.827606:0:15767:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001729661f/0x3d2d1916761d77b4 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869552.827616:0:15767:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xa:0x0].0x0 since=301s v=(0 0) 00010000:00010000:0.0:1788869552.827619:0:15767:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788869552.827624:0:15767:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001729661f/0x3d2d1916761d77b4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869552.827633:0:15767:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001729661f/0x3d2d1916761d77b4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869552.827641:0:15767:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001729661f/0x3d2d1916761d77b4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869552.827647:0:15767:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001729661f/0x3d2d1916761d77b4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869552.827697:0:15767:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1788869552.828070:0:15767:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788869552.828081:0:15767:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002bcd1bb5/0x3d2d1916761d77bb lrc: 3/0,1 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869552.828089:0:15767:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x9:0x0].0x0 since=301s v=(0 0) 00010000:00010000:0.0:1788869552.828092:0:15767:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788869552.828097:0:15767:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002bcd1bb5/0x3d2d1916761d77bb lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869552.828107:0:15767:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002bcd1bb5/0x3d2d1916761d77bb lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869552.828116:0:15767:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002bcd1bb5/0x3d2d1916761d77bb lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869552.828124:0:15767:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002bcd1bb5/0x3d2d1916761d77bb lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869552.828155:0:14157:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788869552.828161:0:14157:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001729661f/0x3d2d1916761d77b4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869552.828169:0:14157:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94c818d1e400 already unused, calling callback (ffffffffc1703220) 00010000:00010000:1.0:1788869552.828173:0:14157:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001729661f/0x3d2d1916761d77b4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869552.828181:0:14157:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001729661f/0x3d2d1916761d77b4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869552.828194:0:14157:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001729661f/0x3d2d1916761d77b4 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869552.828201:0:14157:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001729661f/0x3d2d1916761d77b4 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869552.828228:0:14157:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788869552.828231:0:14157:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002bcd1bb5/0x3d2d1916761d77bb lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869552.828237:0:14157:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94c818d1ee00 already unused, calling callback (ffffffffc1703220) 00010000:00010000:1.0:1788869552.828240:0:14157:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002bcd1bb5/0x3d2d1916761d77bb lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869552.828425:0:14157:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002bcd1bb5/0x3d2d1916761d77bb lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869552.828450:0:14157:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002bcd1bb5/0x3d2d1916761d77bb lrc: 2/0,0 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869552.828547:0:15767:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1788869552.828553:0:15767:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002bcd1bb5/0x3d2d1916761d77bb lrc: 0/0,0 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788869552.828969:0:15767:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788869552.828976:0:15767:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002bff636d/0x3d2d1916761d77c2 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869552.828984:0:15767:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x8:0x0].0x0 since=301s v=(0 0) 00010000:00010000:0.0:1788869552.828988:0:15767:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788869552.828999:0:15767:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002bff636d/0x3d2d1916761d77c2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869552.829009:0:15767:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002bff636d/0x3d2d1916761d77c2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869552.829018:0:15767:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002bff636d/0x3d2d1916761d77c2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869552.829025:0:15767:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002bff636d/0x3d2d1916761d77c2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869552.829041:0:15767:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788869552.829052:0:14156:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788869552.829057:0:14156:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002bff636d/0x3d2d1916761d77c2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869552.829064:0:14156:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94c818d1f000 already unused, calling callback (ffffffffc1703220) 00010000:00010000:0.0:1788869552.829068:0:14156:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002bff636d/0x3d2d1916761d77c2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869552.829075:0:14156:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002bff636d/0x3d2d1916761d77c2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869552.829087:0:14156:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002bff636d/0x3d2d1916761d77c2 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869552.829105:0:14156:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002bff636d/0x3d2d1916761d77c2 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869552.829118:0:14156:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788869552.829119:0:14156:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788869552.829121:0:14156:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788869552.829386:0:15140:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788869552.829672:0:15767:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788869552.829678:0:15767:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000d633537/0x3d2d1916761d77c9 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869552.829687:0:15767:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x7:0x0].0x0 since=301s v=(0 0) 00010000:00010000:0.0:1788869552.829689:0:15767:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788869552.829694:0:15767:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000d633537/0x3d2d1916761d77c9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869552.829703:0:15767:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000d633537/0x3d2d1916761d77c9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869552.829711:0:15767:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000d633537/0x3d2d1916761d77c9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869552.829717:0:15767:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000d633537/0x3d2d1916761d77c9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869552.829771:0:15767:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00080000:0.0:1788869552.829933:0:15767:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0001: after destroy: set last_id to 0x280000400:6 00000100:00100000:0.0:1788869552.830043:0:15767:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c83661ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:14193:x1875765421494016:12345-0@lo:5:osp-pre-1-0.0 Request processed in 90054us (90338us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869552.830053:0:15767:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788869552.830102:0:14193:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94c83661d180 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14193:1875765421494016:0@lo:5:osp-pre-1-0.0 00000004:00080000:0.0:1788869552.830118:0:14193:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x280000400:0x21:0x0] from OST, last_created [0x280000400:0x21:0x0]last_used is [0x280000400:0x6:0x0] 00000100:00100000:0.0:1788869552.830162:0:14193:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94c83661d180 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14193:1875765421494144:0@lo:5:osp-pre-1-0.0 00000100:00100000:0.0:1788869552.830193:0:14193:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869552.830229:0:14193:0:(client.c:2702:ptlrpc_set_wait()) set ffff94c8086be600 going to sleep for 11 seconds 00000100:00100000:0.0:1788869552.830246:0:14805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765421494144 00000100:00100000:0.0:1788869552.830270:0:14805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765421494144 00000100:00100000:0.0:1788869552.830381:0:14805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788869552.830390:0:14805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c83661df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:14193:x1875765421494144:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:0.0:1788869552.830428:0:14805:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x280000400 at 34 00010000:00010000:2.0:1788869552.831397:0:14157:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788869552.831406:0:14157:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000d633537/0x3d2d1916761d77c9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869552.831419:0:14157:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94c818d1fc00 already unused, calling callback (ffffffffc1703220) 00010000:00010000:2.0:1788869552.831424:0:14157:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000d633537/0x3d2d1916761d77c9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869552.831446:0:14157:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000d633537/0x3d2d1916761d77c9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869552.831466:0:14157:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000d633537/0x3d2d1916761d77c9 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869552.831475:0:14157:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000d633537/0x3d2d1916761d77c9 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869552.831495:0:14157:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788869552.831497:0:14157:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788869552.832381:0:14156:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788869552.834397:0:14157:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788869552.837579:0:14805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c83661df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:14193:x1875765421494144:12345-0@lo:5:osp-pre-1-0.0 Request processed in 7183us (7379us total) trans 8589934594 rc 0/0 00000100:00100000:0.0:1788869552.837595:0:14805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788869552.837746:0:14193:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94c83661d180 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14193:1875765421494144:0@lo:5:osp-pre-1-0.0 00000004:00080000:1.0:1788869552.837761:0:14193:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x280000400:0x21:0x0]-[0x280000400:0x41:0x0] 00010000:00010000:1.0:1788869553.758112:0:15140:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1788869553.798172:0:15833:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg139-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:0.0:1788869554.782281:0:14156:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788869554.782500:0:3283:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94c835155180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3283:1875765421494272:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788869554.782569:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869554.782682:0:14807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765421494272 00000100:00100000:2.0:1788869554.782689:0:14807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765421494272 00000100:00100000:2.0:1788869554.782747:0:14807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788869554.782757:0:14807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c83661c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1875765421494272:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788869554.782793:0:14807:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788869554.782837:0:14807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c83661c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1875765421494272:12345-0@lo:13:osp-pre-0-0.0 Request processed in 82us (267us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869554.782844:0:14807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:0.0:1788869554.782912:0:14164:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788869554.782951:0:3283:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94c835155180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3283:1875765421494272:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788869555.678764:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1788869555.678885:0:14163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765413121408 00000100:00100000:2.0:1788869555.678895:0:14163:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765413121408 00000100:00100000:2.0:1788869555.678945:0:14163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 76 00000100:00100000:2.0:1788869555.678951:0:14163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c833d6c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0+-99:2344:x1875765413121408:12345-192.168.201.39@tcp:250:mount.lustre.0 00010000:00080000:2.0:1788869555.678977:0:14163:0:(ldlm_lib.c:1445:target_handle_connect()) MGS: connection from 027d934b-b9c0-4e83-b9af-2634761ebef6@192.168.201.39@tcp t0 exp 0000000000000000 cur 303 last 0 00000020:00000080:2.0:1788869555.678998:0:14163:0:(genops.c:1406:class_connect()) connect: client 027d934b-b9c0-4e83-b9af-2634761ebef6, cookie 0x3d2d1916761d77d0 00000100:00080000:2.0:1788869555.679111:0:14163:0:(import.c:65:import_set_state_nolock()) ffff94c7028d7000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788869555.679175:0:14163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c833d6c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:027d934b-b9c0-4e83-b9af-2634761ebef6+5:2344:x1875765413121408:12345-192.168.201.39@tcp:250:mount.lustre.0 Request processed in 222us (422us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869555.679181:0:14163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 76 00000100:00100000:2.0:1788869555.694647:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1788869555.694998:0:14161:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765413121536 00000100:00100000:3.0:1788869555.695009:0:14161:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765413121536 00000100:00100000:3.0:1788869555.695105:0:14161:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 77 00000100:00100000:3.0:1788869555.695116:0:14161:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c833d6f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:027d934b-b9c0-4e83-b9af-2634761ebef6+5:13660:x1875765413121536:12345-192.168.201.39@tcp:101:mount.lustre.0 00010000:00010000:3.0:1788869555.695133:0:14161:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788869555.695151:0:14161:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff94c702256200/0x3d2d1916761d77d7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x375c010249035c0d expref: -99 pid: 14161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869555.695191:0:14161:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff94c702256200/0x3d2d1916761d77d7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.201.39@tcp remote: 0x375c010249035c0d expref: 6 pid: 14161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869555.695203:0:14161:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff94c702256200/0x3d2d1916761d77d7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.201.39@tcp remote: 0x375c010249035c0d expref: 6 pid: 14161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869555.695213:0:14161:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94c702256200, rc 0) 00000100:00100000:3.0:1788869555.695393:0:14161:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c833d6f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:027d934b-b9c0-4e83-b9af-2634761ebef6+6:13660:x1875765413121536:12345-192.168.201.39@tcp:101:mount.lustre.0 Request processed in 278us (755us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869555.695401:0:14161:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 77 00000100:00100000:3.0:1788869555.700759:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1788869555.701577:0:14162:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765413121664 00000100:00100000:1.0:1788869555.701588:0:14162:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765413121664 00000100:00100000:1.0:1788869555.701754:0:14162:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 78 00000100:00100000:1.0:1788869555.701766:0:14162:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c833d6cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:027d934b-b9c0-4e83-b9af-2634761ebef6+6:13660:x1875765413121664:12345-192.168.201.39@tcp:501:mount.lustre.0 00000100:00100000:1.0:1788869555.702045:0:14162:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c833d6cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:027d934b-b9c0-4e83-b9af-2634761ebef6+6:13660:x1875765413121664:12345-192.168.201.39@tcp:501:mount.lustre.0 Request processed in 281us (1303us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788869555.702060:0:14162:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 78 00000100:00100000:0.0:1788869555.704014:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1788869555.704110:0:14161:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765413121792 00000100:00100000:3.0:1788869555.704119:0:14161:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765413121792 00000100:00100000:3.0:1788869555.704512:0:14161:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 79 00000100:00100000:3.0:1788869555.704524:0:14161:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c833d6e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:027d934b-b9c0-4e83-b9af-2634761ebef6+6:13660:x1875765413121792:12345-192.168.201.39@tcp:101:mount.lustre.0 00010000:00010000:3.0:1788869555.704541:0:14161:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788869555.704559:0:14161:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff94c702257400/0x3d2d1916761d77de lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x375c010249035c14 expref: -99 pid: 14161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869555.704710:0:14161:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff94c702257400/0x3d2d1916761d77de lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.201.39@tcp remote: 0x375c010249035c14 expref: 7 pid: 14161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869555.704725:0:14161:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff94c702257400/0x3d2d1916761d77de lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.201.39@tcp remote: 0x375c010249035c14 expref: 7 pid: 14161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869555.704735:0:14161:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94c702257400, rc 0) 00000100:00100000:3.0:1788869555.704857:0:14161:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c833d6e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:027d934b-b9c0-4e83-b9af-2634761ebef6+7:13660:x1875765413121792:12345-192.168.201.39@tcp:101:mount.lustre.0 Request processed in 336us (852us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869555.704865:0:14161:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 79 00000100:00100000:3.0:1788869555.708021:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1788869555.708673:0:14162:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765413121920 00000100:00100000:1.0:1788869555.708684:0:14162:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765413121920 00000100:00100000:1.0:1788869555.708894:0:14162:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 80 00000100:00100000:1.0:1788869555.708906:0:14162:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c83553f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:027d934b-b9c0-4e83-b9af-2634761ebef6+7:13660:x1875765413121920:12345-192.168.201.39@tcp:501:mount.lustre.0 00000100:00100000:1.0:1788869555.709233:0:14162:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c83553f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:027d934b-b9c0-4e83-b9af-2634761ebef6+8:13660:x1875765413121920:12345-192.168.201.39@tcp:501:mount.lustre.0 Request processed in 329us (1221us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869555.709242:0:14162:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 80 00000100:00100000:1.0:1788869555.711462:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1788869555.711874:0:14163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765413122048 00000100:00100000:2.0:1788869555.711883:0:14163:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765413122048 00000100:00100000:2.0:1788869555.711986:0:14163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 81 00000100:00100000:2.0:1788869555.711998:0:14163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c83553f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:027d934b-b9c0-4e83-b9af-2634761ebef6+8:13660:x1875765413122048:12345-192.168.201.39@tcp:503:mount.lustre.0 00000100:00100000:2.0:1788869555.712474:0:14163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c83553f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:027d934b-b9c0-4e83-b9af-2634761ebef6+8:13660:x1875765413122048:12345-192.168.201.39@tcp:503:mount.lustre.0 Request processed in 477us (1018us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869555.712483:0:14163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 81 00000100:00100000:0.0:1788869555.715935:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1788869555.716014:0:14162:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765413122176 00000100:00100000:1.0:1788869555.716024:0:14162:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765413122176 00000100:00100000:1.0:1788869555.716079:0:14162:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 82 00000100:00100000:1.0:1788869555.716090:0:14162:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c83553dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:027d934b-b9c0-4e83-b9af-2634761ebef6+8:13679:x1875765413122176:12345-192.168.201.39@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788869555.716578:0:14162:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c83553dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:027d934b-b9c0-4e83-b9af-2634761ebef6+8:13679:x1875765413122176:12345-192.168.201.39@tcp:502:llog_process_th.0 Request processed in 489us (651us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869555.716587:0:14162:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 82 00000100:00100000:0.0:1788869555.729714:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1788869555.729968:0:14163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765413122304 00000100:00100000:2.0:1788869555.729978:0:14163:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765413122304 00000100:00100000:2.0:1788869555.730030:0:14163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 83 00000100:00100000:2.0:1788869555.730038:0:14163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c83553f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:027d934b-b9c0-4e83-b9af-2634761ebef6+8:13679:x1875765413122304:12345-192.168.201.39@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788869555.730439:0:14163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c83553f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:027d934b-b9c0-4e83-b9af-2634761ebef6+8:13679:x1875765413122304:12345-192.168.201.39@tcp:502:llog_process_th.0 Request processed in 401us (736us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869555.730446:0:14163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 83 00000100:00100000:0.0:1788869555.737210:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1788869555.737285:0:14161:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765413122432 00000100:00100000:3.0:1788869555.737294:0:14161:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765413122432 00000100:00100000:3.0:1788869555.737336:0:14161:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 84 00000100:00100000:3.0:1788869555.737345:0:14161:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c83553ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:027d934b-b9c0-4e83-b9af-2634761ebef6+8:13660:x1875765413122432:12345-192.168.201.39@tcp:101:mount.lustre.0 00010000:00010000:3.0:1788869555.737363:0:14161:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788869555.737391:0:14161:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff94c702257000/0x3d2d1916761d77e5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x375c010249035c3e expref: -99 pid: 14161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869555.737425:0:14161:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff94c702257000/0x3d2d1916761d77e5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.201.39@tcp remote: 0x375c010249035c3e expref: 9 pid: 14161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869555.737435:0:14161:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff94c702257000/0x3d2d1916761d77e5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.201.39@tcp remote: 0x375c010249035c3e expref: 9 pid: 14161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869555.737442:0:14161:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94c702257000, rc 0) 00000100:00100000:3.0:1788869555.737494:0:14161:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c83553ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:027d934b-b9c0-4e83-b9af-2634761ebef6+9:13660:x1875765413122432:12345-192.168.201.39@tcp:101:mount.lustre.0 Request processed in 151us (293us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869555.737510:0:14161:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 84 00000100:00100000:0.0:1788869555.748320:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1788869555.751490:0:14162:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765413122560 00000100:00100000:1.0:1788869555.751503:0:14162:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765413122560 00000100:00100000:1.0:1788869555.751565:0:14162:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 85 00000100:00100000:1.0:1788869555.751576:0:14162:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c83553e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:027d934b-b9c0-4e83-b9af-2634761ebef6+9:13660:x1875765413122560:12345-192.168.201.39@tcp:256:mount.lustre.0 20000000:01000000:1.0:1788869555.751608:0:14162:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:1.0:1788869555.751631:0:14162:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:1.0:1788869555.751635:0:14162:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:1.0:1788869555.751638:0:14162:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:1.0:1788869555.751640:0:14162:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 8 00000100:00100000:1.0:1788869555.754498:0:14162:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c83553e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:027d934b-b9c0-4e83-b9af-2634761ebef6+9:13660:x1875765413122560:12345-192.168.201.39@tcp:256:mount.lustre.0 Request processed in 2915us (6179us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869555.754512:0:14162:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 85 00000100:00100000:0.0:1788869555.759009:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1788869555.759129:0:14163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765413122688 00000100:00100000:2.0:1788869555.759139:0:14163:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765413122688 00000100:00100000:2.0:1788869555.759233:0:14163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 86 00000100:00100000:2.0:1788869555.759244:0:14163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c83553e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:027d934b-b9c0-4e83-b9af-2634761ebef6+9:13660:x1875765413122688:12345-192.168.201.39@tcp:101:mount.lustre.0 00010000:00010000:2.0:1788869555.759352:0:14163:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788869555.759373:0:14163:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff94c805039400/0x3d2d1916761d77ec lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x375c010249035c45 expref: -99 pid: 14163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869555.759411:0:14163:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff94c805039400/0x3d2d1916761d77ec lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.201.39@tcp remote: 0x375c010249035c45 expref: 10 pid: 14163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869555.759422:0:14163:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff94c805039400/0x3d2d1916761d77ec lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.201.39@tcp remote: 0x375c010249035c45 expref: 10 pid: 14163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869555.759432:0:14163:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94c805039400, rc 0) 00000100:00100000:2.0:1788869555.759489:0:14163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c83553e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:027d934b-b9c0-4e83-b9af-2634761ebef6+10:13660:x1875765413122688:12345-192.168.201.39@tcp:101:mount.lustre.0 Request processed in 246us (487us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869555.759496:0:14163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 86 00000100:00100000:0.0:1788869555.761187:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1788869555.761447:0:14162:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765413122816 00000100:00100000:1.0:1788869555.761454:0:14162:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765413122816 00000100:00100000:1.0:1788869555.761535:0:14162:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 87 00000100:00100000:1.0:1788869555.761544:0:14162:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c83553d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:027d934b-b9c0-4e83-b9af-2634761ebef6+10:13660:x1875765413122816:12345-192.168.201.39@tcp:501:mount.lustre.0 00000100:00100000:1.0:1788869555.761828:0:14162:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c83553d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:027d934b-b9c0-4e83-b9af-2634761ebef6+10:13660:x1875765413122816:12345-192.168.201.39@tcp:501:mount.lustre.0 Request processed in 285us (645us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869555.761836:0:14162:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 87 00000100:00100000:0.0:1788869555.763816:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1788869555.763908:0:14163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765413122944 00000100:00100000:2.0:1788869555.763916:0:14163:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765413122944 00000100:00100000:2.0:1788869555.764002:0:14163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 88 00000100:00100000:2.0:1788869555.764011:0:14163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c83553c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:027d934b-b9c0-4e83-b9af-2634761ebef6+10:13660:x1875765413122944:12345-192.168.201.39@tcp:503:mount.lustre.0 00000100:00100000:2.0:1788869555.764201:0:14163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c83553c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:027d934b-b9c0-4e83-b9af-2634761ebef6+10:13660:x1875765413122944:12345-192.168.201.39@tcp:503:mount.lustre.0 Request processed in 190us (392us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869555.764209:0:14163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 88 00000100:00100000:0.0:1788869555.772346:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1788869555.772903:0:14162:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765413123072 00000100:00100000:1.0:1788869555.772914:0:14162:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765413123072 00000100:00100000:1.0:1788869555.772974:0:14162:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 89 00000100:00100000:1.0:1788869555.772984:0:14162:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c83553d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:027d934b-b9c0-4e83-b9af-2634761ebef6+10:13682:x1875765413123072:12345-192.168.201.39@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788869555.773284:0:14162:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c83553d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:027d934b-b9c0-4e83-b9af-2634761ebef6+10:13682:x1875765413123072:12345-192.168.201.39@tcp:502:llog_process_th.0 Request processed in 299us (952us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869555.773294:0:14162:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 89 00000100:00100000:0.0:1788869555.786849:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1788869555.789614:0:14163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765413123200 00000100:00100000:2.0:1788869555.789628:0:14163:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765413123200 00000100:00100000:2.0:1788869555.789685:0:14163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 90 00000100:00100000:2.0:1788869555.789697:0:14163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c83553c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:027d934b-b9c0-4e83-b9af-2634761ebef6+10:13682:x1875765413123200:12345-192.168.201.39@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788869555.789925:0:14163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c83553c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:027d934b-b9c0-4e83-b9af-2634761ebef6+10:13682:x1875765413123200:12345-192.168.201.39@tcp:502:llog_process_th.0 Request processed in 229us (3087us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869555.789934:0:14163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 90 00000100:00100000:0.0:1788869555.796778:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1788869555.797098:0:14170:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765413123328 00000100:00100000:3.0:1788869555.797108:0:14170:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765413123328 00000100:00100000:3.0:1788869555.797165:0:14170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 4 00000100:00100000:3.0:1788869555.797174:0:14170:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c83661f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2344:x1875765413123328:12345-192.168.201.39@tcp:38:mount.lustre.0 00010000:00080000:3.0:1788869555.797203:0:14170:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0000: connection from 8eec8521-73a5-4f2d-941c-80b702633766@192.168.201.39@tcp t0 exp 0000000000000000 cur 304 last 0 00000020:00000080:3.0:1788869555.797770:0:14170:0:(genops.c:1406:class_connect()) connect: client 8eec8521-73a5-4f2d-941c-80b702633766, cookie 0x3d2d1916761d77f3 00000004:00100000:3.0:1788869555.797801:0:14170:0:(mdt_handler.c:7362:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000001:00000004:3.0:1788869555.797808:0:14170:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934592 00010000:00010000:0.0:1788869555.803466:0:14157:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1788869555.826734:0:14170:0:(import.c:65:import_set_state_nolock()) ffff94c8349dc000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788869555.826869:0:14170:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c83661f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8eec8521-73a5-4f2d-941c-80b702633766+6:2344:x1875765413123328:12345-192.168.201.39@tcp:38:mount.lustre.0 Request processed in 29692us (30099us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869555.826882:0:14170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 4 00000100:00100000:0.0:1788869555.830474:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1788869555.830517:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1788869555.830702:0:15030:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765413123456 00000100:00100000:1.0:1788869555.830714:0:15030:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765413123456 00000100:00080000:0.0:1788869555.830829:0:14164:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788869555.830903:0:15030:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765413123584 00000100:00100000:1.0:1788869555.830907:0:15030:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765413123584 00000100:00100000:1.0:1788869555.830942:0:15030:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 5 00000100:00100000:1.0:1788869555.830953:0:15030:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c83661ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8eec8521-73a5-4f2d-941c-80b702633766+7:0:x1875765413123456:12345-192.168.201.39@tcp:41:mount.lustre.0 00000004:00000024:1.0:1788869555.830999:0:15030:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:1.0:1788869555.831095:0:15030:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c83661ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8eec8521-73a5-4f2d-941c-80b702633766+7:0:x1875765413123456:12345-192.168.201.39@tcp:41:mount.lustre.0 Request processed in 143us (856us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869555.831121:0:15030:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 5 00000100:00100000:1.0:1788869555.831140:0:15030:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 6 00000100:00100000:1.0:1788869555.831147:0:15030:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c83661e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8eec8521-73a5-4f2d-941c-80b702633766+6:13660:x1875765413123584:12345-192.168.201.39@tcp:41:mount.lustre.0 00000004:00000024:1.0:1788869555.831159:0:15030:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:1.0:1788869555.831182:0:15030:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c83661e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8eec8521-73a5-4f2d-941c-80b702633766+6:13660:x1875765413123584:12345-192.168.201.39@tcp:41:mount.lustre.0 Request processed in 36us (664us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869555.831190:0:15030:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 6 00000100:00100000:0.0:1788869555.838811:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1788869555.838934:0:15030:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765413123712 00000100:00100000:1.0:1788869555.838943:0:15030:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765413123712 00000100:00100000:1.0:1788869555.839033:0:15030:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 7 00000100:00100000:1.0:1788869555.839044:0:15030:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c83661ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8eec8521-73a5-4f2d-941c-80b702633766+6:13660:x1875765413123712:12345-192.168.201.39@tcp:40:mount.lustre.0 00000100:00100000:1.0:1788869555.839189:0:15030:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c83661ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8eec8521-73a5-4f2d-941c-80b702633766+6:13660:x1875765413123712:12345-192.168.201.39@tcp:40:mount.lustre.0 Request processed in 146us (387us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869555.839196:0:15030:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 7 00000100:00100000:1.0:1788869555.841046:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1788869555.841151:0:14804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765413123840 00000100:00100000:2.0:1788869555.841159:0:14804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765413123840 00000100:00100000:3.0:1788869555.841663:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1788869555.841920:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1788869555.842048:0:14804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765413123968 00000100:00100000:2.0:1788869555.842053:0:14804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765413123968 00000100:00100000:2.0:1788869555.842091:0:14804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 10 00000100:00100000:2.0:1788869555.842099:0:14804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c83c688380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2344:x1875765413123840:12345-192.168.201.39@tcp:8:mount.lustre.0 00010000:00080000:2.0:1788869555.842131:0:14804:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0000: connection from 8eec8521-73a5-4f2d-941c-80b702633766@192.168.201.39@tcp t0 exp 0000000000000000 cur 304 last 0 00000020:00000080:2.0:1788869555.842160:0:14804:0:(genops.c:1406:class_connect()) connect: client 8eec8521-73a5-4f2d-941c-80b702633766, cookie 0x3d2d1916761d77fa 00002000:00100000:2.0:1788869555.842172:0:14804:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 8eec8521-73a5-4f2d-941c-80b702633766/ffff94c7028d0000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113718 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1788869555.842184:0:14804:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:2.0:1788869555.842677:0:14804:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1788869555.842710:0:14804:0:(import.c:65:import_set_state_nolock()) ffff94c7028d7800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788869555.842773:0:14804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c83c688380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8eec8521-73a5-4f2d-941c-80b702633766+6:2344:x1875765413123840:12345-192.168.201.39@tcp:8:mount.lustre.0 Request processed in 673us (1734us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869555.842794:0:14804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 10 00000100:00100000:2.0:1788869555.842811:0:14804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 11 00000100:00100000:2.0:1788869555.842817:0:14804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c8354d0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2344:x1875765413123968:12345-192.168.201.39@tcp:8:mount.lustre.0 00010000:00080000:2.0:1788869555.842835:0:14804:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0001: connection from 8eec8521-73a5-4f2d-941c-80b702633766@192.168.201.39@tcp t0 exp 0000000000000000 cur 304 last 0 00000020:00000080:2.0:1788869555.842852:0:14804:0:(genops.c:1406:class_connect()) connect: client 8eec8521-73a5-4f2d-941c-80b702633766, cookie 0x3d2d1916761d7801 00002000:00100000:2.0:1788869555.842858:0:14804:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 8eec8521-73a5-4f2d-941c-80b702633766/ffff94c7028d4000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113718 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1788869555.842876:0:14804:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:2.0:1788869555.842988:0:14804:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1788869555.843004:0:14804:0:(import.c:65:import_set_state_nolock()) ffff94c7028d3800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788869555.843028:0:14804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c8354d0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8eec8521-73a5-4f2d-941c-80b702633766+6:2344:x1875765413123968:12345-192.168.201.39@tcp:8:mount.lustre.0 Request processed in 210us (1367us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869555.843034:0:14804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 11 00000100:00100000:1.0:1788869555.843736:0:14171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765413124096 00000100:00100000:1.0:1788869555.843746:0:14171:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765413124096 00000100:00100000:1.0:1788869555.843784:0:14171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 0 00000100:00100000:1.0:1788869555.843791:0:14171:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c8354d1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8eec8521-73a5-4f2d-941c-80b702633766+6:13660:x1875765413124096:12345-192.168.201.39@tcp:33:mount.lustre.0 00000004:00080000:0.0:1788869555.845548:0:14171:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 1696us 00000004:00200000:1.0:1788869555.861962:0:14171:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000100:00100000:1.0:1788869555.862119:0:14171:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c8354d1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8eec8521-73a5-4f2d-941c-80b702633766+6:13660:x1875765413124096:12345-192.168.201.39@tcp:33:mount.lustre.0 Request processed in 18320us (20191us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869555.862131:0:14171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 0 00000100:00100000:3.0:1788869556.012692:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1788869556.012805:0:14168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765413124224 00000100:00100000:2.0:1788869556.012817:0:14168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765413124224 00000100:00100000:2.0:1788869556.012921:0:14168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 8 00000100:00100000:2.0:1788869556.012933:0:14168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c8354d1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8eec8521-73a5-4f2d-941c-80b702633766+6:13703:x1875765413124224:12345-192.168.201.39@tcp:101:mkdir.0 00010000:00010000:2.0:1788869556.012952:0:14168:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788869556.012978:0:14168:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94c805038e00/0x3d2d1916761d7808 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x375c010249035c6f expref: -99 pid: 14168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869556.013047:0:14168:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94c805038200/0x3d2d1916761d780f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869556.013060:0:14168:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94c805038200/0x3d2d1916761d780f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869556.013091:0:14168:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94c805038200/0x3d2d1916761d780f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14168 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788869556.013324:0:14168:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:2.0:1788869556.013329:0:14168:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 3 stripe count 1 MDT count 1 00000004:00010000:2.0:1788869556.013437:0:14168:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff94c805038200/0x3d2d1916761d780f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869556.013467:0:14168:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94c805038e00/0x3d2d1916761d7808 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0x375c010249035c6f expref: 8 pid: 14168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869556.013485:0:14168:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94c805038200/0x3d2d1916761d780f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0x375c010249035c6f expref: 7 pid: 14168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869556.013494:0:14168:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff94c802db2100) 00010000:00010000:2.0:1788869556.013497:0:14168:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788869556.013501:0:14168:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94c805038200, rc 0) 00000100:00100000:2.0:1788869556.013571:0:14168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c8354d1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8eec8521-73a5-4f2d-941c-80b702633766+7:13703:x1875765413124224:12345-192.168.201.39@tcp:101:mkdir.0 Request processed in 641us (888us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869556.013578:0:14168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 8 00000040:00080000:2.0:1788869556.444117:0:14201:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1788869556.835714:0:15140:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1788869556.872317:0:6571:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 8eec8521-73a5-4f2d-941c-80b702633766 00000100:00100000:1.0:1788869557.840395:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1788869557.840537:0:14170:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765413124352 00000100:00100000:0.0:1788869557.840549:0:14170:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765413124352 00000100:00100000:1.0:1788869557.840750:0:15030:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 9 00000100:00100000:1.0:1788869557.840762:0:15030:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c83c688700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8eec8521-73a5-4f2d-941c-80b702633766+7:13755:x1875765413124352:12345-192.168.201.39@tcp:41:lfs.0 00000004:00000024:1.0:1788869557.840807:0:15030:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:1.0:1788869557.840898:0:15030:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c83c688700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8eec8521-73a5-4f2d-941c-80b702633766+7:13755:x1875765413124352:12345-192.168.201.39@tcp:41:lfs.0 Request processed in 138us (512us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869557.840906:0:15030:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 9 00000100:00080000:3.0:1788869557.842816:0:14164:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788869557.848988:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1788869557.849135:0:14807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765413124480 00000100:00100000:2.0:1788869557.849145:0:14807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765413124480 00000100:00100000:2.0:1788869557.849220:0:14807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 5 00000100:00100000:2.0:1788869557.849230:0:14807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c83661d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:8eec8521-73a5-4f2d-941c-80b702633766+5:13755:x1875765413124480:12345-192.168.201.39@tcp:13:lfs.0 00002000:00000024:2.0:1788869557.849293:0:14807:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788869557.849397:0:14807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c83661d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:8eec8521-73a5-4f2d-941c-80b702633766+5:13755:x1875765413124480:12345-192.168.201.39@tcp:13:lfs.0 Request processed in 168us (416us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869557.849405:0:14807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 5 00000100:00080000:3.0:1788869557.849465:0:14164:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1788869557.851546:0:14156:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788869557.851875:0:3283:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788869557.851896:0:3283:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94c83661c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3283:1875765421494400:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788869557.851955:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869557.855009:0:3286:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94c835157480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3286:1875765421494656:0@lo:400:kworker.0 00000100:00100000:2.0:1788869557.855071:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869557.855105:0:3286:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:2.0:1788869557.855118:0:3286:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94c835155f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:cd496ea5-7761-4e68-8a6b-58e98659ad4a:3286:1875765421494528:0@lo:400:kworker.0 00000100:00100000:2.0:1788869557.855146:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869557.855174:0:3286:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94c835156a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3286:1875765421495040:0@lo:400:kworker.0 00000100:00100000:2.0:1788869557.855203:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869557.855229:0:3284:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94c835156300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3284:1875765421494912:0@lo:400:kworker.0 00000100:00100000:2.0:1788869557.855286:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869557.855307:0:3284:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788869557.855313:0:3284:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94c835155880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3284:1875765421494784:0@lo:400:kworker.0 00000100:00100000:2.0:1788869557.855349:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869557.855381:0:14804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765421494656 00000100:00100000:2.0:1788869557.855388:0:14804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765421494656 00000100:00100000:2.0:1788869557.855441:0:14804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788869557.855451:0:14804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c835154a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3286:x1875765421494656:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788869557.855501:0:14804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c835154a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3286:x1875765421494656:12345-0@lo:400:kworker.0 Request processed in 51us (429us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869557.855509:0:14804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788869557.855532:0:14161:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765421494528 00000100:00100000:2.0:1788869557.855536:0:14161:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765421494528 00000100:00100000:2.0:1788869557.855560:0:14161:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:2.0:1788869557.855567:0:14161:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c8225f0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cd496ea5-7761-4e68-8a6b-58e98659ad4a+19:3286:x1875765421494528:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788869557.855615:0:14161:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c8225f0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cd496ea5-7761-4e68-8a6b-58e98659ad4a+19:3286:x1875765421494528:12345-0@lo:400:kworker.0 Request processed in 48us (467us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869557.855623:0:14161:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:2.0:1788869557.855650:0:14169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765421495040 00000100:00100000:2.0:1788869557.855654:0:14169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765421495040 00000100:00100000:2.0:1788869557.855677:0:14169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765421494912 00000100:00100000:2.0:1788869557.855680:0:14169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765421494912 00000100:00100000:2.0:1788869557.855693:0:14169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765421494784 00000100:00100000:2.0:1788869557.855695:0:14169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765421494784 00000100:00100000:2.0:1788869557.855707:0:14169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788869557.855714:0:14169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c835156680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3286:x1875765421495040:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788869557.855745:0:14169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c835156680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3286:x1875765421495040:12345-0@lo:400:kworker.0 Request processed in 31us (541us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869557.855751:0:14169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788869557.855763:0:14169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788869557.855769:0:14169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c835154380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3284:x1875765421494912:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788869557.855803:0:14169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c835154380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3284:x1875765421494912:12345-0@lo:400:kworker.0 Request processed in 34us (517us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869557.855810:0:14169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788869557.855821:0:14169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1788869557.855827:0:14169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c835154000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3284:x1875765421494784:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788869557.855854:0:14169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c835154000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3284:x1875765421494784:12345-0@lo:400:kworker.0 Request processed in 27us (504us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869557.855860:0:14169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00080000:2.0:1788869557.855890:0:14164:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788869557.855895:0:14164:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788869557.855926:0:3284:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94c835155880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3284:1875765421494784:0@lo:400:kworker.0 00000100:00100000:2.0:1788869557.855946:0:3284:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94c835156300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3284:1875765421494912:0@lo:400:kworker.0 00000100:00100000:2.0:1788869557.855972:0:3286:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94c835155f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:cd496ea5-7761-4e68-8a6b-58e98659ad4a:3286:1875765421494528:0@lo:400:kworker.0 00000100:00100000:2.0:1788869557.855982:0:3286:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94c835156a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3286:1875765421495040:0@lo:400:kworker.0 00000100:00100000:2.0:1788869557.855990:0:3286:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94c835157480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3286:1875765421494656:0@lo:400:kworker.0 00000100:00100000:2.0:1788869557.856011:0:14807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765421494400 00000100:00100000:2.0:1788869557.856015:0:14807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765421494400 00000100:00100000:2.0:1788869557.856044:0:14807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788869557.856051:0:14807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c83661f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3283:x1875765421494400:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788869557.856081:0:14807:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788869557.856115:0:14807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c83661f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3283:x1875765421494400:12345-0@lo:13:osp-pre-1-0.0 Request processed in 64us (4160us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869557.856121:0:14807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00080000:2.0:1788869557.856149:0:14164:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788869557.856511:0:3283:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94c83661c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3283:1875765421494400:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788869557.858230:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1788869557.858282:0:14807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765413124608 00000100:00100000:2.0:1788869557.858289:0:14807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765413124608 00000100:00100000:2.0:1788869557.858353:0:14807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 7 00000100:00100000:2.0:1788869557.858360:0:14807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c835157480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:8eec8521-73a5-4f2d-941c-80b702633766+6:13755:x1875765413124608:12345-192.168.201.39@tcp:13:lfs.0 00002000:00000024:2.0:1788869557.858379:0:14807:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788869557.858441:0:14807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c835157480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:8eec8521-73a5-4f2d-941c-80b702633766+6:13755:x1875765413124608:12345-192.168.201.39@tcp:13:lfs.0 Request processed in 80us (214us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869557.858448:0:14807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 7 00000100:00080000:2.0:1788869557.858466:0:14164:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000001:00080000:3.0:1788869557.925473:0:7458:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934594 is committed 00000001:00100000:3.0:1788869557.925570:0:7458:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 8eec8521-73a5-4f2d-941c-80b702633766 00000100:00100000:1.0:1788869557.970680:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1788869557.970953:0:14163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765413124736 00000100:00100000:2.0:1788869557.970979:0:14163:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765413124736 00000100:00100000:3.0:1788869557.972580:0:14163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 92 00000100:00100000:3.0:1788869557.972593:0:14163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c8225f2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:027d934b-b9c0-4e83-b9af-2634761ebef6+10:13785:x1875765413124736:12345-192.168.201.39@tcp:101:mount.lustre.0 00010000:00010000:3.0:1788869557.972611:0:14163:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788869557.972641:0:14163:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff94c702256e00/0x3d2d1916761d7816 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x375c010249035c76 expref: -99 pid: 14163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869557.972674:0:14163:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff94c702256e00/0x3d2d1916761d7816 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.201.39@tcp remote: 0x375c010249035c76 expref: 11 pid: 14163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869557.972686:0:14163:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff94c702256e00/0x3d2d1916761d7816 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.201.39@tcp remote: 0x375c010249035c76 expref: 11 pid: 14163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869557.972696:0:14163:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94c702256e00, rc 0) 00000100:00100000:3.0:1788869557.972858:0:14163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c8225f2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:027d934b-b9c0-4e83-b9af-2634761ebef6+11:13785:x1875765413124736:12345-192.168.201.39@tcp:101:mount.lustre.0 Request processed in 266us (2189us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869557.972866:0:14163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 92 00000100:00100000:0.0:1788869557.976990:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1788869557.977091:0:14162:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765413124864 00000100:00100000:2.0:1788869557.977100:0:14162:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765413124864 00000100:00100000:2.0:1788869557.977156:0:14162:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 93 00000100:00100000:2.0:1788869557.977166:0:14162:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c8225f1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:027d934b-b9c0-4e83-b9af-2634761ebef6+11:13785:x1875765413124864:12345-192.168.201.39@tcp:501:mount.lustre.0 00000100:00100000:2.0:1788869557.977545:0:14162:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c8225f1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:027d934b-b9c0-4e83-b9af-2634761ebef6+11:13785:x1875765413124864:12345-192.168.201.39@tcp:501:mount.lustre.0 Request processed in 380us (565us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869557.977554:0:14162:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 93 00000100:00100000:0.0:1788869557.981930:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1788869557.982027:0:14163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765413124992 00000100:00100000:3.0:1788869557.982039:0:14163:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765413124992 00000100:00100000:3.0:1788869557.982096:0:14163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 94 00000100:00100000:3.0:1788869557.982106:0:14163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c81f236850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:027d934b-b9c0-4e83-b9af-2634761ebef6+11:13785:x1875765413124992:12345-192.168.201.39@tcp:503:mount.lustre.0 00000100:00100000:3.0:1788869557.982552:0:14163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c81f236850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:027d934b-b9c0-4e83-b9af-2634761ebef6+11:13785:x1875765413124992:12345-192.168.201.39@tcp:503:mount.lustre.0 Request processed in 446us (633us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869557.982561:0:14163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 94 00000100:00100000:1.0:1788869557.993943:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1788869557.997476:0:14161:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765413125120 00000100:00100000:3.0:1788869557.997504:0:14161:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765413125120 00000100:00100000:2.0:1788869557.997738:0:14161:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 95 00000100:00100000:2.0:1788869557.997749:0:14161:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c81f235c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:027d934b-b9c0-4e83-b9af-2634761ebef6+11:13794:x1875765413125120:12345-192.168.201.39@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788869557.998277:0:14161:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c81f235c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:027d934b-b9c0-4e83-b9af-2634761ebef6+11:13794:x1875765413125120:12345-192.168.201.39@tcp:502:llog_process_th.0 Request processed in 529us (4346us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869557.998284:0:14161:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 95 00000100:00100000:0.0:1788869558.022064:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1788869558.022234:0:14162:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765413125248 00000100:00100000:2.0:1788869558.022282:0:14162:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765413125248 00000100:00100000:2.0:1788869558.022371:0:14162:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 96 00000100:00100000:2.0:1788869558.022382:0:14162:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c81f234050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:027d934b-b9c0-4e83-b9af-2634761ebef6+11:13794:x1875765413125248:12345-192.168.201.39@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788869558.022746:0:14162:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c81f234050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:027d934b-b9c0-4e83-b9af-2634761ebef6+11:13794:x1875765413125248:12345-192.168.201.39@tcp:502:llog_process_th.0 Request processed in 365us (695us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869558.022756:0:14162:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 96 00000100:00100000:0.0:1788869558.032177:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1788869558.032300:0:14161:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765413125376 00000100:00100000:2.0:1788869558.032313:0:14161:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765413125376 00000100:00100000:2.0:1788869558.032399:0:14161:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 97 00000100:00100000:2.0:1788869558.032410:0:14161:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c81f236c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:027d934b-b9c0-4e83-b9af-2634761ebef6+11:13785:x1875765413125376:12345-192.168.201.39@tcp:101:mount.lustre.0 00010000:00010000:2.0:1788869558.032433:0:14161:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788869558.032472:0:14161:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff94c805038600/0x3d2d1916761d781d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x375c010249035ca0 expref: -99 pid: 14161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869558.032512:0:14161:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff94c805038600/0x3d2d1916761d781d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.201.39@tcp remote: 0x375c010249035ca0 expref: 12 pid: 14161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869558.032525:0:14161:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff94c805038600/0x3d2d1916761d781d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.201.39@tcp remote: 0x375c010249035ca0 expref: 12 pid: 14161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869558.032537:0:14161:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94c805038600, rc 0) 00000100:00100000:2.0:1788869558.032618:0:14161:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c81f236c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:027d934b-b9c0-4e83-b9af-2634761ebef6+12:13785:x1875765413125376:12345-192.168.201.39@tcp:101:mount.lustre.0 Request processed in 210us (457us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869558.032626:0:14161:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 97 00000100:00100000:1.0:1788869558.042822:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1788869558.042945:0:14163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765413125504 00000100:00100000:3.0:1788869558.042963:0:14163:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765413125504 00000100:00100000:3.0:1788869558.043058:0:14163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 98 00000100:00100000:3.0:1788869558.043072:0:14163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c81f236450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:027d934b-b9c0-4e83-b9af-2634761ebef6+12:13785:x1875765413125504:12345-192.168.201.39@tcp:256:mount.lustre.0 20000000:01000000:3.0:1788869558.043110:0:14163:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:3.0:1788869558.043147:0:14163:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:3.0:1788869558.043156:0:14163:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:3.0:1788869558.043160:0:14163:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:3.0:1788869558.043163:0:14163:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 8 00000100:00100000:3.0:1788869558.045174:0:14163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c81f236450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:027d934b-b9c0-4e83-b9af-2634761ebef6+12:13785:x1875765413125504:12345-192.168.201.39@tcp:256:mount.lustre.0 Request processed in 2094us (2350us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869558.045190:0:14163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 98 00000100:00100000:0.0:1788869558.049170:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1788869558.049288:0:14161:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765413125632 00000100:00100000:2.0:1788869558.049299:0:14161:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765413125632 00000100:00100000:2.0:1788869558.049361:0:14161:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 99 00000100:00100000:2.0:1788869558.049372:0:14161:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c81f237c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:027d934b-b9c0-4e83-b9af-2634761ebef6+12:13785:x1875765413125632:12345-192.168.201.39@tcp:101:mount.lustre.0 00010000:00010000:2.0:1788869558.049388:0:14161:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788869558.049406:0:14161:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff94c805039c00/0x3d2d1916761d7824 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x375c010249035ca7 expref: -99 pid: 14161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869558.049437:0:14161:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff94c805039c00/0x3d2d1916761d7824 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.201.39@tcp remote: 0x375c010249035ca7 expref: 13 pid: 14161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869558.049588:0:14161:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff94c805039c00/0x3d2d1916761d7824 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.201.39@tcp remote: 0x375c010249035ca7 expref: 13 pid: 14161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869558.049600:0:14161:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94c805039c00, rc 0) 00000100:00100000:2.0:1788869558.049697:0:14161:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c81f237c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:027d934b-b9c0-4e83-b9af-2634761ebef6+13:13785:x1875765413125632:12345-192.168.201.39@tcp:101:mount.lustre.0 Request processed in 327us (537us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869558.049715:0:14161:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 99 00000100:00100000:1.0:1788869558.055457:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1788869558.055508:0:14163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765413125760 00000100:00100000:3.0:1788869558.055518:0:14163:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765413125760 00000100:00100000:3.0:1788869558.055571:0:14163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 100 00000100:00100000:3.0:1788869558.055579:0:14163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c81f236050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:027d934b-b9c0-4e83-b9af-2634761ebef6+13:13785:x1875765413125760:12345-192.168.201.39@tcp:501:mount.lustre.0 00000100:00100000:3.0:1788869558.056016:0:14163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c81f236050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:027d934b-b9c0-4e83-b9af-2634761ebef6+13:13785:x1875765413125760:12345-192.168.201.39@tcp:501:mount.lustre.0 Request processed in 432us (564us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869558.056024:0:14163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 100 00000100:00100000:2.0:1788869558.060104:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1788869558.060209:0:14162:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765413125888 00000100:00100000:0.0:1788869558.060220:0:14162:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765413125888 00000100:00100000:0.0:1788869558.060662:0:14162:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 101 00000100:00100000:0.0:1788869558.060676:0:14162:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c81f235850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:027d934b-b9c0-4e83-b9af-2634761ebef6+13:13785:x1875765413125888:12345-192.168.201.39@tcp:503:mount.lustre.0 00000100:00100000:0.0:1788869558.060999:0:14162:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c81f235850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:027d934b-b9c0-4e83-b9af-2634761ebef6+13:13785:x1875765413125888:12345-192.168.201.39@tcp:503:mount.lustre.0 Request processed in 327us (904us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869558.061009:0:14162:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 101 00000100:00100000:0.0:1788869558.067466:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1788869558.067556:0:14163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765413126016 00000100:00100000:3.0:1788869558.067567:0:14163:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765413126016 00000100:00100000:3.0:1788869558.067628:0:14163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 102 00000100:00100000:3.0:1788869558.067638:0:14163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c81f234850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:027d934b-b9c0-4e83-b9af-2634761ebef6+13:13798:x1875765413126016:12345-192.168.201.39@tcp:502:llog_process_th.0 00000100:00100000:3.0:1788869558.068008:0:14163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c81f234850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:027d934b-b9c0-4e83-b9af-2634761ebef6+13:13798:x1875765413126016:12345-192.168.201.39@tcp:502:llog_process_th.0 Request processed in 370us (549us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869558.068016:0:14163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 102 00000100:00100000:1.0:1788869558.076119:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1788869558.076223:0:14162:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765413126144 00000100:00100000:0.0:1788869558.076233:0:14162:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765413126144 00000100:00100000:0.0:1788869558.076334:0:14162:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 103 00000100:00100000:0.0:1788869558.076344:0:14162:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c81f235450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:027d934b-b9c0-4e83-b9af-2634761ebef6+13:13798:x1875765413126144:12345-192.168.201.39@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788869558.076596:0:14162:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c81f235450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:027d934b-b9c0-4e83-b9af-2634761ebef6+13:13798:x1875765413126144:12345-192.168.201.39@tcp:502:llog_process_th.0 Request processed in 253us (485us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869558.076605:0:14162:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 103 00000100:00100000:2.0:1788869558.085051:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1788869558.085085:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1788869558.085112:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1788869558.085175:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1788869558.085211:0:14805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765413126784 00000100:00100000:2.0:1788869558.085220:0:14805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765413126784 00000100:00100000:2.0:1788869558.085286:0:14805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765413126912 00000100:00100000:2.0:1788869558.085289:0:14805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765413126912 00000100:00100000:2.0:1788869558.085314:0:14805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 3 00000100:00100000:2.0:1788869558.085342:0:14805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c835155f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8eec8521-73a5-4f2d-941c-80b702633766+5:2345:x1875765413126784:12345-192.168.201.39@tcp:400:kworker.0 00000100:00100000:2.0:1788869558.085418:0:14805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c835155f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8eec8521-73a5-4f2d-941c-80b702633766+5:2345:x1875765413126784:12345-192.168.201.39@tcp:400:kworker.0 Request processed in 77us (330us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869558.085425:0:14805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 3 00000100:00100000:2.0:1788869558.085442:0:14805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 4 00000100:00100000:2.0:1788869558.085448:0:14805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c835155880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8eec8521-73a5-4f2d-941c-80b702633766+5:2345:x1875765413126912:12345-192.168.201.39@tcp:400:kworker.0 00000100:00100000:2.0:1788869558.085474:0:14805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c835155880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8eec8521-73a5-4f2d-941c-80b702633766+5:2345:x1875765413126912:12345-192.168.201.39@tcp:400:kworker.0 Request processed in 25us (308us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869558.085480:0:14805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 4 00000100:00100000:3.0:1788869558.085827:0:14169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765413126272 00000100:00100000:3.0:1788869558.085833:0:14169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765413126272 00000100:00100000:3.0:1788869558.085861:0:14169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765413126656 00000100:00100000:3.0:1788869558.085864:0:14169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765413126656 00000100:00100000:3.0:1788869558.085891:0:14169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 17 00000100:00100000:3.0:1788869558.085898:0:14169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c835156300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8eec8521-73a5-4f2d-941c-80b702633766+7:2345:x1875765413126656:12345-192.168.201.39@tcp:400:kworker.0 00000100:00100000:3.0:1788869558.085935:0:14169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c835156300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8eec8521-73a5-4f2d-941c-80b702633766+7:2345:x1875765413126656:12345-192.168.201.39@tcp:400:kworker.0 Request processed in 37us (822us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869558.085952:0:14169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 17 00000100:00100000:3.0:1788869558.085967:0:14169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 10 00000100:00100000:3.0:1788869558.085971:0:14169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c835156a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2344:x1875765413126272:12345-192.168.201.39@tcp:38:mount.lustre.0 00010000:00080000:3.0:1788869558.085993:0:14169:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0000: connection from b859f31b-9885-425c-b9a4-5a4e02335486@192.168.201.39@tcp t0 exp 0000000000000000 cur 306 last 0 00000020:00000080:3.0:1788869558.086027:0:14169:0:(genops.c:1406:class_connect()) connect: client b859f31b-9885-425c-b9a4-5a4e02335486, cookie 0x3d2d1916761d782b 00000004:00100000:3.0:1788869558.086060:0:14169:0:(mdt_handler.c:7362:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:3.0:1788869558.086192:0:14169:0:(import.c:65:import_set_state_nolock()) ffff94c8349de800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788869558.086225:0:14169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c835156a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b859f31b-9885-425c-b9a4-5a4e02335486+6:2344:x1875765413126272:12345-192.168.201.39@tcp:38:mount.lustre.0 Request processed in 251us (1182us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869558.086232:0:14169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 10 00000100:00100000:2.0:1788869558.099453:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1788869558.099500:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1788869558.099590:0:14170:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765413126400 00000100:00100000:0.0:1788869558.099599:0:14170:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765413126400 00000100:00100000:0.0:1788869558.099659:0:14170:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765413126528 00000100:00100000:0.0:1788869558.099662:0:14170:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765413126528 00000100:00100000:0.0:1788869558.099679:0:14170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 11 00000100:00100000:0.0:1788869558.099687:0:14170:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c835155180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b859f31b-9885-425c-b9a4-5a4e02335486+7:0:x1875765413126400:12345-192.168.201.39@tcp:41:mount.lustre.0 00000004:00000024:0.0:1788869558.099717:0:14170:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:0.0:1788869558.099776:0:14170:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c835155180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b859f31b-9885-425c-b9a4-5a4e02335486+7:0:x1875765413126400:12345-192.168.201.39@tcp:41:mount.lustre.0 Request processed in 89us (334us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869558.099783:0:14170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 11 00000100:00100000:0.0:1788869558.099796:0:14170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 12 00000100:00100000:0.0:1788869558.099802:0:14170:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c835155c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b859f31b-9885-425c-b9a4-5a4e02335486+6:13785:x1875765413126528:12345-192.168.201.39@tcp:41:mount.lustre.0 00000004:00000024:0.0:1788869558.099810:0:14170:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:0.0:1788869558.099839:0:14170:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c835155c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b859f31b-9885-425c-b9a4-5a4e02335486+6:13785:x1875765413126528:12345-192.168.201.39@tcp:41:mount.lustre.0 Request processed in 36us (339us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869558.099859:0:14170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 12 00000100:00080000:2.0:1788869558.100137:0:14164:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788869558.104961:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1788869558.105061:0:14170:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765413127040 00000100:00100000:0.0:1788869558.105070:0:14170:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765413127040 00000100:00100000:0.0:1788869558.105130:0:14170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 13 00000100:00100000:0.0:1788869558.105138:0:14170:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c8354d2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b859f31b-9885-425c-b9a4-5a4e02335486+6:13785:x1875765413127040:12345-192.168.201.39@tcp:40:mount.lustre.0 00000100:00100000:0.0:1788869558.105226:0:14170:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c8354d2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b859f31b-9885-425c-b9a4-5a4e02335486+6:13785:x1875765413127040:12345-192.168.201.39@tcp:40:mount.lustre.0 Request processed in 88us (275us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869558.105234:0:14170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 13 00000100:00100000:2.0:1788869558.107843:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1788869558.108116:0:14805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765413127168 00000100:00100000:3.0:1788869558.108133:0:14805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765413127168 00000100:00100000:3.0:1788869558.108196:0:14805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 12 00000100:00100000:3.0:1788869558.108210:0:14805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c835156d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2344:x1875765413127168:12345-192.168.201.39@tcp:8:mount.lustre.0 00010000:00080000:3.0:1788869558.108301:0:14805:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0000: connection from b859f31b-9885-425c-b9a4-5a4e02335486@192.168.201.39@tcp t0 exp 0000000000000000 cur 306 last 0 00000020:00000080:3.0:1788869558.108366:0:14805:0:(genops.c:1406:class_connect()) connect: client b859f31b-9885-425c-b9a4-5a4e02335486, cookie 0x3d2d1916761d7832 00002000:00100000:3.0:1788869558.108384:0:14805:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli b859f31b-9885-425c-b9a4-5a4e02335486/ffff94c8349d9000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113718 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1788869558.108397:0:14805:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00000100:00100000:1.0:1788869558.108446:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1788869558.108539:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00002000:00080000:3.0:1788869558.108744:0:14805:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1788869558.108778:0:14805:0:(import.c:65:import_set_state_nolock()) ffff94c8349db000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788869558.108858:0:14805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c835156d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b859f31b-9885-425c-b9a4-5a4e02335486+6:2344:x1875765413127168:12345-192.168.201.39@tcp:8:mount.lustre.0 Request processed in 652us (1024us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869558.108868:0:14805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 12 00000100:00100000:0.0:1788869558.108898:0:14172:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765413127424 00000100:00100000:0.0:1788869558.108911:0:14172:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765413127424 00000100:00100000:3.0:1788869558.108913:0:14805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765413127296 00000100:00100000:3.0:1788869558.108919:0:14805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765413127296 00000100:00100000:0.0:1788869558.109220:0:14172:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 1 00000100:00100000:0.0:1788869558.109232:0:14172:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c83c68b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b859f31b-9885-425c-b9a4-5a4e02335486+6:13785:x1875765413127424:12345-192.168.201.39@tcp:33:mount.lustre.0 00000004:00200000:0.0:1788869558.109924:0:14172:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000100:00100000:0.0:1788869558.110201:0:14172:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c83c68b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b859f31b-9885-425c-b9a4-5a4e02335486+6:13785:x1875765413127424:12345-192.168.201.39@tcp:33:mount.lustre.0 Request processed in 969us (1659us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869558.110210:0:14172:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 1 00000100:00100000:3.0:1788869558.114893:0:14805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 13 00000100:00100000:3.0:1788869558.114906:0:14805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c83c68ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2344:x1875765413127296:12345-192.168.201.39@tcp:8:mount.lustre.0 00010000:00080000:3.0:1788869558.114948:0:14805:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0001: connection from b859f31b-9885-425c-b9a4-5a4e02335486@192.168.201.39@tcp t0 exp 0000000000000000 cur 306 last 0 00000020:00000080:3.0:1788869558.114992:0:14805:0:(genops.c:1406:class_connect()) connect: client b859f31b-9885-425c-b9a4-5a4e02335486, cookie 0x3d2d1916761d7839 00002000:00100000:3.0:1788869558.115007:0:14805:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli b859f31b-9885-425c-b9a4-5a4e02335486/ffff94c8349dd800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113718 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1788869558.115020:0:14805:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:3.0:1788869558.115174:0:14805:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1788869558.115206:0:14805:0:(import.c:65:import_set_state_nolock()) ffff94c8349dd000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788869558.115431:0:14805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c83c68ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b859f31b-9885-425c-b9a4-5a4e02335486+6:2344:x1875765413127296:12345-192.168.201.39@tcp:8:mount.lustre.0 Request processed in 523us (6988us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869558.115440:0:14805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 13 00000100:00100000:1.0:1788869558.287180:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1788869558.291803:0:14169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765413127552 00000100:00100000:3.0:1788869558.292312:0:14169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765413127552 00000100:00100000:3.0:1788869558.292402:0:14169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 14 00000100:00100000:3.0:1788869558.292413:0:14169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c83c68b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b859f31b-9885-425c-b9a4-5a4e02335486+6:13819:x1875765413127552:12345-192.168.201.39@tcp:101:mkdir.0 00010000:00010000:3.0:1788869558.292434:0:14169:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788869558.292458:0:14169:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94c702257c00/0x3d2d1916761d7840 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x375c010249035cd1 expref: -99 pid: 14169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869558.295189:0:14169:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94c702257200/0x3d2d1916761d7847 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869558.295211:0:14169:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94c702257200/0x3d2d1916761d7847 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869558.295242:0:14169:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94c702257200/0x3d2d1916761d7847 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14169 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788869558.295514:0:14169:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:3.0:1788869558.295519:0:14169:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 3 stripe count 1 MDT count 1 00000004:00010000:3.0:1788869558.295618:0:14169:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff94c702257200/0x3d2d1916761d7847 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869558.295761:0:14169:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94c702257c00/0x3d2d1916761d7840 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0x375c010249035cd1 expref: 8 pid: 14169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869558.295781:0:14169:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94c702257200/0x3d2d1916761d7847 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0x375c010249035cd1 expref: 7 pid: 14169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869558.295790:0:14169:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff94c802db2100) 00010000:00010000:3.0:1788869558.295793:0:14169:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788869558.295796:0:14169:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94c702257200, rc 0) 00000100:00100000:3.0:1788869558.295954:0:14169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c83c68b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b859f31b-9885-425c-b9a4-5a4e02335486+7:13819:x1875765413127552:12345-192.168.201.39@tcp:101:mkdir.0 Request processed in 3541us (8782us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869558.295963:0:14169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 14 00010000:00010000:0.0:1788869558.875519:0:14157:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788869559.899666:0:3286:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94c82cdc4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3286:1875765421495168:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788869559.899745:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869559.899873:0:14807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765421495168 00000100:00100000:2.0:1788869559.899889:0:14807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765421495168 00000100:00100000:2.0:1788869559.899962:0:14807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788869559.899973:0:14807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c83661c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3286:x1875765421495168:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788869559.900011:0:14807:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788869559.900057:0:14807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c83661c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3286:x1875765421495168:12345-0@lo:13:osp-pre-0-0.0 Request processed in 86us (311us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869559.900065:0:14807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00080000:2.0:1788869559.900087:0:14164:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788869559.900148:0:3286:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94c82cdc4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3286:1875765421495168:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1788869559.902799:0:15140:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1788869560.334915:0:16036:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:3.0:1788869560.925879:0:14156:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1788869560.999750:0:5777:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of b859f31b-9885-425c-b9a4-5a4e02335486 00000001:00100000:0.0:1788869560.999765:0:5777:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 8eec8521-73a5-4f2d-941c-80b702633766 00010000:00010000:0.0:1788869561.952701:0:14157:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1788869561.986784:0:6571:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of b859f31b-9885-425c-b9a4-5a4e02335486 00000100:00100000:0.0:1788869562.971741:0:3284:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94c83fbb2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3284:1875765421495424:0@lo:400:kworker.0 00000100:00100000:0.0:1788869562.971844:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869562.971917:0:3284:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94c83fbb1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3284:1875765421495936:0@lo:400:kworker.0 00000100:00100000:0.0:1788869562.971952:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869562.971982:0:3284:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1788869562.971988:0:3284:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94c83661c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:cd496ea5-7761-4e68-8a6b-58e98659ad4a:3284:1875765421495296:0@lo:400:kworker.0 00000100:00100000:0.0:1788869562.972020:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869562.972042:0:3284:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94c83fbb1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3284:1875765421495808:0@lo:400:kworker.0 00000100:00100000:0.0:1788869562.972063:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869562.972093:0:3286:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94c83fbb3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3286:1875765421495680:0@lo:400:kworker.0 00000100:00100000:0.0:1788869562.972117:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869562.972137:0:3286:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788869562.972143:0:3286:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94c83fbb0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3286:1875765421495552:0@lo:400:kworker.0 00000100:00100000:0.0:1788869562.972165:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869562.972197:0:14804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765421495424 00000100:00100000:0.0:1788869562.972207:0:14804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765421495424 00000100:00100000:0.0:1788869562.972309:0:14804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765421495552 00000100:00100000:0.0:1788869562.972313:0:14804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765421495552 00000100:00100000:0.0:1788869562.972336:0:14804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788869562.972345:0:14804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c83fbb0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3284:x1875765421495424:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788869562.972408:0:14804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c83fbb0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3284:x1875765421495424:12345-0@lo:400:kworker.0 Request processed in 63us (564us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869562.972416:0:14804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788869562.972434:0:14804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788869562.972441:0:14804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c83fbb1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3286:x1875765421495552:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788869562.972472:0:14804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c83fbb1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3286:x1875765421495552:12345-0@lo:400:kworker.0 Request processed in 32us (306us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869562.972496:0:14804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788869562.972517:0:14170:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765421495936 00000100:00100000:0.0:1788869562.972521:0:14170:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765421495936 00000100:00100000:0.0:1788869562.972548:0:14170:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765421495808 00000100:00100000:0.0:1788869562.972551:0:14170:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765421495808 00000100:00100000:0.0:1788869562.972563:0:14170:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765421495680 00000100:00100000:0.0:1788869562.972566:0:14170:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765421495680 00000100:00100000:0.0:1788869562.972578:0:14170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1788869562.972584:0:14170:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c83fbb1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3284:x1875765421495936:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788869562.972618:0:14170:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c83fbb1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3284:x1875765421495936:12345-0@lo:400:kworker.0 Request processed in 34us (665us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869562.972624:0:14170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1788869562.972636:0:14170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1788869562.972642:0:14170:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c83fbb3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3284:x1875765421495808:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788869562.972665:0:14170:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c83fbb3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3284:x1875765421495808:12345-0@lo:400:kworker.0 Request processed in 24us (601us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869562.972671:0:14170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1788869562.972679:0:14170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1788869562.972684:0:14170:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c83fbb3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3286:x1875765421495680:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788869562.972706:0:14170:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c83fbb3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3286:x1875765421495680:12345-0@lo:400:kworker.0 Request processed in 22us (588us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869562.972711:0:14170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00080000:0.0:1788869562.972741:0:14164:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788869562.972747:0:14164:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788869562.972749:0:14164:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788869562.972779:0:3286:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934594 gen 2 00000100:00100000:0.0:1788869562.972801:0:3286:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94c83fbb0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3286:1875765421495552:0@lo:400:kworker.0 00000100:00100000:0.0:1788869562.972824:0:3286:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94c83fbb3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3286:1875765421495680:0@lo:400:kworker.0 00000100:00100000:0.0:1788869562.972852:0:3284:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94c83fbb1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3284:1875765421495808:0@lo:400:kworker.0 00000100:00100000:0.0:1788869562.972863:0:3284:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94c83fbb2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3284:1875765421495424:0@lo:400:kworker.0 00000100:00100000:0.0:1788869562.972871:0:3284:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94c83fbb1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3284:1875765421495936:0@lo:400:kworker.0 00000100:00100000:3.0:1788869562.973910:0:14163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765421495296 00000100:00100000:3.0:1788869562.973922:0:14163:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765421495296 00000100:00100000:3.0:1788869562.973980:0:14163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:3.0:1788869562.973989:0:14163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c81f234450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cd496ea5-7761-4e68-8a6b-58e98659ad4a+19:3284:x1875765421495296:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788869562.974072:0:14163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c81f234450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cd496ea5-7761-4e68-8a6b-58e98659ad4a+19:3284:x1875765421495296:12345-0@lo:400:kworker.0 Request processed in 84us (2050us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869562.974096:0:14163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00010000:00010000:3.0:1788869562.974195:0:15140:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788869562.974240:0:3284:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94c83661c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:cd496ea5-7761-4e68-8a6b-58e98659ad4a:3284:1875765421495296:0@lo:400:kworker.0 00000100:00100000:1.0:1788869562.975166:0:3285:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94c82cdc6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3285:1875765421496064:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788869562.975281:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869562.977286:0:14807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765421496064 00000100:00100000:3.0:1788869562.977309:0:14807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765421496064 00000100:00100000:3.0:1788869562.977373:0:14807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788869562.977386:0:14807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c83fae8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3285:x1875765421496064:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788869562.977436:0:14807:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788869562.977540:0:14807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c83fae8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3285:x1875765421496064:12345-0@lo:13:osp-pre-1-0.0 Request processed in 155us (2257us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869562.977548:0:14807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788869562.977623:0:3285:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94c82cdc6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3285:1875765421496064:0@lo:13:osp-pre-1-0.0 00000001:00100000:1.0:1788869563.021590:0:7458:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of b859f31b-9885-425c-b9a4-5a4e02335486 00000020:00000080:2.0:1788869563.161513:0:16186:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007fff33133ba0 20000000:00000080:2.0:1788869563.161539:0:16186:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff94c7031e3400 uarg=0000000000000000 20000000:01000000:2.0:1788869563.161576:0:16186:0:(mgs_llog.c:6188:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:2.0:1788869563.161582:0:16186:0:(mgs_llog.c:4643:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:2.0:1788869563.161587:0:16186:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:1.0:1788869563.163517:0:16187:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 10 20000000:00000400:2.0:1788869563.163779:0:16186:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:2.0:1788869563.181128:0:16186:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:3.0:1788869563.181774:0:16186:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff94c702257c00/0x3d2d1916761d784e lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869563.181803:0:16186:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff94c805038800/0x3d2d1916761d7545 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3d2d1916761d753e expref: 18 pid: 14161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869563.181812:0:16186:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff94c83504d600/0x3d2d1916761d7592 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3d2d1916761d758b expref: 18 pid: 14162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869563.181819:0:16186:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff94c83fde6200/0x3d2d1916761d76cd lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3d2d1916761d76c6 expref: 18 pid: 14161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869563.181831:0:16186:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff94c805039400/0x3d2d1916761d77ec lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.201.39@tcp remote: 0x375c010249035c45 expref: 12 pid: 14163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869563.181867:0:16186:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff94c805039c00/0x3d2d1916761d7824 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.201.39@tcp remote: 0x375c010249035ca7 expref: 12 pid: 14161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869563.181875:0:16186:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff94c702257c00/0x3d2d1916761d784e lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 16186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869563.181937:0:16186:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff94c805039c00/0x3d2d1916761d7824 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.201.39@tcp remote: 0x375c010249035ca7 expref: 12 pid: 14161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869563.181955:0:16186:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff94c805039c00/0x3d2d1916761d7824 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.201.39@tcp remote: 0x375c010249035ca7 expref: 12 pid: 14161 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788869563.181975:0:16186:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94c8354d2a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16186:1875765421496192:192.168.201.39@tcp:104: 00010000:00010000:3.0:1788869563.182138:0:16186:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff94c805039400/0x3d2d1916761d77ec lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.201.39@tcp remote: 0x375c010249035c45 expref: 12 pid: 14163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869563.182148:0:16186:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff94c805039400/0x3d2d1916761d77ec lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.201.39@tcp remote: 0x375c010249035c45 expref: 12 pid: 14163 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788869563.182157:0:16186:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94c8354d2300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16186:1875765421496320:192.168.201.39@tcp:104: 00010000:00010000:3.0:1788869563.182193:0:16186:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff94c83fde6200/0x3d2d1916761d76cd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x3d2d1916761d76c6 expref: 18 pid: 14161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869563.182202:0:16186:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff94c83fde6200/0x3d2d1916761d76cd lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x3d2d1916761d76c6 expref: 18 pid: 14161 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788869563.182213:0:16186:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94c8354d0a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16186:1875765421496448:0@lo:104: 00000100:00100000:3.0:1788869563.182313:0:16186:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788869563.184977:0:16186:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff94c83504d600/0x3d2d1916761d7592 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x3d2d1916761d758b expref: 18 pid: 14162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869563.184998:0:16186:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff94c83504d600/0x3d2d1916761d7592 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x3d2d1916761d758b expref: 18 pid: 14162 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788869563.185015:0:16186:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94c8354d3b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16186:1875765421496576:0@lo:104: 00000100:00100000:3.0:1788869563.185647:0:16186:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788869563.185702:0:16186:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff94c805038800/0x3d2d1916761d7545 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x3d2d1916761d753e expref: 18 pid: 14161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869563.185713:0:16186:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff94c805038800/0x3d2d1916761d7545 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x3d2d1916761d753e expref: 18 pid: 14161 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788869563.185724:0:16186:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94c8354d0000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16186:1875765421496704:0@lo:104: 00000100:00100000:3.0:1788869563.185755:0:16186:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869563.185766:0:16186:0:(client.c:2702:ptlrpc_set_wait()) set ffff94c8357d5600 going to sleep for 11 seconds 00000100:00100000:1.0:1788869563.185911:0:14151:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:1.0:1788869563.185929:0:14151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765421496448 00000100:00100000:1.0:1788869563.185937:0:14151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765421496448 00000100:00100000:1.0:1788869563.185987:0:14151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765421496576 00000100:00100000:1.0:1788869563.185989:0:14151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765421496576 00000100:00100000:1.0:1788869563.185997:0:14151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765421496704 00000100:00100000:1.0:1788869563.185998:0:14151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765421496704 00000100:00100000:1.0:1788869563.186010:0:14151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788869563.186019:0:14151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c8354d1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:cd496ea5-7761-4e68-8a6b-58e98659ad4a+5:16186:x1875765421496448:12345-0@lo:104: 00010000:00010000:1.0:1788869563.186055:0:14151:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.139@tcp lock: ffff94c818d1f600/0x3d2d1916761d76c6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x3d2d1916761d76cd expref: -99 pid: 15475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869563.186141:0:14151:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788869563.186148:0:14151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c8354d1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:cd496ea5-7761-4e68-8a6b-58e98659ad4a+5:16186:x1875765421496448:12345-0@lo:104: Request processed in 130us (3836us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869563.186156:0:14151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788869563.186175:0:14151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788869563.186181:0:14151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c8354d0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:cd496ea5-7761-4e68-8a6b-58e98659ad4a+4:16186:x1875765421496576:12345-0@lo:104: 00010000:00010000:1.0:1788869563.186187:0:14151:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.139@tcp lock: ffff94c83504c600/0x3d2d1916761d758b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x3d2d1916761d7592 expref: -99 pid: 14802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869563.187166:0:14151:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1788869563.187182:0:14151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c8354d0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:cd496ea5-7761-4e68-8a6b-58e98659ad4a+4:16186:x1875765421496576:12345-0@lo:104: Request processed in 997us (1534us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869563.187194:0:14151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788869563.187234:0:14151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788869563.187364:0:16186:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94c8354d0a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16186:1875765421496448:0@lo:104: 00000100:00100000:2.0:1788869563.187378:0:16186:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94c8354d3b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16186:1875765421496576:0@lo:104: 00000100:00100000:1.0:1788869563.187419:0:14151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c820780050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:cd496ea5-7761-4e68-8a6b-58e98659ad4a+3:16186:x1875765421496704:12345-0@lo:104: 00010000:00010000:1.0:1788869563.187439:0:14151:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.139@tcp lock: ffff94c83504ce00/0x3d2d1916761d753e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x3d2d1916761d7545 expref: -99 pid: 14165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788869563.187613:0:16186:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94c8354d0000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16186:1875765421496704:0@lo:104: 00010000:00010000:3.0:1788869563.187676:0:14156:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1788869563.187686:0:14156:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.139@tcp lock: ffff94c818d1f600/0x3d2d1916761d76c6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x3d2d1916761d76cd expref: -99 pid: 15475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869563.187697:0:14156:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94c818d1f600 already unused, calling callback (ffffffffc1ce9c20) 10000000:00010000:3.0:1788869563.187702:0:14156:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.139@tcp lock: ffff94c818d1f600/0x3d2d1916761d76c6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x3d2d1916761d76cd expref: -99 pid: 15475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869563.187712:0:14156:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.139@tcp lock: ffff94c818d1f600/0x3d2d1916761d76c6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x3d2d1916761d76cd expref: -99 pid: 15475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788869563.187719:0:14156:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.139@tcp lock: ffff94c818d1f600/0x3d2d1916761d76c6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x3d2d1916761d76cd expref: -99 pid: 15475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788869563.187745:0:14156:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1788869563.187811:0:14156:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.139@tcp lock: ffff94c818d1f600/0x3d2d1916761d76c6 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3d2d1916761d76cd expref: -99 pid: 15475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869563.187819:0:14156:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788869563.187849:0:14156:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.139@tcp lock: ffff94c818d1f600/0x3d2d1916761d76c6 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3d2d1916761d76cd expref: -99 pid: 15475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869563.187857:0:14156:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.139@tcp lock: ffff94c818d1f600/0x3d2d1916761d76c6 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3d2d1916761d76cd expref: -99 pid: 15475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869563.187870:0:14156:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788869563.187874:0:14156:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.139@tcp lock: ffff94c83504c600/0x3d2d1916761d758b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x3d2d1916761d7592 expref: -99 pid: 14802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869563.187879:0:14156:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94c83504c600 already unused, calling callback (ffffffffc1ce9c20) 10000000:00010000:3.0:1788869563.187882:0:14156:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.139@tcp lock: ffff94c83504c600/0x3d2d1916761d758b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x3d2d1916761d7592 expref: -99 pid: 14802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869563.187890:0:14156:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.139@tcp lock: ffff94c83504c600/0x3d2d1916761d758b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x3d2d1916761d7592 expref: -99 pid: 14802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788869563.187897:0:14156:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.139@tcp lock: ffff94c83504c600/0x3d2d1916761d758b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x3d2d1916761d7592 expref: -99 pid: 14802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788869563.187902:0:14156:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1788869563.187917:0:14156:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.139@tcp lock: ffff94c83504c600/0x3d2d1916761d758b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3d2d1916761d7592 expref: -99 pid: 14802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869563.187923:0:14156:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788869563.187947:0:14156:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.139@tcp lock: ffff94c83504c600/0x3d2d1916761d758b lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3d2d1916761d7592 expref: -99 pid: 14802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869563.187954:0:14156:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.139@tcp lock: ffff94c83504c600/0x3d2d1916761d758b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3d2d1916761d7592 expref: -99 pid: 14802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869563.187965:0:14156:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788869563.187968:0:14156:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.139@tcp lock: ffff94c83504ce00/0x3d2d1916761d753e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x3d2d1916761d7545 expref: -99 pid: 14165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869563.187975:0:14156:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94c83504ce00 already unused, calling callback (ffffffffc1ce9c20) 10000000:00010000:3.0:1788869563.187977:0:14156:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.139@tcp lock: ffff94c83504ce00/0x3d2d1916761d753e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x3d2d1916761d7545 expref: -99 pid: 14165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869563.187984:0:14156:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.139@tcp lock: ffff94c83504ce00/0x3d2d1916761d753e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x3d2d1916761d7545 expref: -99 pid: 14165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788869563.187991:0:14156:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.139@tcp lock: ffff94c83504ce00/0x3d2d1916761d753e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x3d2d1916761d7545 expref: -99 pid: 14165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788869563.187996:0:14156:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1788869563.188011:0:14156:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.139@tcp lock: ffff94c83504ce00/0x3d2d1916761d753e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3d2d1916761d7545 expref: -99 pid: 14165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869563.188017:0:14156:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788869563.188023:0:14156:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.139@tcp lock: ffff94c83504ce00/0x3d2d1916761d753e lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3d2d1916761d7545 expref: -99 pid: 14165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869563.188030:0:14156:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.139@tcp lock: ffff94c83504ce00/0x3d2d1916761d753e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3d2d1916761d7545 expref: -99 pid: 14165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869563.188055:0:14156:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788869563.188057:0:14156:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788869563.188073:0:14156:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788869563.188092:0:3285:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788869563.188111:0:3285:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94c8354d1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:cd496ea5-7761-4e68-8a6b-58e98659ad4a:3285:1875765421496832:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788869563.188162:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869563.188213:0:3283:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94c8354d2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:cd496ea5-7761-4e68-8a6b-58e98659ad4a:3283:1875765421496960:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788869563.188284:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869563.188309:0:3283:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788869563.188316:0:3283:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94c8354d0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:cd496ea5-7761-4e68-8a6b-58e98659ad4a:3283:1875765421497088:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788869563.188341:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788869563.188611:0:14151:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to priority blp list, 0 blwis in pool 00000100:00100000:1.0:1788869563.188621:0:14151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c820780050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:cd496ea5-7761-4e68-8a6b-58e98659ad4a+3:16186:x1875765421496704:12345-0@lo:104: Request processed in 1379us (2863us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869563.188631:0:14151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00010000:3.0:1788869563.188720:0:15140:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788869563.188764:0:14157:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788869563.188784:0:14154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765421496832 00000100:00100000:0.0:1788869563.188851:0:14154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765421496832 00010000:00010000:0.0:1788869563.188894:0:14154:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff94c83fde6200/0x3d2d1916761d76cd lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3d2d1916761d76c6 expref: 19 pid: 14161 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788869563.188916:0:14154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765421496960 00000100:00100000:0.0:1788869563.188918:0:14154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765421496960 00010000:00010000:0.0:1788869563.188927:0:14154:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff94c83504d600/0x3d2d1916761d7592 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3d2d1916761d758b expref: 20 pid: 14162 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788869563.188937:0:14154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765421497088 00000100:00100000:0.0:1788869563.188939:0:14154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765421497088 00010000:00010000:0.0:1788869563.188947:0:14154:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff94c805038800/0x3d2d1916761d7545 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3d2d1916761d753e expref: 21 pid: 14161 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788869563.188959:0:14154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788869563.188966:0:14154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c8354d3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cd496ea5-7761-4e68-8a6b-58e98659ad4a+21:3285:x1875765421496832:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788869563.188979:0:14154:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788869563.188986:0:14154:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff94c83fde6200/0x3d2d1916761d76cd lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3d2d1916761d76c6 expref: 21 pid: 14161 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869563.188996:0:14154:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff94c83fde6200/0x3d2d1916761d76cd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x3d2d1916761d76c6 expref: 21 pid: 14161 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869563.189029:0:14154:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff94c83fde6200/0x3d2d1916761d76cd lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x3d2d1916761d76c6 expref: 21 pid: 14161 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869563.189046:0:14154:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788869563.189318:0:14153:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:2.0:1788869563.189329:0:14153:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_003' 00000100:00100000:2.0:1788869563.189828:0:14153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788869563.189839:0:14153:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c835a15500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cd496ea5-7761-4e68-8a6b-58e98659ad4a+20:3283:x1875765421496960:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788869563.189853:0:14153:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788869563.189860:0:14153:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff94c83504d600/0x3d2d1916761d7592 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3d2d1916761d758b expref: 20 pid: 14162 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869563.189871:0:14153:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff94c83504d600/0x3d2d1916761d7592 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x3d2d1916761d758b expref: 20 pid: 14162 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869563.189903:0:14153:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff94c83504d600/0x3d2d1916761d7592 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x3d2d1916761d758b expref: 20 pid: 14162 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869563.189918:0:14153:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788869563.189971:0:14153:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c835a15500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cd496ea5-7761-4e68-8a6b-58e98659ad4a+19:3283:x1875765421496960:12345-0@lo:103:ldlm_bl.0 Request processed in 134us (1686us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869563.189978:0:14153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788869563.190002:0:14153:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:2.0:1788869563.190011:0:14153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788869563.190017:0:14153:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c816f05050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cd496ea5-7761-4e68-8a6b-58e98659ad4a+18:3283:x1875765421497088:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788869563.190026:0:14153:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788869563.190031:0:14153:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff94c805038800/0x3d2d1916761d7545 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3d2d1916761d753e expref: 18 pid: 14161 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869563.190039:0:14153:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff94c805038800/0x3d2d1916761d7545 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x3d2d1916761d753e expref: 18 pid: 14161 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869563.190048:0:14153:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff94c805038800/0x3d2d1916761d7545 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x3d2d1916761d753e expref: 18 pid: 14161 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869563.190058:0:14153:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788869563.190678:0:14153:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c816f05050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cd496ea5-7761-4e68-8a6b-58e98659ad4a+17:3283:x1875765421497088:12345-0@lo:103:ldlm_bl.0 Request processed in 657us (2333us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869563.190688:0:14153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788869563.190754:0:3283:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94c8354d0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:cd496ea5-7761-4e68-8a6b-58e98659ad4a:3283:1875765421497088:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788869563.190768:0:3283:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94c8354d2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:cd496ea5-7761-4e68-8a6b-58e98659ad4a:3283:1875765421496960:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788869563.191361:0:14154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c8354d3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cd496ea5-7761-4e68-8a6b-58e98659ad4a+16:3285:x1875765421496832:12345-0@lo:103:ldlm_bl.0 Request processed in 2391us (3194us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869563.191373:0:14154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788869563.191634:0:3285:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94c8354d1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:cd496ea5-7761-4e68-8a6b-58e98659ad4a:3285:1875765421496832:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788869563.192170:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1788869563.192400:0:16186:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94c8354d2a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16186:1875765421496192:192.168.201.39@tcp:104: 00000100:00100000:3.0:1788869563.192505:0:16186:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94c8354d2300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16186:1875765421496320:192.168.201.39@tcp:104: 00010000:00010000:3.0:1788869563.192547:0:16186:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff94c702257c00/0x3d2d1916761d784e lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 16186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788869563.192659:0:14153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765413127680 00000100:00100000:0.0:1788869563.192667:0:14153:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765413127680 00010000:00010000:0.0:1788869563.192713:0:14153:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff94c805039c00/0x3d2d1916761d7824 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.201.39@tcp remote: 0x375c010249035ca7 expref: 13 pid: 14161 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788869563.192753:0:14153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 7 00000100:00100000:0.0:1788869563.192764:0:14153:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c835a15880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:027d934b-b9c0-4e83-b9af-2634761ebef6+13:2347:x1875765413127680:12345-192.168.201.39@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788869563.192783:0:14153:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788869563.192900:0:14153:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff94c805039c00/0x3d2d1916761d7824 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.201.39@tcp remote: 0x375c010249035ca7 expref: 13 pid: 14161 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869563.192917:0:14153:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff94c805039c00/0x3d2d1916761d7824 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.201.39@tcp remote: 0x375c010249035ca7 expref: 13 pid: 14161 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869563.192940:0:14153:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff94c805039c00/0x3d2d1916761d7824 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.201.39@tcp remote: 0x375c010249035ca7 expref: 13 pid: 14161 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869563.192958:0:14153:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788869563.193054:0:14153:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c835a15880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:027d934b-b9c0-4e83-b9af-2634761ebef6+12:2347:x1875765413127680:12345-192.168.201.39@tcp:103:ldlm_bl.0 Request processed in 292us (888us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869563.193073:0:14153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 7 00000100:00100000:0.0:1788869563.206538:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1788869563.206743:0:14154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765413127808 00000100:00100000:2.0:1788869563.206758:0:14154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765413127808 00010000:00010000:2.0:1788869563.206999:0:14154:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff94c805039400/0x3d2d1916761d77ec lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.201.39@tcp remote: 0x375c010249035c45 expref: 12 pid: 14163 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788869563.207139:0:14154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 8 00000100:00100000:2.0:1788869563.207152:0:14154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c83fbb1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:027d934b-b9c0-4e83-b9af-2634761ebef6+12:2348:x1875765413127808:12345-192.168.201.39@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788869563.207175:0:14154:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788869563.207183:0:14154:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff94c805039400/0x3d2d1916761d77ec lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.201.39@tcp remote: 0x375c010249035c45 expref: 12 pid: 14163 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869563.207197:0:14154:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff94c805039400/0x3d2d1916761d77ec lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.201.39@tcp remote: 0x375c010249035c45 expref: 12 pid: 14163 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869563.207230:0:14154:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff94c805039400/0x3d2d1916761d77ec lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.201.39@tcp remote: 0x375c010249035c45 expref: 12 pid: 14163 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869563.207307:0:14154:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff94c702257c00/0x3d2d1916761d784e lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 16186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869563.207318:0:14154:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff94c702257c00/0x3d2d1916761d784e lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 16186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869563.207343:0:14154:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff94c702257c00/0x3d2d1916761d784e lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 16186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869563.207352:0:14154:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff94c702257c00/0x3d2d1916761d784e lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 16186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869563.207359:0:14154:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff94c702257c00/0x3d2d1916761d784e lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 16186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869563.207396:0:14154:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff94c702257c00/0x3d2d1916761d784e lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 16186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869563.207405:0:14154:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94c702257c00 already unused, calling callback (ffffffffc1703220) 00010000:00010000:2.0:1788869563.207409:0:14154:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff94c702257c00/0x3d2d1916761d784e lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 16186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869563.207419:0:14154:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff94c702257c00/0x3d2d1916761d784e lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 16186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869563.207927:0:16186:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff94c702257c00/0x3d2d1916761d784e lrc: 5/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869563.207953:0:16186:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff94c702257c00/0x3d2d1916761d784e lrc: 5/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869563.209054:0:14154:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff94c702257c00/0x3d2d1916761d784e lrc: 3/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869563.209140:0:14154:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff94c702257c00/0x3d2d1916761d784e lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869563.209166:0:14154:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788869563.209471:0:14154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c83fbb1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:027d934b-b9c0-4e83-b9af-2634761ebef6+11:2348:x1875765413127808:12345-192.168.201.39@tcp:103:ldlm_bl.0 Request processed in 2313us (2939us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869563.209484:0:14154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 8 00000100:00100000:0.0:1788869563.318434:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1788869563.318531:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1788869563.318548:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1788869563.318560:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1788869563.318575:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1788869563.318697:0:14806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765413128192 00000100:00100000:1.0:1788869563.318713:0:14806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765413128192 00000100:00100000:1.0:1788869563.318805:0:14806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765413128448 00000100:00100000:1.0:1788869563.318808:0:14806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765413128448 00000100:00100000:1.0:1788869563.318824:0:14806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765413128064 00000100:00100000:1.0:1788869563.318826:0:14806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765413128064 00000100:00100000:1.0:1788869563.318847:0:14806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 7 00000100:00100000:1.0:1788869563.318859:0:14806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c83fbb1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8eec8521-73a5-4f2d-941c-80b702633766+5:2345:x1875765413128192:12345-192.168.201.39@tcp:400:kworker.0 00000100:00100000:1.0:1788869563.318974:0:14806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c83fbb1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8eec8521-73a5-4f2d-941c-80b702633766+5:2345:x1875765413128192:12345-192.168.201.39@tcp:400:kworker.0 Request processed in 116us (441us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869563.318983:0:14806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 7 00000100:00100000:1.0:1788869563.319004:0:14806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 8 00000100:00100000:1.0:1788869563.319010:0:14806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c83fbb3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b859f31b-9885-425c-b9a4-5a4e02335486+5:2345:x1875765413128448:12345-192.168.201.39@tcp:400:kworker.0 00000100:00100000:1.0:1788869563.319037:0:14806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c83fbb3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b859f31b-9885-425c-b9a4-5a4e02335486+5:2345:x1875765413128448:12345-192.168.201.39@tcp:400:kworker.0 Request processed in 27us (487us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869563.319044:0:14806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 8 00000100:00100000:1.0:1788869563.319057:0:14806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 9 00000100:00100000:1.0:1788869563.319063:0:14806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c83fbb0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8eec8521-73a5-4f2d-941c-80b702633766+5:2345:x1875765413128064:12345-192.168.201.39@tcp:400:kworker.0 00000100:00100000:1.0:1788869563.319087:0:14806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c83fbb0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8eec8521-73a5-4f2d-941c-80b702633766+5:2345:x1875765413128064:12345-192.168.201.39@tcp:400:kworker.0 Request processed in 24us (524us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869563.319094:0:14806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 9 00000100:00080000:1.0:1788869563.319138:0:14164:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788869563.319154:0:14164:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788869563.319785:0:14170:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765413127936 00000100:00100000:3.0:1788869563.319794:0:14170:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765413127936 00000100:00100000:3.0:1788869563.319880:0:14170:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765413128320 00000100:00100000:3.0:1788869563.319883:0:14170:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765413128320 00000100:00080000:0.0:1788869563.319906:0:14164:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788869563.330225:0:14169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 21 00000100:00100000:3.0:1788869563.330378:0:14169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c83fbb2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8eec8521-73a5-4f2d-941c-80b702633766+6:2345:x1875765413127936:12345-192.168.201.39@tcp:400:kworker.0 00000100:00100000:3.0:1788869563.330615:0:14169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c83fbb2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8eec8521-73a5-4f2d-941c-80b702633766+6:2345:x1875765413127936:12345-192.168.201.39@tcp:400:kworker.0 Request processed in 371us (12543us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869563.330635:0:14169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 21 00000100:00100000:3.0:1788869563.330663:0:14169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 22 00000100:00100000:3.0:1788869563.330670:0:14169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c83fbb1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b859f31b-9885-425c-b9a4-5a4e02335486+6:2345:x1875765413128320:12345-192.168.201.39@tcp:400:kworker.0 00000100:00100000:3.0:1788869563.330694:0:14169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c83fbb1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b859f31b-9885-425c-b9a4-5a4e02335486+6:2345:x1875765413128320:12345-192.168.201.39@tcp:400:kworker.0 Request processed in 26us (12119us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869563.330699:0:14169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 22 00000100:00100000:3.0:1788869563.331309:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1788869563.331483:0:14806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765413128576 00000100:00100000:3.0:1788869563.332077:0:14806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765413128576 00000100:00100000:3.0:1788869563.332301:0:14806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 10 00000100:00100000:3.0:1788869563.332313:0:14806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c835a17100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b859f31b-9885-425c-b9a4-5a4e02335486+5:2345:x1875765413128576:12345-192.168.201.39@tcp:400:kworker.0 00000100:00100000:3.0:1788869563.332397:0:14806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c835a17100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b859f31b-9885-425c-b9a4-5a4e02335486+5:2345:x1875765413128576:12345-192.168.201.39@tcp:400:kworker.0 Request processed in 86us (1092us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869563.332407:0:14806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 10 00000100:00080000:1.0:1788869563.333374:0:14164:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:3.0:1788869563.995475:0:14156:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788869564.332106:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1788869564.332866:0:14161:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765413128704 00000100:00100000:2.0:1788869564.332883:0:14161:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765413128704 00000100:00100000:3.0:1788869564.333139:0:14161:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 105 00000100:00100000:3.0:1788869564.333151:0:14161:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c81f234c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:027d934b-b9c0-4e83-b9af-2634761ebef6+11:13674:x1875765413128704:12345-192.168.201.39@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788869564.333175:0:14161:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788869564.336695:0:14161:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff94c702256600/0x3d2d1916761d7855 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x375c010249035cd8 expref: -99 pid: 14161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869564.337768:0:14161:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff94c702256600/0x3d2d1916761d7855 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.201.39@tcp remote: 0x375c010249035cd8 expref: 12 pid: 14161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869564.337823:0:14161:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff94c702256600/0x3d2d1916761d7855 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.201.39@tcp remote: 0x375c010249035cd8 expref: 12 pid: 14161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869564.337835:0:14161:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94c702256600, rc 0) 00000100:00100000:3.0:1788869564.337953:0:14161:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c81f234c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:027d934b-b9c0-4e83-b9af-2634761ebef6+12:13674:x1875765413128704:12345-192.168.201.39@tcp:101:ll_cfg_requeue.0 Request processed in 4802us (5862us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869564.337964:0:14161:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 105 00000100:00100000:1.0:1788869564.340901:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1788869564.341072:0:14162:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765413128832 00000100:00100000:0.0:1788869564.341086:0:14162:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765413128832 00000100:00100000:0.0:1788869564.341148:0:14162:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 106 00000100:00100000:0.0:1788869564.341160:0:14162:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c81f235050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:027d934b-b9c0-4e83-b9af-2634761ebef6+12:13674:x1875765413128832:12345-192.168.201.39@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788869564.343505:0:14162:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c81f235050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:027d934b-b9c0-4e83-b9af-2634761ebef6+12:13674:x1875765413128832:12345-192.168.201.39@tcp:501:ll_cfg_requeue.0 Request processed in 2330us (2601us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869564.343525:0:14162:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 106 00000100:00100000:3.0:1788869564.352687:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1788869564.352789:0:14161:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765413128960 00000100:00100000:2.0:1788869564.352802:0:14161:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765413128960 00000100:00100000:2.0:1788869564.352877:0:14161:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 107 00000100:00100000:2.0:1788869564.352889:0:14161:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c81f237050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:027d934b-b9c0-4e83-b9af-2634761ebef6+12:13674:x1875765413128960:12345-192.168.201.39@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788869564.353183:0:14161:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c81f237050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:027d934b-b9c0-4e83-b9af-2634761ebef6+12:13674:x1875765413128960:12345-192.168.201.39@tcp:503:ll_cfg_requeue.0 Request processed in 296us (512us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869564.353205:0:14161:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 107 00000100:00100000:3.0:1788869564.361515:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1788869564.361760:0:14162:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765413129088 00000100:00100000:2.0:1788869564.361774:0:14162:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765413129088 00000100:00100000:2.0:1788869564.361858:0:14162:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 108 00000100:00100000:2.0:1788869564.361870:0:14162:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c834d3b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:027d934b-b9c0-4e83-b9af-2634761ebef6+12:13674:x1875765413129088:12345-192.168.201.39@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788869564.361892:0:14162:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788869564.361916:0:14162:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff94c805039c00/0x3d2d1916761d785c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x375c010249035cdf expref: -99 pid: 14162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869564.361953:0:14162:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff94c805039c00/0x3d2d1916761d785c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.201.39@tcp remote: 0x375c010249035cdf expref: 13 pid: 14162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869564.361966:0:14162:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff94c805039c00/0x3d2d1916761d785c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.201.39@tcp remote: 0x375c010249035cdf expref: 13 pid: 14162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869564.361978:0:14162:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94c805039c00, rc 0) 00000100:00100000:2.0:1788869564.362064:0:14162:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c834d3b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:027d934b-b9c0-4e83-b9af-2634761ebef6+13:13674:x1875765413129088:12345-192.168.201.39@tcp:101:ll_cfg_requeue.0 Request processed in 195us (564us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869564.362071:0:14162:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 108 00000100:00100000:2.0:1788869564.367483:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1788869564.367562:0:14163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765413129216 00000100:00100000:3.0:1788869564.367574:0:14163:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765413129216 00000100:00100000:3.0:1788869564.367642:0:14163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 109 00000100:00100000:3.0:1788869564.367654:0:14163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c834d3a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:027d934b-b9c0-4e83-b9af-2634761ebef6+13:13674:x1875765413129216:12345-192.168.201.39@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788869564.368024:0:14163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c834d3a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:027d934b-b9c0-4e83-b9af-2634761ebef6+13:13674:x1875765413129216:12345-192.168.201.39@tcp:501:ll_cfg_requeue.0 Request processed in 371us (551us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869564.368046:0:14163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 109 00000100:00100000:2.0:1788869564.372840:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1788869564.372937:0:14161:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765413129344 00000100:00100000:0.0:1788869564.372951:0:14161:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765413129344 00000100:00100000:0.0:1788869564.373028:0:14161:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 110 00000100:00100000:0.0:1788869564.373040:0:14161:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c834d3b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:027d934b-b9c0-4e83-b9af-2634761ebef6+13:13674:x1875765413129344:12345-192.168.201.39@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788869564.373357:0:14161:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c834d3b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:027d934b-b9c0-4e83-b9af-2634761ebef6+13:13674:x1875765413129344:12345-192.168.201.39@tcp:503:ll_cfg_requeue.0 Request processed in 319us (532us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869564.373367:0:14161:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 110 10000000:01000000:2.0:1788869564.635618:0:14165:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1788869564.635629:0:14165:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff94c810e50000 from 10 10000000:01000000:2.0:1788869564.635635:0:14165:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788869564.635696:0:14165:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.139@tcp lock: ffff94c805038c00/0x3d2d1916761d7863 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869564.635711:0:14165:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.139@tcp lock: ffff94c805038c00/0x3d2d1916761d7863 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869564.635724:0:14165:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.139@tcp lock: ffff94c805038c00/0x3d2d1916761d7863 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788869564.635774:0:14165:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94c82cdc5500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cd496ea5-7761-4e68-8a6b-58e98659ad4a:14165:1875765421497216:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788869564.635864:0:14165:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869564.635920:0:14165:0:(client.c:2702:ptlrpc_set_wait()) set ffff94c818d26300 going to sleep for 11 seconds 00000100:00100000:2.0:1788869564.635946:0:14162:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765421497216 00000100:00100000:2.0:1788869564.635955:0:14162:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765421497216 00000100:00100000:2.0:1788869564.636026:0:14162:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:2.0:1788869564.636036:0:14162:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c834d3ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cd496ea5-7761-4e68-8a6b-58e98659ad4a+16:14165:x1875765421497216:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788869564.636053:0:14162:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788869564.636071:0:14162:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff94c805039600/0x3d2d1916761d786a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x3d2d1916761d7863 expref: -99 pid: 14162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869564.636099:0:14162:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff94c805039600/0x3d2d1916761d786a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3d2d1916761d7863 expref: 17 pid: 14162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869564.636111:0:14162:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff94c805039600/0x3d2d1916761d786a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3d2d1916761d7863 expref: 17 pid: 14162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869564.636122:0:14162:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94c805039600, rc 0) 00000100:00100000:2.0:1788869564.636163:0:14162:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c834d3ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cd496ea5-7761-4e68-8a6b-58e98659ad4a+17:14165:x1875765421497216:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 129us (299us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869564.636171:0:14162:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:2.0:1788869564.636269:0:14165:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94c82cdc5500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cd496ea5-7761-4e68-8a6b-58e98659ad4a:14165:1875765421497216:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788869564.636288:0:14165:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.139@tcp lock: ffff94c805038c00/0x3d2d1916761d7863 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3d2d1916761d786a expref: -99 pid: 14165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869564.636298:0:14165:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.139@tcp lock: ffff94c805038c00/0x3d2d1916761d7863 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x3d2d1916761d786a expref: -99 pid: 14165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788869564.636367:0:14165:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94c82cdc5500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cd496ea5-7761-4e68-8a6b-58e98659ad4a:14165:1875765421497344:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788869564.636395:0:14165:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869564.636416:0:14165:0:(client.c:2702:ptlrpc_set_wait()) set ffff94c818d26300 going to sleep for 11 seconds 00000100:00100000:2.0:1788869564.636430:0:14163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765421497344 00000100:00100000:2.0:1788869564.636434:0:14163:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765421497344 00000100:00100000:2.0:1788869564.636455:0:14163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:2.0:1788869564.636461:0:14163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c83e0c8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cd496ea5-7761-4e68-8a6b-58e98659ad4a+17:14165:x1875765421497344:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788869564.636783:0:14163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c83e0c8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cd496ea5-7761-4e68-8a6b-58e98659ad4a+17:14165:x1875765421497344:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 321us (387us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869564.636791:0:14163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:2.0:1788869564.636823:0:14165:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94c82cdc5500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cd496ea5-7761-4e68-8a6b-58e98659ad4a:14165:1875765421497344:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788869564.636858:0:14165:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94c82cdc5500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cd496ea5-7761-4e68-8a6b-58e98659ad4a:14165:1875765421497472:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788869564.636905:0:14165:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869564.636918:0:14165:0:(client.c:2702:ptlrpc_set_wait()) set ffff94c818d26300 going to sleep for 11 seconds 00000100:00100000:2.0:1788869564.636933:0:14161:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765421497472 00000100:00100000:2.0:1788869564.636937:0:14161:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765421497472 00000100:00100000:2.0:1788869564.636960:0:14161:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:2.0:1788869564.636966:0:14161:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c83e0ca850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cd496ea5-7761-4e68-8a6b-58e98659ad4a+17:14165:x1875765421497472:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788869564.637129:0:14161:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c83e0ca850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cd496ea5-7761-4e68-8a6b-58e98659ad4a+17:14165:x1875765421497472:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 163us (224us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869564.637137:0:14161:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:2.0:1788869564.637173:0:14165:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94c82cdc5500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cd496ea5-7761-4e68-8a6b-58e98659ad4a:14165:1875765421497472:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1788869564.647363:0:16239:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:2.0:1788869564.648301:0:14165:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:2.0:1788869564.648354:0:14165:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.139@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788869564.648368:0:14165:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.139@tcp lock: ffff94c805038c00/0x3d2d1916761d7863 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3d2d1916761d786a expref: -99 pid: 14165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869564.648382:0:14165:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.139@tcp lock: ffff94c805038c00/0x3d2d1916761d7863 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3d2d1916761d786a expref: -99 pid: 14165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788869564.648394:0:14165:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1788869564.648398:0:14165:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff94c8101da800 from 10 10000000:01000000:2.0:1788869564.648401:0:14165:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788869564.648450:0:14165:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.139@tcp lock: ffff94c805038400/0x3d2d1916761d7871 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869564.648460:0:14165:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.139@tcp lock: ffff94c805038400/0x3d2d1916761d7871 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869564.648473:0:14165:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.139@tcp lock: ffff94c805038400/0x3d2d1916761d7871 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788869564.648510:0:14165:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94c82cdc5500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cd496ea5-7761-4e68-8a6b-58e98659ad4a:14165:1875765421497600:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788869564.648767:0:14165:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869564.648824:0:14165:0:(client.c:2702:ptlrpc_set_wait()) set ffff94c839dc5480 going to sleep for 11 seconds 00000100:00100000:3.0:1788869564.648884:0:14162:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765421497600 00000100:00100000:3.0:1788869564.648896:0:14162:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765421497600 00000100:00100000:3.0:1788869564.648961:0:14162:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:3.0:1788869564.648972:0:14162:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c83e0c9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cd496ea5-7761-4e68-8a6b-58e98659ad4a+17:14165:x1875765421497600:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788869564.648988:0:14162:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788869564.649004:0:14162:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff94c702256a00/0x3d2d1916761d7878 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x3d2d1916761d7871 expref: -99 pid: 14162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869564.649031:0:14162:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff94c702256a00/0x3d2d1916761d7878 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3d2d1916761d7871 expref: 18 pid: 14162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869564.649053:0:14162:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff94c702256a00/0x3d2d1916761d7878 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3d2d1916761d7871 expref: 18 pid: 14162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869564.649063:0:14162:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94c702256a00, rc 0) 00000100:00100000:3.0:1788869564.649114:0:14162:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c83e0c9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cd496ea5-7761-4e68-8a6b-58e98659ad4a+18:14165:x1875765421497600:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 144us (348us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869564.649122:0:14162:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:0.0:1788869564.649271:0:14165:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94c82cdc5500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cd496ea5-7761-4e68-8a6b-58e98659ad4a:14165:1875765421497600:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788869564.649291:0:14165:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.139@tcp lock: ffff94c805038400/0x3d2d1916761d7871 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x3d2d1916761d7878 expref: -99 pid: 14165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869564.649309:0:14165:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.139@tcp lock: ffff94c805038400/0x3d2d1916761d7871 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x3d2d1916761d7878 expref: -99 pid: 14165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788869564.649377:0:14165:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94c83fbb0e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cd496ea5-7761-4e68-8a6b-58e98659ad4a:14165:1875765421497728:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788869564.649411:0:14165:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869564.649441:0:14165:0:(client.c:2702:ptlrpc_set_wait()) set ffff94c8033c4900 going to sleep for 11 seconds 00000100:00100000:3.0:1788869564.649497:0:14163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765421497728 00000100:00100000:3.0:1788869564.649502:0:14163:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765421497728 00000100:00100000:3.0:1788869564.649534:0:14163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:3.0:1788869564.649541:0:14163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c83e0cb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cd496ea5-7761-4e68-8a6b-58e98659ad4a+18:14165:x1875765421497728:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788869564.649865:0:14163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c83e0cb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cd496ea5-7761-4e68-8a6b-58e98659ad4a+18:14165:x1875765421497728:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 323us (452us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869564.649874:0:14163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:0.0:1788869564.650017:0:14165:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94c83fbb0e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cd496ea5-7761-4e68-8a6b-58e98659ad4a:14165:1875765421497728:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788869564.650056:0:14165:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94c83fbb0e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cd496ea5-7761-4e68-8a6b-58e98659ad4a:14165:1875765421497856:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788869564.650099:0:14165:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869564.650138:0:14165:0:(client.c:2702:ptlrpc_set_wait()) set ffff94c8033c4900 going to sleep for 11 seconds 00000100:00100000:2.0:1788869564.650218:0:14161:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765421497856 00000100:00100000:2.0:1788869564.650223:0:14161:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765421497856 00000100:00100000:2.0:1788869564.650279:0:14161:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:2.0:1788869564.650289:0:14161:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c83e0cb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cd496ea5-7761-4e68-8a6b-58e98659ad4a+18:14165:x1875765421497856:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788869564.650465:0:14161:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c83e0cb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cd496ea5-7761-4e68-8a6b-58e98659ad4a+18:14165:x1875765421497856:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 177us (364us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869564.650472:0:14161:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:0.0:1788869564.650574:0:14165:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94c83fbb0e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cd496ea5-7761-4e68-8a6b-58e98659ad4a:14165:1875765421497856:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1788869564.652676:0:16241:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:1.0:1788869564.652889:0:14165:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:1.0:1788869564.652917:0:14165:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.139@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788869564.652932:0:14165:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.139@tcp lock: ffff94c805038400/0x3d2d1916761d7871 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x3d2d1916761d7878 expref: -99 pid: 14165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869564.652946:0:14165:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.139@tcp lock: ffff94c805038400/0x3d2d1916761d7871 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x3d2d1916761d7878 expref: -99 pid: 14165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788869564.652958:0:14165:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1788869564.652961:0:14165:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff94c83f9d2800 from 10 10000000:01000000:1.0:1788869564.652964:0:14165:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788869564.653015:0:14165:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.139@tcp lock: ffff94c83fde7400/0x3d2d1916761d787f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869564.653025:0:14165:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.139@tcp lock: ffff94c83fde7400/0x3d2d1916761d787f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869564.653037:0:14165:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.139@tcp lock: ffff94c83fde7400/0x3d2d1916761d787f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788869564.653068:0:14165:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94c83fae8000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cd496ea5-7761-4e68-8a6b-58e98659ad4a:14165:1875765421497984:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788869564.653156:0:14165:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869564.653224:0:14165:0:(client.c:2702:ptlrpc_set_wait()) set ffff94c820d006c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788869564.653326:0:14161:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765421497984 00000100:00100000:2.0:1788869564.653355:0:14161:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765421497984 00000100:00100000:2.0:1788869564.653413:0:14161:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:2.0:1788869564.653424:0:14161:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c83e0cac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cd496ea5-7761-4e68-8a6b-58e98659ad4a+18:14165:x1875765421497984:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788869564.653442:0:14161:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788869564.653459:0:14161:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff94c805039a00/0x3d2d1916761d7886 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x3d2d1916761d787f expref: -99 pid: 14161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869564.653489:0:14161:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff94c805039a00/0x3d2d1916761d7886 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3d2d1916761d787f expref: 19 pid: 14161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869564.653501:0:14161:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff94c805039a00/0x3d2d1916761d7886 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3d2d1916761d787f expref: 19 pid: 14161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869564.653510:0:14161:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94c805039a00, rc 0) 00000100:00100000:2.0:1788869564.653684:0:14161:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c83e0cac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cd496ea5-7761-4e68-8a6b-58e98659ad4a+19:14165:x1875765421497984:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 262us (527us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869564.653693:0:14161:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:1.0:1788869564.653786:0:14165:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94c83fae8000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cd496ea5-7761-4e68-8a6b-58e98659ad4a:14165:1875765421497984:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788869564.653803:0:14165:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.139@tcp lock: ffff94c83fde7400/0x3d2d1916761d787f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x3d2d1916761d7886 expref: -99 pid: 14165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869564.653827:0:14165:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.139@tcp lock: ffff94c83fde7400/0x3d2d1916761d787f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x3d2d1916761d7886 expref: -99 pid: 14165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788869564.653898:0:14165:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94c83fae8000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cd496ea5-7761-4e68-8a6b-58e98659ad4a:14165:1875765421498112:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788869564.653931:0:14165:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869564.653966:0:14165:0:(client.c:2702:ptlrpc_set_wait()) set ffff94c820d006c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788869564.654010:0:14163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765421498112 00000100:00100000:2.0:1788869564.654014:0:14163:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765421498112 00000100:00100000:2.0:1788869564.654044:0:14163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:2.0:1788869564.654052:0:14163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c83e0ca450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cd496ea5-7761-4e68-8a6b-58e98659ad4a+19:14165:x1875765421498112:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788869564.654433:0:14163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c83e0ca450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cd496ea5-7761-4e68-8a6b-58e98659ad4a+19:14165:x1875765421498112:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 380us (500us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869564.654441:0:14163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:1.0:1788869564.654648:0:14165:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94c83fae8000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cd496ea5-7761-4e68-8a6b-58e98659ad4a:14165:1875765421498112:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788869564.654685:0:14165:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94c83fae8000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cd496ea5-7761-4e68-8a6b-58e98659ad4a:14165:1875765421498240:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788869564.654732:0:14165:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869564.654765:0:14165:0:(client.c:2702:ptlrpc_set_wait()) set ffff94c820d006c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788869564.654807:0:14161:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765421498240 00000100:00100000:2.0:1788869564.654812:0:14161:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765421498240 00000100:00100000:2.0:1788869564.654850:0:14161:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:2.0:1788869564.654858:0:14161:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c83e0cbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cd496ea5-7761-4e68-8a6b-58e98659ad4a+19:14165:x1875765421498240:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788869564.655049:0:14161:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c83e0cbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cd496ea5-7761-4e68-8a6b-58e98659ad4a+19:14165:x1875765421498240:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 191us (316us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869564.655056:0:14161:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:1.0:1788869564.655155:0:14165:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94c83fae8000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cd496ea5-7761-4e68-8a6b-58e98659ad4a:14165:1875765421498240:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1788869564.681440:0:16242:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:3.0:1788869564.682830:0:14165:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:3.0:1788869564.682875:0:14165:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.139@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788869564.682892:0:14165:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.139@tcp lock: ffff94c83fde7400/0x3d2d1916761d787f lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x3d2d1916761d7886 expref: -99 pid: 14165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869564.682908:0:14165:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.139@tcp lock: ffff94c83fde7400/0x3d2d1916761d787f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x3d2d1916761d7886 expref: -99 pid: 14165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869565.020500:0:15140:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788869565.020974:0:3285:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94c83fae8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3285:1875765421498368:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788869565.021091:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869565.023467:0:14807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765421498368 00000100:00100000:3.0:1788869565.023482:0:14807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765421498368 00000100:00100000:3.0:1788869565.023578:0:14807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788869565.023589:0:14807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c83faeb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3285:x1875765421498368:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788869565.023644:0:14807:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788869565.023751:0:14807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c83faeb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3285:x1875765421498368:12345-0@lo:13:osp-pre-0-0.0 Request processed in 163us (2660us total) trans 0 rc 0/0 00000100:00080000:1.0:1788869565.023759:0:14164:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788869565.023761:0:14807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788869565.023898:0:3285:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94c83fae8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3285:1875765421498368:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1788869566.044578:0:14157:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788869566.682394:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1788869566.682590:0:14168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765413129472 00000100:00100000:1.0:1788869566.682601:0:14168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765413129472 00000100:00100000:1.0:1788869566.682732:0:14168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 15 00000100:00100000:1.0:1788869566.682743:0:14168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c835a14000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8eec8521-73a5-4f2d-941c-80b702633766+6:14329:x1875765413129472:12345-192.168.201.39@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788869566.682764:0:14168:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788869566.682787:0:14168:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94c83fde7200/0x3d2d1916761d788d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x375c010249035ce6 expref: -99 pid: 14168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869566.682871:0:14168:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff94c83fde7000/0x3d2d1916761d7894 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869566.682885:0:14168:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94c83fde7000/0x3d2d1916761d7894 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869566.684062:0:14168:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94c83fde7000/0x3d2d1916761d7894 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869566.684095:0:14168:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94c83fde6600/0x3d2d1916761d789b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869566.684103:0:14168:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94c83fde6600/0x3d2d1916761d789b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869566.684109:0:14168:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94c83fde6600/0x3d2d1916761d789b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14168 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1788869566.684634:0:14164:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000040:00080000:3.0:1788869566.684832:0:14201:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1788869566.685510:0:14168:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94c83fde6e00/0x3d2d1916761d78a2 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869566.685524:0:14168:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94c83fde6e00/0x3d2d1916761d78a2 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869566.685532:0:14168:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94c83fde6e00/0x3d2d1916761d78a2 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14168 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788869566.685614:0:14168:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 6656 00000004:00200000:1.0:1788869566.685619:0:14168:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:1.0:1788869566.685712:0:14168:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff94c83fde6e00/0x3d2d1916761d78a2 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869566.685735:0:14168:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff94c83fde7000/0x3d2d1916761d7894 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869566.685742:0:14168:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94c83fde7000/0x3d2d1916761d7894 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869566.685749:0:14168:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94c83fde7000/0x3d2d1916761d7894 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869566.685755:0:14168:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94c83fde7000 already unused, calling callback (ffffffffc21124f0) 00010000:00010000:1.0:1788869566.685760:0:14168:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94c83fde7000/0x3d2d1916761d7894 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869566.685768:0:14168:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94c83fde7000/0x3d2d1916761d7894 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869566.685781:0:14168:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff94c802db2100) 00010000:00010000:1.0:1788869566.685784:0:14168:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788869566.685789:0:14168:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94c83fde7000/0x3d2d1916761d7894 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869566.685795:0:14168:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94c83fde7000/0x3d2d1916761d7894 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869566.685806:0:14168:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94c83fde6600/0x3d2d1916761d789b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869566.685813:0:14168:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94c83fde6600/0x3d2d1916761d789b lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869566.685818:0:14168:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94c83fde6600/0x3d2d1916761d789b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869566.685830:0:14168:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94c83fde6600 already unused, calling callback (ffffffffc21124f0) 00010000:00010000:1.0:1788869566.685833:0:14168:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94c83fde6600/0x3d2d1916761d789b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869566.685840:0:14168:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94c83fde6600/0x3d2d1916761d789b lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869566.685848:0:14168:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff94c81a585a00) 00010000:00010000:1.0:1788869566.685851:0:14168:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788869566.685854:0:14168:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94c83fde6600/0x3d2d1916761d789b lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869566.685860:0:14168:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94c83fde6600/0x3d2d1916761d789b lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869566.686059:0:14168:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94c83fde7200/0x3d2d1916761d788d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0x375c010249035ce6 expref: 8 pid: 14168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869566.686077:0:14168:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94c83fde6e00/0x3d2d1916761d78a2 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0x375c010249035ce6 expref: 7 pid: 14168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869566.686085:0:14168:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff94c81a585800) 00010000:00010000:1.0:1788869566.686087:0:14168:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788869566.686089:0:14168:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94c83fde6e00, rc 0) 00000100:00100000:1.0:1788869566.686234:0:14168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c835a14000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8eec8521-73a5-4f2d-941c-80b702633766+7:14329:x1875765413129472:12345-192.168.201.39@tcp:101:lhsmtool_posix.0 Request processed in 3491us (3846us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869566.686244:0:14168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 15 00000100:00100000:0.0:1788869566.697689:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1788869566.697779:0:14169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765413129728 00000100:00100000:3.0:1788869566.697788:0:14169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765413129728 00000100:00100000:3.0:1788869566.697853:0:14169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 16 00000100:00100000:3.0:1788869566.697864:0:14169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c83fbb0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8eec8521-73a5-4f2d-941c-80b702633766+7:14329:x1875765413129728:12345-192.168.201.39@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788869566.697885:0:14169:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788869566.697906:0:14169:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94c702256800/0x3d2d1916761d78a9 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x375c010249035ced expref: -99 pid: 14169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869566.697982:0:14169:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff94c702257a00/0x3d2d1916761d78b0 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869566.697998:0:14169:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94c702257a00/0x3d2d1916761d78b0 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869566.698009:0:14169:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94c702257a00/0x3d2d1916761d78b0 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869566.698024:0:14169:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94c702257e00/0x3d2d1916761d78b7 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869566.698032:0:14169:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94c702257e00/0x3d2d1916761d78b7 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869566.698039:0:14169:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94c702257e00/0x3d2d1916761d78b7 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869566.698623:0:14169:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94c702257600/0x3d2d1916761d78be lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869566.698635:0:14169:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94c702257600/0x3d2d1916761d78be lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869566.698643:0:14169:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94c702257600/0x3d2d1916761d78be lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14169 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788869566.698654:0:14169:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 6656 00010000:00010000:3.0:1788869566.698930:0:14169:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff94c702257a00/0x3d2d1916761d78b0 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869566.698938:0:14169:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94c702257a00/0x3d2d1916761d78b0 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869566.698946:0:14169:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94c702257a00/0x3d2d1916761d78b0 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869566.698953:0:14169:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94c702257a00 already unused, calling callback (ffffffffc21124f0) 00010000:00010000:3.0:1788869566.698957:0:14169:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94c702257a00/0x3d2d1916761d78b0 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869566.698965:0:14169:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94c702257a00/0x3d2d1916761d78b0 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869566.698978:0:14169:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff94c81a585800) 00010000:00010000:3.0:1788869566.698981:0:14169:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788869566.698986:0:14169:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94c702257a00/0x3d2d1916761d78b0 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869566.699003:0:14169:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94c702257a00/0x3d2d1916761d78b0 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869566.699017:0:14169:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94c702257e00/0x3d2d1916761d78b7 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869566.699024:0:14169:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94c702257e00/0x3d2d1916761d78b7 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869566.699030:0:14169:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94c702257e00/0x3d2d1916761d78b7 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869566.699036:0:14169:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94c702257e00 already unused, calling callback (ffffffffc21124f0) 00010000:00010000:3.0:1788869566.699040:0:14169:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94c702257e00/0x3d2d1916761d78b7 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869566.699046:0:14169:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94c702257e00/0x3d2d1916761d78b7 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869566.699054:0:14169:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff94c810a48400) 00010000:00010000:3.0:1788869566.699056:0:14169:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788869566.699059:0:14169:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94c702257e00/0x3d2d1916761d78b7 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869566.699066:0:14169:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94c702257e00/0x3d2d1916761d78b7 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869566.699654:0:14169:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94c702256800/0x3d2d1916761d78a9 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0x375c010249035ced expref: 10 pid: 14169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869566.699684:0:14169:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94c702257600/0x3d2d1916761d78be lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0x375c010249035ced expref: 9 pid: 14169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869566.699692:0:14169:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff94c810a48000) 00010000:00010000:3.0:1788869566.699695:0:14169:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788869566.699698:0:14169:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94c702257600, rc 0) 00000100:00100000:3.0:1788869566.699811:0:14169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c83fbb0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8eec8521-73a5-4f2d-941c-80b702633766+9:14329:x1875765413129728:12345-192.168.201.39@tcp:101:lhsmtool_posix.0 Request processed in 1948us (2143us total) trans 8589934593 rc 0/0 00000100:00100000:3.0:1788869566.699821:0:14169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 16 00000100:00100000:2.0:1788869566.703829:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1788869566.704367:0:15030:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765413129856 00000100:00100000:0.0:1788869566.704378:0:15030:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765413129856 00000100:00100000:0.0:1788869566.704477:0:15030:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 17 00000100:00100000:0.0:1788869566.704488:0:15030:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c82cdc4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8eec8521-73a5-4f2d-941c-80b702633766+9:14329:x1875765413129856:12345-192.168.201.39@tcp:59:lhsmtool_posix.0 00000100:00100000:0.0:1788869566.704592:0:15030:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c82cdc4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8eec8521-73a5-4f2d-941c-80b702633766+9:14329:x1875765413129856:12345-192.168.201.39@tcp:59:lhsmtool_posix.0 Request processed in 107us (773us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869566.704598:0:15030:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 17 00000100:00100000:0.0:1788869566.734912:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1788869566.735027:0:14170:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765413129984 00000100:00100000:3.0:1788869566.735038:0:14170:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765413129984 00000100:00100000:3.0:1788869566.735132:0:14170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 18 00000100:00100000:3.0:1788869566.735174:0:14170:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c83fbb2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8eec8521-73a5-4f2d-941c-80b702633766+9:14335:x1875765413129984:12345-192.168.201.39@tcp:101:lfs.0 00010000:00010000:3.0:1788869566.735195:0:14170:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788869566.735215:0:14170:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94c702256800/0x3d2d1916761d78cc lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x375c010249035cf4 expref: -99 pid: 14170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869566.735318:0:14170:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff94c702257e00/0x3d2d1916761d78d3 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869566.735333:0:14170:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94c702257e00/0x3d2d1916761d78d3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869566.735345:0:14170:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94c702257e00/0x3d2d1916761d78d3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869566.735359:0:14170:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94c702257a00/0x3d2d1916761d78da lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869566.735372:0:14170:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94c702257a00/0x3d2d1916761d78da lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869566.735379:0:14170:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94c702257a00/0x3d2d1916761d78da lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869566.735594:0:14170:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff94c702257e00/0x3d2d1916761d78d3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869566.735603:0:14170:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94c702257e00/0x3d2d1916761d78d3 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869566.735609:0:14170:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94c702257e00/0x3d2d1916761d78d3 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869566.735615:0:14170:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94c702257e00 already unused, calling callback (ffffffffc21124f0) 00010000:00010000:3.0:1788869566.735619:0:14170:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94c702257e00/0x3d2d1916761d78d3 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869566.735627:0:14170:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94c702257e00/0x3d2d1916761d78d3 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869566.735638:0:14170:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff94c802db2100) 00010000:00010000:3.0:1788869566.735641:0:14170:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788869566.735645:0:14170:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94c702257e00/0x3d2d1916761d78d3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869566.735651:0:14170:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94c702257e00/0x3d2d1916761d78d3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869566.735664:0:14170:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94c702257a00/0x3d2d1916761d78da lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869566.735677:0:14170:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94c702257a00/0x3d2d1916761d78da lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869566.735683:0:14170:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94c702257a00/0x3d2d1916761d78da lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869566.735688:0:14170:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94c702257a00 already unused, calling callback (ffffffffc21124f0) 00010000:00010000:3.0:1788869566.735692:0:14170:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94c702257a00/0x3d2d1916761d78da lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869566.735698:0:14170:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94c702257a00/0x3d2d1916761d78da lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869566.735706:0:14170:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff94c810a48400) 00010000:00010000:3.0:1788869566.735708:0:14170:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788869566.735710:0:14170:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94c702257a00/0x3d2d1916761d78da lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869566.735715:0:14170:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94c702257a00/0x3d2d1916761d78da lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869566.735746:0:14170:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94c702256800/0x3d2d1916761d78cc lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0x375c010249035cf4 expref: 10 pid: 14170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869566.735756:0:14170:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff94c802db2100) 00010000:00010000:3.0:1788869566.735758:0:14170:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788869566.735761:0:14170:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94c702256800/0x3d2d1916761d78cc lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.39@tcp remote: 0x375c010249035cf4 expref: 10 pid: 14170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869566.735782:0:14170:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94c702256800, rc 0) 00000100:00100000:3.0:1788869566.735898:0:14170:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c83fbb2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8eec8521-73a5-4f2d-941c-80b702633766+9:14335:x1875765413129984:12345-192.168.201.39@tcp:101:lfs.0 Request processed in 757us (995us total) trans 0 rc 301/301 00000100:00100000:3.0:1788869566.735907:0:14170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 18 00000100:00100000:2.0:1788869566.738815:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1788869566.739116:0:14177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765413130112 00000100:00100000:0.0:1788869566.739125:0:14177:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765413130112 00000100:00100000:0.0:1788869566.739188:0:14177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 0 00000100:00100000:0.0:1788869566.739198:0:14177:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c82cdc5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:8eec8521-73a5-4f2d-941c-80b702633766+9:14335:x1875765413130112:12345-192.168.201.39@tcp:700:lfs.0 00000100:00100000:0.0:1788869566.739294:0:14177:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c82cdc5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:8eec8521-73a5-4f2d-941c-80b702633766+9:14335:x1875765413130112:12345-192.168.201.39@tcp:700:lfs.0 Request processed in 98us (486us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869566.739300:0:14177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 0 00000100:00100000:2.0:1788869566.741582:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1788869566.742107:0:14168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765413130368 00000100:00100000:1.0:1788869566.742132:0:14168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765413130368 00000100:00100000:1.0:1788869566.742190:0:14168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 19 00000100:00100000:1.0:1788869566.742199:0:14168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c82cdc4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8eec8521-73a5-4f2d-941c-80b702633766+9:14335:x1875765413130368:12345-192.168.201.39@tcp:36:lfs.0 00010000:00010000:1.0:1788869566.742280:0:14168:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788869566.742307:0:14168:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94c805038200/0x3d2d1916761d780f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.39@tcp remote: 0x375c010249035c6f expref: 9 pid: 14168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869566.742327:0:14168:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff94c802db2100) 00010000:00010000:1.0:1788869566.742332:0:14168:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788869566.742565:0:14168:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94c83fde7200/0x3d2d1916761d78e1 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869566.742579:0:14168:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff94c702257200/0x3d2d1916761d7847 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0x375c010249035cd1 expref: 5 pid: 14169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869566.742588:0:14168:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff94c83fde7200/0x3d2d1916761d78e1 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869566.742619:0:14168:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff94c702257200/0x3d2d1916761d7847 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.39@tcp remote: 0x375c010249035cd1 expref: 5 pid: 14169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869566.742633:0:14168:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff94c702257200/0x3d2d1916761d7847 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.39@tcp remote: 0x375c010249035cd1 expref: 5 pid: 14169 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788869566.742648:0:14168:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94c83faeb100 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14168:1875765421498496:192.168.201.39@tcp:104: 00000100:00100000:1.0:1788869566.742744:0:14168:0:(client.c:2702:ptlrpc_set_wait()) set ffff94c820d00240 going to sleep for 11 seconds 00000100:00100000:1.0:1788869566.745372:0:14168:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94c83faeb100 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14168:1875765421498496:192.168.201.39@tcp:104: 00000100:00100000:3.0:1788869566.745399:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00010000:00010000:1.0:1788869566.745406:0:14168:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff94c83fde7200/0x3d2d1916761d78e1 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14168 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788869566.745827:0:16188:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765413130496 00000100:00100000:2.0:1788869566.745835:0:16188:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765413130496 00010000:00010000:2.0:1788869566.745886:0:16188:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff94c702257200/0x3d2d1916761d7847 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.39@tcp remote: 0x375c010249035cd1 expref: 6 pid: 14169 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1788869566.745895:0:14164:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788869566.745920:0:16188:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 9 00000100:00100000:2.0:1788869566.745930:0:16188:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c835a17800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b859f31b-9885-425c-b9a4-5a4e02335486+6:2348:x1875765413130496:12345-192.168.201.39@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788869566.745946:0:16188:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788869566.745952:0:16188:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff94c702257200/0x3d2d1916761d7847 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.39@tcp remote: 0x375c010249035cd1 expref: 6 pid: 14169 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869566.745964:0:16188:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff94c702257200/0x3d2d1916761d7847 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.39@tcp remote: 0x375c010249035cd1 expref: 6 pid: 14169 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869566.745985:0:16188:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94c702257200/0x3d2d1916761d7847 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.39@tcp remote: 0x375c010249035cd1 expref: 6 pid: 14169 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869566.746000:0:16188:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff94c802db2100) 00010000:00010000:2.0:1788869566.746005:0:16188:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff94c83fde7200/0x3d2d1916761d78e1 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869566.746024:0:16188:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff94c83fde7200/0x3d2d1916761d78e1 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 14168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869566.746032:0:16188:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94c83fde7200/0x3d2d1916761d78e1 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 14168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869566.746055:0:16188:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788869566.746079:0:14168:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff94c83fde7200/0x3d2d1916761d78e1 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869566.746090:0:14168:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94c83fde7200/0x3d2d1916761d78e1 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869566.746114:0:14168:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94c83fde6600/0x3d2d1916761d78e8 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869566.746134:0:14168:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94c83fde6600/0x3d2d1916761d78e8 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14168 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788869566.746152:0:16188:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c835a17800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b859f31b-9885-425c-b9a4-5a4e02335486+5:2348:x1875765413130496:12345-192.168.201.39@tcp:103:ldlm_bl.0 Request processed in 212us (745us total) trans 0 rc 0/0 00010000:00010000:1.0:1788869566.746154:0:14168:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94c83fde6600/0x3d2d1916761d78e8 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14168 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788869566.746165:0:16188:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 9 00000004:00200000:1.0:1788869566.748297:0:14168:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00010000:00010000:1.0:1788869566.748311:0:14168:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94c83fde7200/0x3d2d1916761d78e1 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869566.748318:0:14168:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94c83fde7200/0x3d2d1916761d78e1 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869566.748324:0:14168:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94c83fde7200/0x3d2d1916761d78e1 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869566.748327:0:14168:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94c83fde7200 already unused, calling callback (ffffffffc21124f0) 00010000:00010000:1.0:1788869566.748330:0:14168:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94c83fde7200/0x3d2d1916761d78e1 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869566.748334:0:14168:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94c83fde7200/0x3d2d1916761d78e1 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869566.748353:0:14168:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff94c802db2100) 00010000:00010000:1.0:1788869566.748355:0:14168:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788869566.748358:0:14168:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94c83fde7200/0x3d2d1916761d78e1 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869566.748362:0:14168:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94c83fde7200/0x3d2d1916761d78e1 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14168 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788869566.748376:0:14168:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000096c20574 reply state 00000000701e583b transno 8589934594 ns: mdt-lustre-MDT0000_UUID lock: ffff94c83fde6600/0x3d2d1916761d78e8 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14168 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788869566.748382:0:14168:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788869566.748456:0:14168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c82cdc4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8eec8521-73a5-4f2d-941c-80b702633766+10:14335:x1875765413130368:12345-192.168.201.39@tcp:36:lfs.0 Request processed in 6256us (6879us total) trans 8589934594 rc 0/0 00000100:00100000:1.0:1788869566.748464:0:14168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 19 00010000:00010000:2.0:1788869566.751027:0:3269:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94c83fde6600/0x3d2d1916761d78e8 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869566.751044:0:3269:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94c83fde6600/0x3d2d1916761d78e8 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869566.751051:0:3269:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94c83fde6600/0x3d2d1916761d78e8 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869566.751058:0:3269:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94c83fde6600 already unused, calling callback (ffffffffc21124f0) 00010000:00010000:2.0:1788869566.751063:0:3269:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94c83fde6600/0x3d2d1916761d78e8 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869566.751071:0:3269:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94c83fde6600/0x3d2d1916761d78e8 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869566.751085:0:3269:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff94c81a585a00) 00010000:00010000:2.0:1788869566.751088:0:3269:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788869566.751092:0:3269:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94c83fde6600/0x3d2d1916761d78e8 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869566.751114:0:3269:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94c83fde6600/0x3d2d1916761d78e8 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14168 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788869566.806413:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1788869566.806524:0:14169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765413130624 00000100:00100000:0.0:1788869566.806538:0:14169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765413130624 00000100:00100000:0.0:1788869566.806610:0:14169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 20 00000100:00100000:0.0:1788869566.806621:0:14169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c835a17480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8eec8521-73a5-4f2d-941c-80b702633766+9:14342:x1875765413130624:12345-192.168.201.39@tcp:101:lctl.0 00010000:00010000:0.0:1788869566.806649:0:14169:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788869566.806674:0:14169:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94c818d1f000/0x3d2d1916761d78ef lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x375c010249035cfb expref: -99 pid: 14169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869566.806737:0:14169:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94c818d1ee00/0x3d2d1916761d78f6 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869566.806749:0:14169:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94c818d1ee00/0x3d2d1916761d78f6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869566.806761:0:14169:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94c818d1ee00/0x3d2d1916761d78f6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14169 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788869566.806817:0:14169:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:0.0:1788869566.806821:0:14169:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 4 stripe count 1 MDT count 1 00000004:00010000:0.0:1788869566.806854:0:14169:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff94c818d1ee00/0x3d2d1916761d78f6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869566.806895:0:14169:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94c818d1f000/0x3d2d1916761d78ef lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0x375c010249035cfb expref: 11 pid: 14169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869566.806934:0:14169:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94c818d1ee00/0x3d2d1916761d78f6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0x375c010249035cfb expref: 10 pid: 14169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869566.806942:0:14169:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff94c803990a00) 00010000:00010000:0.0:1788869566.806945:0:14169:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788869566.806949:0:14169:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94c818d1ee00, rc 0) 00000100:00100000:0.0:1788869566.807022:0:14169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c835a17480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8eec8521-73a5-4f2d-941c-80b702633766+10:14342:x1875765413130624:12345-192.168.201.39@tcp:101:lctl.0 Request processed in 403us (623us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869566.807029:0:14169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 20 00000100:00100000:3.0:1788869566.824061:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1788869566.824340:0:15030:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765413130752 00000100:00100000:0.0:1788869566.824353:0:15030:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765413130752 00000100:00100000:0.0:1788869566.824439:0:15030:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 21 00000100:00100000:0.0:1788869566.824451:0:15030:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c835a15500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b859f31b-9885-425c-b9a4-5a4e02335486+5:14344:x1875765413130752:12345-192.168.201.39@tcp:101:lfs.0 00010000:00010000:0.0:1788869566.824478:0:15030:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788869566.824504:0:15030:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94c818d1f000/0x3d2d1916761d78fd lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x375c010249035d02 expref: -99 pid: 15030 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869566.824597:0:15030:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94c818d1f600/0x3d2d1916761d7904 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 15030 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869566.824613:0:15030:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94c818d1f600/0x3d2d1916761d7904 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15030 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869566.824627:0:15030:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94c818d1f600/0x3d2d1916761d7904 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15030 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788869566.824716:0:15030:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:0.0:1788869566.824720:0:15030:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 4 stripe count 1 MDT count 1 00000004:00010000:0.0:1788869566.824748:0:15030:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff94c818d1f600/0x3d2d1916761d7904 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15030 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869566.824775:0:15030:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94c818d1f000/0x3d2d1916761d78fd lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0x375c010249035d02 expref: 7 pid: 15030 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869566.824799:0:15030:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94c818d1f600/0x3d2d1916761d7904 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0x375c010249035d02 expref: 6 pid: 15030 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869566.824810:0:15030:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff94c803990a00) 00010000:00010000:0.0:1788869566.824813:0:15030:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788869566.824817:0:15030:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94c818d1f600, rc 0) 00000100:00100000:0.0:1788869566.824898:0:15030:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c835a15500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b859f31b-9885-425c-b9a4-5a4e02335486+6:14344:x1875765413130752:12345-192.168.201.39@tcp:101:lfs.0 Request processed in 450us (854us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869566.824906:0:15030:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 21 00000100:00100000:2.0:1788869566.828079:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1788869566.828295:0:14170:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765413130880 00000100:00100000:3.0:1788869566.828312:0:14170:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765413130880 00000100:00100000:3.0:1788869566.828388:0:14170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 22 00000100:00100000:3.0:1788869566.828400:0:14170:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c82cdc7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b859f31b-9885-425c-b9a4-5a4e02335486+6:14344:x1875765413130880:12345-192.168.201.39@tcp:101:lfs.0 00010000:00010000:3.0:1788869566.828431:0:14170:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788869566.828461:0:14170:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94c702256800/0x3d2d1916761d790b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x375c010249035d09 expref: -99 pid: 14170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869566.828552:0:14170:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff94c702257a00/0x3d2d1916761d7912 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869566.828567:0:14170:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94c702257a00/0x3d2d1916761d7912 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869566.828577:0:14170:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94c702257a00/0x3d2d1916761d7912 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869566.828588:0:14170:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94c702257e00/0x3d2d1916761d7919 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869566.828592:0:14170:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94c702257e00/0x3d2d1916761d7919 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869566.828613:0:14170:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94c702257e00/0x3d2d1916761d7919 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869566.828720:0:14170:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94c702256c00/0x3d2d1916761d7920 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869566.828724:0:14170:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94c702256c00/0x3d2d1916761d7920 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869566.828729:0:14170:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94c702256c00/0x3d2d1916761d7920 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14170 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788869566.828765:0:14170:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00000004:00200000:3.0:1788869566.828768:0:14170:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1788869566.828789:0:14170:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff94c702256c00/0x3d2d1916761d7920 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869566.828800:0:14170:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff94c702257a00/0x3d2d1916761d7912 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869566.828804:0:14170:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94c702257a00/0x3d2d1916761d7912 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869566.828809:0:14170:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94c702257a00/0x3d2d1916761d7912 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869566.828813:0:14170:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94c702257a00 already unused, calling callback (ffffffffc21124f0) 00010000:00010000:3.0:1788869566.828817:0:14170:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94c702257a00/0x3d2d1916761d7912 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869566.828822:0:14170:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94c702257a00/0x3d2d1916761d7912 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869566.828839:0:14170:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff94c803990a00) 00010000:00010000:3.0:1788869566.828841:0:14170:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788869566.828845:0:14170:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94c702257a00/0x3d2d1916761d7912 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869566.828850:0:14170:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94c702257a00/0x3d2d1916761d7912 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869566.828861:0:14170:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94c702257e00/0x3d2d1916761d7919 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869566.828864:0:14170:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94c702257e00/0x3d2d1916761d7919 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869566.828868:0:14170:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94c702257e00/0x3d2d1916761d7919 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869566.828872:0:14170:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94c702257e00 already unused, calling callback (ffffffffc21124f0) 00010000:00010000:3.0:1788869566.828874:0:14170:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94c702257e00/0x3d2d1916761d7919 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869566.828877:0:14170:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94c702257e00/0x3d2d1916761d7919 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869566.828880:0:14170:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff94c810a48400) 00010000:00010000:3.0:1788869566.828882:0:14170:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788869566.828883:0:14170:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94c702257e00/0x3d2d1916761d7919 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869566.829225:0:14170:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94c702257e00/0x3d2d1916761d7919 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869566.829307:0:14170:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94c702256800/0x3d2d1916761d790b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0x375c010249035d09 expref: 8 pid: 14170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869566.829321:0:14170:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94c702256c00/0x3d2d1916761d7920 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0x375c010249035d09 expref: 7 pid: 14170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869566.829326:0:14170:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff94c810a48b00) 00010000:00010000:3.0:1788869566.829328:0:14170:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788869566.829329:0:14170:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94c702256c00, rc 0) 00000100:00100000:3.0:1788869566.829414:0:14170:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c82cdc7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b859f31b-9885-425c-b9a4-5a4e02335486+7:14344:x1875765413130880:12345-192.168.201.39@tcp:101:lfs.0 Request processed in 1016us (1343us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869566.829422:0:14170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 22 00000100:00100000:3.0:1788869566.832807:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1788869566.832917:0:15030:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765413131136 00000100:00100000:0.0:1788869566.832929:0:15030:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765413131136 00000100:00100000:0.0:1788869566.833132:0:15030:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 23 00000100:00100000:0.0:1788869566.833179:0:15030:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c83513df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b859f31b-9885-425c-b9a4-5a4e02335486+7:14344:x1875765413131136:12345-192.168.201.39@tcp:101:lfs.0 00010000:00010000:0.0:1788869566.833207:0:15030:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788869566.833235:0:15030:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94c818d1fa00/0x3d2d1916761d7927 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x375c010249035d10 expref: -99 pid: 15030 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788869566.833424:0:15030:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00010000:00010000:0.0:1788869566.833581:0:15030:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94c818d1fa00/0x3d2d1916761d7927 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0x375c010249035d10 expref: 9 pid: 15030 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869566.833613:0:15030:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff94c803990a00) 00010000:00010000:0.0:1788869566.833616:0:15030:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788869566.833620:0:15030:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94c818d1fa00/0x3d2d1916761d7927 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.39@tcp remote: 0x375c010249035d10 expref: 9 pid: 15030 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869566.833639:0:15030:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94c818d1fa00, rc 0) 00000100:00100000:0.0:1788869566.833702:0:15030:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c83513df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b859f31b-9885-425c-b9a4-5a4e02335486+8:14344:x1875765413131136:12345-192.168.201.39@tcp:101:lfs.0 Request processed in 563us (908us total) trans 8589934595 rc 301/301 00000100:00100000:0.0:1788869566.833708:0:15030:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 23 00000100:00100000:3.0:1788869566.836288:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1788869566.836944:0:14168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765413131392 00000100:00100000:1.0:1788869566.836959:0:14168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765413131392 00000100:00100000:1.0:1788869566.837076:0:14168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 24 00000100:00100000:1.0:1788869566.837088:0:14168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c83513f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b859f31b-9885-425c-b9a4-5a4e02335486+8:14344:x1875765413131392:12345-192.168.201.39@tcp:36:lfs.0 00010000:00010000:1.0:1788869566.837186:0:14168:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788869566.837228:0:14168:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94c702256c00/0x3d2d1916761d7920 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.39@tcp remote: 0x375c010249035d09 expref: 8 pid: 14170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869566.837273:0:14168:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff94c810a48b00) 00010000:00010000:1.0:1788869566.837290:0:14168:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788869566.837324:0:14168:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94c83fde7200/0x3d2d1916761d7935 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869566.837363:0:14168:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94c83fde7200/0x3d2d1916761d7935 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869566.837374:0:14168:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94c83fde7200/0x3d2d1916761d7935 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14168 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788869566.837690:0:14168:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000009cee448a reply state 00000000aea53d93 transno 8589934596 ns: mdt-lustre-MDT0000_UUID lock: ffff94c83fde7200/0x3d2d1916761d7935 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14168 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788869566.837699:0:14168:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:1.0:1788869566.837711:0:14168:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00000100:00100000:1.0:1788869566.837802:0:14168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c83513f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b859f31b-9885-425c-b9a4-5a4e02335486+9:14344:x1875765413131392:12345-192.168.201.39@tcp:36:lfs.0 Request processed in 716us (1526us total) trans 8589934596 rc 0/0 00000100:00100000:1.0:1788869566.837808:0:14168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 24 00010000:00010000:2.0:1788869566.840568:0:3270:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94c83fde7200/0x3d2d1916761d7935 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869566.840593:0:3270:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94c83fde7200/0x3d2d1916761d7935 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869566.840600:0:3270:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94c83fde7200/0x3d2d1916761d7935 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869566.840604:0:3270:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94c83fde7200 already unused, calling callback (ffffffffc21124f0) 00010000:00010000:2.0:1788869566.840608:0:3270:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94c83fde7200/0x3d2d1916761d7935 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869566.840616:0:3270:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94c83fde7200/0x3d2d1916761d7935 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869566.840638:0:3270:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff94c81a585200) 00010000:00010000:2.0:1788869566.840642:0:3270:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00010000:00010000:2.0:1788869566.840649:0:3270:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94c83fde7200/0x3d2d1916761d7935 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869566.840656:0:3270:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94c83fde7200/0x3d2d1916761d7935 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14168 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788869566.840866:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1788869566.841152:0:14172:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765413131648 00000100:00100000:1.0:1788869566.841168:0:14172:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765413131648 00000100:00100000:1.0:1788869566.841237:0:14172:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 2 00000100:00100000:1.0:1788869566.841276:0:14172:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c83513f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b859f31b-9885-425c-b9a4-5a4e02335486+8:14344:x1875765413131648:12345-192.168.201.39@tcp:35:lfs.0 00000100:00100000:1.0:1788869566.841898:0:14172:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c83513f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b859f31b-9885-425c-b9a4-5a4e02335486+9:14344:x1875765413131648:12345-192.168.201.39@tcp:35:lfs.0 Request processed in 647us (1032us total) trans 8589934597 rc 0/0 00000100:00100000:1.0:1788869566.841908:0:14172:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 2 00000100:00100000:3.0:1788869566.844712:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1788869566.844908:0:14170:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765413131904 00000100:00100000:2.0:1788869566.844925:0:14170:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765413131904 00000100:00100000:2.0:1788869566.845150:0:14170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 25 00000100:00100000:2.0:1788869566.845188:0:14170:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c83513ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b859f31b-9885-425c-b9a4-5a4e02335486+9:14344:x1875765413131904:12345-192.168.201.39@tcp:101:lfs.0 00010000:00010000:2.0:1788869566.845227:0:14170:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788869566.845290:0:14170:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94c805038800/0x3d2d1916761d793c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x375c010249035d17 expref: -99 pid: 14170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869566.845411:0:14170:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff94c805039400/0x3d2d1916761d7943 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869566.845429:0:14170:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94c805039400/0x3d2d1916761d7943 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869566.845444:0:14170:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94c805039400/0x3d2d1916761d7943 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869566.845462:0:14170:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94c805038a00/0x3d2d1916761d794a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869566.845469:0:14170:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94c805038a00/0x3d2d1916761d794a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869566.845475:0:14170:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94c805038a00/0x3d2d1916761d794a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14170 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788869566.845772:0:14170:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00010000:00010000:2.0:1788869566.846090:0:14170:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff94c805039400/0x3d2d1916761d7943 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869566.846100:0:14170:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94c805039400/0x3d2d1916761d7943 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869566.846109:0:14170:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94c805039400/0x3d2d1916761d7943 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869566.846132:0:14170:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94c805039400 already unused, calling callback (ffffffffc21124f0) 00010000:00010000:2.0:1788869566.846138:0:14170:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94c805039400/0x3d2d1916761d7943 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869566.846155:0:14170:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94c805039400/0x3d2d1916761d7943 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869566.846175:0:14170:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff94c803990a00) 00010000:00010000:2.0:1788869566.846179:0:14170:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788869566.846186:0:14170:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94c805039400/0x3d2d1916761d7943 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869566.846194:0:14170:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94c805039400/0x3d2d1916761d7943 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869566.846213:0:14170:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94c805038a00/0x3d2d1916761d794a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869566.846219:0:14170:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94c805038a00/0x3d2d1916761d794a lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869566.846225:0:14170:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94c805038a00/0x3d2d1916761d794a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869566.846230:0:14170:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94c805038a00 already unused, calling callback (ffffffffc21124f0) 00010000:00010000:2.0:1788869566.846232:0:14170:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94c805038a00/0x3d2d1916761d794a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869566.846239:0:14170:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94c805038a00/0x3d2d1916761d794a lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869566.846349:0:14170:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff94c802db2500) 00010000:00010000:2.0:1788869566.846352:0:14170:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788869566.846355:0:14170:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94c805038a00/0x3d2d1916761d794a lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869566.846362:0:14170:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94c805038a00/0x3d2d1916761d794a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869566.846433:0:14170:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94c805038800/0x3d2d1916761d793c lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0x375c010249035d17 expref: 11 pid: 14170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869566.846448:0:14170:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff94c803990a00) 00010000:00010000:2.0:1788869566.846450:0:14170:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788869566.846454:0:14170:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94c805038800/0x3d2d1916761d793c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.39@tcp remote: 0x375c010249035d17 expref: 11 pid: 14170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869566.846464:0:14170:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94c805038800, rc 0) 00000100:00100000:2.0:1788869566.846751:0:14170:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c83513ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b859f31b-9885-425c-b9a4-5a4e02335486+10:14344:x1875765413131904:12345-192.168.201.39@tcp:101:lfs.0 Request processed in 1566us (2057us total) trans 8589934598 rc 301/301 00000100:00100000:2.0:1788869566.846761:0:14170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 25 00000100:00100000:0.0:1788869566.850443:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1788869566.850529:0:14169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765413132032 00000100:00100000:2.0:1788869566.850542:0:14169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765413132032 00000100:00100000:2.0:1788869566.850642:0:14169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 26 00000100:00100000:2.0:1788869566.850654:0:14169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c83fbb3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b859f31b-9885-425c-b9a4-5a4e02335486+10:14344:x1875765413132032:12345-192.168.201.39@tcp:101:lfs.0 00010000:00010000:2.0:1788869566.850692:0:14169:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788869566.850724:0:14169:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94c805038e00/0x3d2d1916761d7958 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x375c010249035d1e expref: -99 pid: 14169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869566.850883:0:14169:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94c805038200/0x3d2d1916761d795f lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869566.850917:0:14169:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94c805038200/0x3d2d1916761d795f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869566.850932:0:14169:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94c805038200/0x3d2d1916761d795f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14169 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788869566.851009:0:14169:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00000004:00200000:2.0:1788869566.851014:0:14169:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1788869566.851043:0:14169:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff94c805038200/0x3d2d1916761d795f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869566.851079:0:14169:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94c805038e00/0x3d2d1916761d7958 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0x375c010249035d1e expref: 12 pid: 14169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869566.851104:0:14169:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94c805038200/0x3d2d1916761d795f lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0x375c010249035d1e expref: 11 pid: 14169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869566.851115:0:14169:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff94c802db2800) 00010000:00010000:2.0:1788869566.851118:0:14169:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788869566.851123:0:14169:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94c805038200, rc 0) 00000100:00100000:2.0:1788869566.851209:0:14169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c83fbb3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b859f31b-9885-425c-b9a4-5a4e02335486+11:14344:x1875765413132032:12345-192.168.201.39@tcp:101:lfs.0 Request processed in 557us (782us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869566.851217:0:14169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 26 00000100:00100000:3.0:1788869566.854784:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1788869566.854913:0:14172:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765413132160 00000100:00100000:0.0:1788869566.854927:0:14172:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765413132160 00000100:00100000:0.0:1788869566.855020:0:14172:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 3 00000100:00100000:0.0:1788869566.855032:0:14172:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c83513fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b859f31b-9885-425c-b9a4-5a4e02335486+11:14344:x1875765413132160:12345-192.168.201.39@tcp:37:lfs.0 00000100:00100000:0.0:1788869566.860737:0:14172:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c83513fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b859f31b-9885-425c-b9a4-5a4e02335486+11:14344:x1875765413132160:12345-192.168.201.39@tcp:37:lfs.0 Request processed in 5689us (5951us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869566.860758:0:14172:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 3 00000100:00100000:0.0:1788869566.865154:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1788869566.865299:0:14171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765413132416 00000100:00100000:2.0:1788869566.865312:0:14171:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765413132416 00000100:00100000:2.0:1788869566.865397:0:14171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 4 00000100:00100000:2.0:1788869566.865408:0:14171:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c83c6aec50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b859f31b-9885-425c-b9a4-5a4e02335486+11:14344:x1875765413132416:12345-192.168.201.39@tcp:35:lfs.0 00000100:00100000:2.0:1788869566.865783:0:14171:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c83c6aec50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b859f31b-9885-425c-b9a4-5a4e02335486+12:14344:x1875765413132416:12345-192.168.201.39@tcp:35:lfs.0 Request processed in 375us (654us total) trans 8589934599 rc 0/0 00000100:00100000:2.0:1788869566.865790:0:14171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 4 00000100:00100000:3.0:1788869566.903459:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1788869566.903670:0:15030:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765413132544 00000100:00100000:0.0:1788869566.903684:0:15030:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765413132544 00000100:00100000:0.0:1788869566.903767:0:15030:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 27 00000100:00100000:0.0:1788869566.903778:0:15030:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c83513c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8eec8521-73a5-4f2d-941c-80b702633766+10:14350:x1875765413132544:12345-192.168.201.39@tcp:101:bash.0 00010000:00010000:0.0:1788869566.903808:0:15030:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788869566.903835:0:15030:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94c818d1f000/0x3d2d1916761d7966 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x375c010249035d25 expref: -99 pid: 15030 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869566.903971:0:15030:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff94c818d1e800/0x3d2d1916761d796d lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 15030 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869566.904000:0:15030:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94c818d1e800/0x3d2d1916761d796d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 15030 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869566.904016:0:15030:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94c818d1e800/0x3d2d1916761d796d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 15030 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869566.904034:0:15030:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94c818d1fa00/0x3d2d1916761d7974 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15030 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869566.904042:0:15030:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94c818d1fa00/0x3d2d1916761d7974 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15030 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869566.904048:0:15030:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94c818d1fa00/0x3d2d1916761d7974 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15030 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869566.904203:0:15030:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94c818d1e000/0x3d2d1916761d797b lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15030 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869566.904212:0:15030:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94c818d1e000/0x3d2d1916761d797b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15030 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869566.904219:0:15030:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94c818d1e000/0x3d2d1916761d797b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15030 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788869566.904317:0:15030:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00000004:00200000:0.0:1788869566.904322:0:15030:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1788869566.904372:0:15030:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff94c818d1e000/0x3d2d1916761d797b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15030 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869566.904399:0:15030:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff94c818d1e800/0x3d2d1916761d796d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 15030 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869566.904406:0:15030:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94c818d1e800/0x3d2d1916761d796d lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 15030 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869566.904412:0:15030:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94c818d1e800/0x3d2d1916761d796d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 15030 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869566.904419:0:15030:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94c818d1e800 already unused, calling callback (ffffffffc21124f0) 00010000:00010000:0.0:1788869566.904423:0:15030:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94c818d1e800/0x3d2d1916761d796d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 15030 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869566.904432:0:15030:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94c818d1e800/0x3d2d1916761d796d lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 15030 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869566.904447:0:15030:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff94c803990a00) 00010000:00010000:0.0:1788869566.904450:0:15030:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788869566.904455:0:15030:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94c818d1e800/0x3d2d1916761d796d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 15030 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869566.904462:0:15030:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94c818d1e800/0x3d2d1916761d796d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 15030 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869566.904481:0:15030:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94c818d1fa00/0x3d2d1916761d7974 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15030 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869566.904488:0:15030:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94c818d1fa00/0x3d2d1916761d7974 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15030 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869566.904494:0:15030:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94c818d1fa00/0x3d2d1916761d7974 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15030 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869566.904504:0:15030:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94c818d1fa00 already unused, calling callback (ffffffffc21124f0) 00010000:00010000:0.0:1788869566.904508:0:15030:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94c818d1fa00/0x3d2d1916761d7974 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15030 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869566.904514:0:15030:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94c818d1fa00/0x3d2d1916761d7974 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15030 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869566.904523:0:15030:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff94c803990800) 00010000:00010000:0.0:1788869566.904525:0:15030:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788869566.904528:0:15030:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94c818d1fa00/0x3d2d1916761d7974 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15030 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869566.904534:0:15030:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94c818d1fa00/0x3d2d1916761d7974 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15030 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869566.904573:0:15030:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94c818d1f000/0x3d2d1916761d7966 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0x375c010249035d25 expref: 12 pid: 15030 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869566.904594:0:15030:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94c818d1e000/0x3d2d1916761d797b lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0x375c010249035d25 expref: 11 pid: 15030 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869566.904601:0:15030:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff94c802db2800) 00010000:00010000:0.0:1788869566.904603:0:15030:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1788869566.904605:0:15030:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94c818d1e000, rc 0) 00000100:00100000:0.0:1788869566.904747:0:15030:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c83513c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8eec8521-73a5-4f2d-941c-80b702633766+11:14350:x1875765413132544:12345-192.168.201.39@tcp:101:bash.0 Request processed in 967us (1301us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869566.904756:0:15030:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 27 00000100:00100000:1.0:1788869566.908080:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1788869566.908305:0:14168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765413132800 00000100:00100000:0.0:1788869566.908335:0:14168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765413132800 00000100:00100000:0.0:1788869566.908402:0:14168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 28 00000100:00100000:0.0:1788869566.908413:0:14168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c83faeb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8eec8521-73a5-4f2d-941c-80b702633766+11:14350:x1875765413132800:12345-192.168.201.39@tcp:101:bash.0 00010000:00010000:0.0:1788869566.908440:0:14168:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788869566.908470:0:14168:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94c818d1e400/0x3d2d1916761d7982 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x375c010249035d2c expref: -99 pid: 14168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869566.908657:0:14168:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94c818d1fc00/0x3d2d1916761d7989 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869566.908674:0:14168:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff94c805038200/0x3d2d1916761d795f lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0x375c010249035d1e expref: 11 pid: 14169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869566.908683:0:14168:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff94c818d1fc00/0x3d2d1916761d7989 lrc: 4/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869566.908732:0:14168:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff94c805038200/0x3d2d1916761d795f lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.39@tcp remote: 0x375c010249035d1e expref: 11 pid: 14169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869566.908747:0:14168:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff94c805038200/0x3d2d1916761d795f lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.39@tcp remote: 0x375c010249035d1e expref: 11 pid: 14169 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788869566.908763:0:14168:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94c83fbb0a80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14168:1875765421498624:192.168.201.39@tcp:104: 00000100:00100000:0.0:1788869566.908906:0:14168:0:(client.c:2702:ptlrpc_set_wait()) set ffff94c8033c4480 going to sleep for 11 seconds 00000100:00100000:3.0:1788869566.912423:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1788869566.912593:0:14168:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94c83fbb0a80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14168:1875765421498624:192.168.201.39@tcp:104: 00010000:00010000:0.0:1788869566.912644:0:14168:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff94c818d1fc00/0x3d2d1916761d7989 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14168 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788869566.912808:0:14155:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765413132928 00000100:00100000:1.0:1788869566.912817:0:14155:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765413132928 00010000:00010000:1.0:1788869566.912864:0:14155:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff94c805038200/0x3d2d1916761d795f lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.39@tcp remote: 0x375c010249035d1e expref: 12 pid: 14169 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788869566.912918:0:14155:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 10 00000100:00100000:1.0:1788869566.912937:0:14155:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c83513ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b859f31b-9885-425c-b9a4-5a4e02335486+12:2347:x1875765413132928:12345-192.168.201.39@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788869566.912956:0:14155:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788869566.912963:0:14155:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff94c805038200/0x3d2d1916761d795f lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.39@tcp remote: 0x375c010249035d1e expref: 12 pid: 14169 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869566.912977:0:14155:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff94c805038200/0x3d2d1916761d795f lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.39@tcp remote: 0x375c010249035d1e expref: 12 pid: 14169 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869566.913014:0:14155:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94c805038200/0x3d2d1916761d795f lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.39@tcp remote: 0x375c010249035d1e expref: 12 pid: 14169 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869566.913034:0:14155:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff94c802db2800) 00010000:00010000:1.0:1788869566.913039:0:14155:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff94c818d1fc00/0x3d2d1916761d7989 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869566.913051:0:14155:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff94c818d1fc00/0x3d2d1916761d7989 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 14168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869566.913059:0:14155:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94c818d1fc00/0x3d2d1916761d7989 lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 14168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869566.913084:0:14155:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788869566.913155:0:14155:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c83513ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b859f31b-9885-425c-b9a4-5a4e02335486+11:2347:x1875765413132928:12345-192.168.201.39@tcp:103:ldlm_bl.0 Request processed in 220us (748us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869566.913164:0:14155:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 10 00010000:00010000:2.0:1788869566.913927:0:14168:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff94c818d1fc00/0x3d2d1916761d7989 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869566.913938:0:14168:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94c818d1fc00/0x3d2d1916761d7989 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869566.913970:0:14168:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94c805038e00/0x3d2d1916761d7990 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869566.913992:0:14168:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94c805038e00/0x3d2d1916761d7990 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869566.914002:0:14168:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94c805038e00/0x3d2d1916761d7990 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869566.914956:0:14168:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94c805038800/0x3d2d1916761d7997 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869566.914971:0:14168:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94c805038800/0x3d2d1916761d7997 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869566.914982:0:14168:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94c805038800/0x3d2d1916761d7997 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14168 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788869566.914997:0:14168:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1788869566.915032:0:14168:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94c818d1fc00/0x3d2d1916761d7989 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869566.915047:0:14168:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94c818d1fc00/0x3d2d1916761d7989 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869566.915056:0:14168:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94c818d1fc00/0x3d2d1916761d7989 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869566.915063:0:14168:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94c818d1fc00 already unused, calling callback (ffffffffc21124f0) 00010000:00010000:2.0:1788869566.915068:0:14168:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94c818d1fc00/0x3d2d1916761d7989 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869566.915076:0:14168:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94c818d1fc00/0x3d2d1916761d7989 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869566.915091:0:14168:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff94c802db2800) 00010000:00010000:2.0:1788869566.915095:0:14168:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788869566.915101:0:14168:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94c818d1fc00/0x3d2d1916761d7989 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869566.915109:0:14168:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94c818d1fc00/0x3d2d1916761d7989 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14168 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788869566.915129:0:14168:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000045e1c665 reply state 00000000254c299c transno 8589934600 ns: mdt-lustre-MDT0000_UUID lock: ffff94c805038e00/0x3d2d1916761d7990 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14168 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788869566.915151:0:14168:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1788869566.915200:0:14168:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94c818d1e400/0x3d2d1916761d7982 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0x375c010249035d2c expref: 14 pid: 14168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869566.915218:0:14168:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94c805038800/0x3d2d1916761d7997 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0x375c010249035d2c expref: 13 pid: 14168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869566.915239:0:14168:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff94c802db2600) 00010000:00010000:2.0:1788869566.915241:0:14168:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 9 00010000:00010000:2.0:1788869566.915244:0:14168:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94c805038800, rc 0) 00000100:00100000:2.0:1788869566.915368:0:14168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c83faeb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8eec8521-73a5-4f2d-941c-80b702633766+14:14350:x1875765413132800:12345-192.168.201.39@tcp:101:bash.0 Request processed in 6955us (7300us total) trans 8589934600 rc 0/0 00000100:00100000:2.0:1788869566.915377:0:14168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 28 00010000:00010000:2.0:1788869566.918885:0:3269:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94c805038e00/0x3d2d1916761d7990 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869566.918908:0:3269:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94c805038e00/0x3d2d1916761d7990 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869566.918917:0:3269:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94c805038e00/0x3d2d1916761d7990 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869566.918924:0:3269:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94c805038e00 already unused, calling callback (ffffffffc21124f0) 00010000:00010000:2.0:1788869566.918929:0:3269:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94c805038e00/0x3d2d1916761d7990 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869566.918938:0:3269:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94c805038e00/0x3d2d1916761d7990 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869566.918960:0:3269:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff94c802db2500) 00010000:00010000:2.0:1788869566.918963:0:3269:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788869566.918969:0:3269:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94c805038e00/0x3d2d1916761d7990 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869566.918976:0:3269:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94c805038e00/0x3d2d1916761d7990 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14168 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788869566.927865:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1788869566.928173:0:14170:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765413133056 00000100:00100000:2.0:1788869566.928187:0:14170:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765413133056 00000100:00100000:2.0:1788869566.928312:0:14170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 29 00000100:00100000:2.0:1788869566.928326:0:14170:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c83513d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8eec8521-73a5-4f2d-941c-80b702633766+13:14350:x1875765413133056:12345-192.168.201.39@tcp:101:bash.0 00010000:00010000:2.0:1788869566.928362:0:14170:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788869566.928392:0:14170:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94c805038a00/0x3d2d1916761d79a5 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x375c010249035d33 expref: -99 pid: 14170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869566.928480:0:14170:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94c805039400/0x3d2d1916761d79ac lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869566.928498:0:14170:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94c805039400/0x3d2d1916761d79ac lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869566.928510:0:14170:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94c805039400/0x3d2d1916761d79ac lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14170 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788869566.928562:0:14170:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:2.0:1788869566.928568:0:14170:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1788869566.928592:0:14170:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff94c805039400/0x3d2d1916761d79ac lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869566.928605:0:14170:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94c805039400/0x3d2d1916761d79ac lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869566.928635:0:14170:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94c805038a00/0x3d2d1916761d79a5 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0x375c010249035d33 expref: 15 pid: 14170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869566.928658:0:14170:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94c805039400/0x3d2d1916761d79ac lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0x375c010249035d33 expref: 14 pid: 14170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869566.928684:0:14170:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff94c802db2600) 00010000:00010000:2.0:1788869566.928687:0:14170:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788869566.928691:0:14170:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94c805039400, rc 0) 00000100:00100000:2.0:1788869566.929005:0:14170:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c83513d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8eec8521-73a5-4f2d-941c-80b702633766+14:14350:x1875765413133056:12345-192.168.201.39@tcp:101:bash.0 Request processed in 681us (1151us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869566.929013:0:14170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 29 00000100:00100000:3.0:1788869566.932861:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1788869566.932955:0:14171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765413133312 00000100:00100000:2.0:1788869566.932969:0:14171:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765413133312 00000100:00100000:2.0:1788869566.933053:0:14171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 5 00000100:00100000:2.0:1788869566.933065:0:14171:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c83513c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8eec8521-73a5-4f2d-941c-80b702633766+14:14350:x1875765413133312:12345-192.168.201.39@tcp:35:bash.0 00000100:00100000:2.0:1788869566.933585:0:14171:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c83513c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8eec8521-73a5-4f2d-941c-80b702633766+15:14350:x1875765413133312:12345-192.168.201.39@tcp:35:bash.0 Request processed in 520us (735us total) trans 8589934601 rc 0/0 00000100:00100000:2.0:1788869566.933595:0:14171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 5 00000100:00100000:3.0:1788869567.022493:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1788869567.022631:0:14169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765413133568 00000100:00100000:2.0:1788869567.022645:0:14169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765413133568 00000100:00100000:2.0:1788869567.022728:0:14169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 30 00000100:00100000:2.0:1788869567.022740:0:14169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c83513d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8eec8521-73a5-4f2d-941c-80b702633766+15:14360:x1875765413133568:12345-192.168.201.39@tcp:101:lfs.0 00010000:00010000:2.0:1788869567.022776:0:14169:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788869567.022803:0:14169:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94c805038a00/0x3d2d1916761d79b3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x375c010249035d3a expref: -99 pid: 14169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788869567.023123:0:14169:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00010000:00010000:2.0:1788869567.023356:0:14169:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94c805038a00/0x3d2d1916761d79b3 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0x375c010249035d3a expref: 17 pid: 14169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869567.023400:0:14169:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff94c803990a00) 00010000:00010000:2.0:1788869567.023404:0:14169:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788869567.023411:0:14169:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94c805038a00/0x3d2d1916761d79b3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.39@tcp remote: 0x375c010249035d3a expref: 17 pid: 14169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869567.023431:0:14169:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94c805038a00, rc 0) 00000100:00100000:2.0:1788869567.023523:0:14169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c83513d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8eec8521-73a5-4f2d-941c-80b702633766+16:14360:x1875765413133568:12345-192.168.201.39@tcp:101:lfs.0 Request processed in 784us (1045us total) trans 8589934602 rc 301/301 00000100:00100000:2.0:1788869567.023531:0:14169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 30 00000100:00100000:3.0:1788869567.026833:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1788869567.026925:0:14171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765413133824 00000100:00100000:2.0:1788869567.026936:0:14171:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765413133824 00000100:00100000:2.0:1788869567.027004:0:14171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 6 00000100:00100000:2.0:1788869567.027013:0:14171:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c83513e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8eec8521-73a5-4f2d-941c-80b702633766+16:14360:x1875765413133824:12345-192.168.201.39@tcp:35:lfs.0 00000100:00100000:2.0:1788869567.027392:0:14171:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c83513e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8eec8521-73a5-4f2d-941c-80b702633766+17:14360:x1875765413133824:12345-192.168.201.39@tcp:35:lfs.0 Request processed in 378us (574us total) trans 8589934603 rc 0/0 00000100:00100000:2.0:1788869567.027401:0:14171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 6 00000100:00100000:3.0:1788869567.059725:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1788869567.059897:0:15030:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765413134080 00000100:00100000:0.0:1788869567.059912:0:15030:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765413134080 00000100:00100000:0.0:1788869567.060001:0:15030:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 31 00000100:00100000:0.0:1788869567.060013:0:15030:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c83513ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8eec8521-73a5-4f2d-941c-80b702633766+17:14363:x1875765413134080:12345-192.168.201.39@tcp:101:lfs.0 00010000:00010000:0.0:1788869567.060053:0:15030:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788869567.060085:0:15030:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94c818d1f000/0x3d2d1916761d79c1 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x375c010249035d41 expref: -99 pid: 15030 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869567.060243:0:15030:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94c818d1fa00/0x3d2d1916761d79c8 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 15030 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869567.060289:0:15030:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94c818d1fa00/0x3d2d1916761d79c8 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15030 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869567.060304:0:15030:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94c818d1fa00/0x3d2d1916761d79c8 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15030 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788869567.060317:0:15030:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:0.0:1788869567.060498:0:15030:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94c818d1f000/0x3d2d1916761d79c1 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0x375c010249035d41 expref: 20 pid: 15030 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869567.060528:0:15030:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94c818d1fa00/0x3d2d1916761d79c8 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0x375c010249035d41 expref: 19 pid: 15030 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869567.060537:0:15030:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff94c802db2600) 00010000:00010000:0.0:1788869567.060541:0:15030:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788869567.060545:0:15030:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94c818d1fa00, rc 0) 00000100:00100000:0.0:1788869567.060627:0:15030:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c83513ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8eec8521-73a5-4f2d-941c-80b702633766+19:14363:x1875765413134080:12345-192.168.201.39@tcp:101:lfs.0 Request processed in 616us (917us total) trans 8589934604 rc 0/0 00000100:00100000:0.0:1788869567.060656:0:15030:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 31 00000100:00100000:3.0:1788869567.065071:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1788869567.065129:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1788869567.065305:0:14168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765413134208 00000100:00100000:0.0:1788869567.065318:0:14168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765413134208 00000100:00100000:0.0:1788869567.065394:0:14168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 32 00000100:00100000:0.0:1788869567.065406:0:14168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c83513f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8eec8521-73a5-4f2d-941c-80b702633766+19:14363:x1875765413134208:12345-192.168.201.39@tcp:54:lfs.0 00010000:00010000:0.0:1788869567.065505:0:14168:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94c818d1e800/0x3d2d1916761d79d6 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869567.065536:0:14168:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94c818d1e800/0x3d2d1916761d79d6 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869567.065550:0:14168:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94c818d1e800/0x3d2d1916761d79d6 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869567.065586:0:14168:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94c818d1e800/0x3d2d1916761d79d6 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869567.065593:0:14168:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94c818d1e800/0x3d2d1916761d79d6 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869567.065601:0:14168:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94c818d1e800/0x3d2d1916761d79d6 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869567.065608:0:14168:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94c818d1e800 already unused, calling callback (ffffffffc21124f0) 00010000:00010000:0.0:1788869567.065614:0:14168:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94c818d1e800/0x3d2d1916761d79d6 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869567.065622:0:14168:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94c818d1e800/0x3d2d1916761d79d6 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869567.065636:0:14168:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff94c802db2600) 00010000:00010000:0.0:1788869567.065647:0:14168:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788869567.065653:0:14168:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94c818d1e800/0x3d2d1916761d79d6 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869567.065661:0:14168:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94c818d1e800/0x3d2d1916761d79d6 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14168 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788869567.065760:0:14168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c83513f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8eec8521-73a5-4f2d-941c-80b702633766+19:14363:x1875765413134208:12345-192.168.201.39@tcp:54:lfs.0 Request processed in 356us (705us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869567.065769:0:14168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 32 00000100:00100000:1.0:1788869567.066535:0:14153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765413134336 00000100:00100000:1.0:1788869567.066544:0:14153:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765413134336 00000100:00100000:1.0:1788869567.066598:0:14153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 0 00000100:00100000:1.0:1788869567.066606:0:14153:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c83513e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8eec8521-73a5-4f2d-941c-80b702633766+19:2347:x1875765413134336:12345-192.168.201.39@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788869567.066639:0:14153:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788869567.066663:0:14153:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94c818d1fa00/0x3d2d1916761d79c8 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.39@tcp remote: 0x375c010249035d41 expref: 19 pid: 15030 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869567.066680:0:14153:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff94c802db2600) 00010000:00010000:1.0:1788869567.066683:0:14153:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788869567.066730:0:14153:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c83513e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8eec8521-73a5-4f2d-941c-80b702633766+18:2347:x1875765413134336:12345-192.168.201.39@tcp:103:ldlm_bl.0 Request processed in 124us (1599us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869567.066737:0:14153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 0 00010000:00010000:3.0:1788869567.067709:0:14156:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788869567.071243:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1788869567.072730:0:14171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765413134592 00000100:00100000:2.0:1788869567.072751:0:14171:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765413134592 00000100:00100000:2.0:1788869567.072834:0:14171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 7 00000100:00100000:2.0:1788869567.072846:0:14171:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c83513ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8eec8521-73a5-4f2d-941c-80b702633766+18:14363:x1875765413134592:12345-192.168.201.39@tcp:35:lfs.0 00000100:00100000:2.0:1788869567.073298:0:14171:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c83513ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8eec8521-73a5-4f2d-941c-80b702633766+19:14363:x1875765413134592:12345-192.168.201.39@tcp:35:lfs.0 Request processed in 452us (2070us total) trans 8589934605 rc 0/0 00000100:00100000:2.0:1788869567.073307:0:14171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 7 00000100:00100000:0.0:1788869567.374977:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1788869567.375061:0:15030:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765413134848 00000100:00100000:2.0:1788869567.375090:0:15030:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765413134848 00000100:00100000:2.0:1788869567.375367:0:15030:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 33 00000100:00100000:2.0:1788869567.375377:0:15030:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c83fbb0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8eec8521-73a5-4f2d-941c-80b702633766+19:14394:x1875765413134848:12345-192.168.201.39@tcp:101:cat.0 00010000:00010000:2.0:1788869567.375402:0:15030:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788869567.375423:0:15030:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94c805038e00/0x3d2d1916761d79dd lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x375c010249035d48 expref: -99 pid: 15030 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869567.375553:0:15030:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94c805038a00/0x3d2d1916761d79e4 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 15030 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869567.375568:0:15030:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94c805038a00/0x3d2d1916761d79e4 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15030 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869567.375580:0:15030:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94c805038a00/0x3d2d1916761d79e4 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15030 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788869567.375593:0:15030:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1788869567.375771:0:15030:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94c805038e00/0x3d2d1916761d79dd lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0x375c010249035d48 expref: 22 pid: 15030 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869567.375792:0:15030:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94c805038a00/0x3d2d1916761d79e4 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0x375c010249035d48 expref: 21 pid: 15030 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869567.375800:0:15030:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff94c802db2600) 00010000:00010000:2.0:1788869567.375802:0:15030:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788869567.375805:0:15030:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94c805038a00, rc 0) 00000100:00100000:2.0:1788869567.375866:0:15030:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c83fbb0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8eec8521-73a5-4f2d-941c-80b702633766+21:14394:x1875765413134848:12345-192.168.201.39@tcp:101:cat.0 Request processed in 490us (898us total) trans 8589934606 rc 0/0 00000100:00100000:2.0:1788869567.375878:0:15030:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 33 00000100:00100000:2.0:1788869567.381628:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1788869567.381686:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1788869567.381793:0:14171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765413135232 00000100:00100000:0.0:1788869567.381804:0:14171:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765413135232 00000100:00100000:0.0:1788869567.381869:0:14171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 8 00000100:00100000:0.0:1788869567.381880:0:14171:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c82cdc6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8eec8521-73a5-4f2d-941c-80b702633766+21:14394:x1875765413135232:12345-192.168.201.39@tcp:35:cat.0 00000100:00100000:0.0:1788869567.382302:0:14171:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c82cdc6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8eec8521-73a5-4f2d-941c-80b702633766+22:14394:x1875765413135232:12345-192.168.201.39@tcp:35:cat.0 Request processed in 422us (682us total) trans 8589934607 rc 0/0 00000100:00100000:0.0:1788869567.382311:0:14171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 8 00000100:00100000:1.0:1788869567.382452:0:14155:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765413134976 00000100:00100000:1.0:1788869567.382457:0:14155:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765413134976 00000100:00100000:1.0:1788869567.382510:0:14155:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 1 00000100:00100000:1.0:1788869567.382517:0:14155:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c82cdc5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8eec8521-73a5-4f2d-941c-80b702633766+22:2348:x1875765413134976:12345-192.168.201.39@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788869567.382531:0:14155:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788869567.382555:0:14155:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94c805038a00/0x3d2d1916761d79e4 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.39@tcp remote: 0x375c010249035d48 expref: 22 pid: 15030 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869567.382572:0:14155:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff94c802db2600) 00010000:00010000:1.0:1788869567.382578:0:14155:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788869567.382598:0:14155:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c82cdc5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8eec8521-73a5-4f2d-941c-80b702633766+21:2348:x1875765413134976:12345-192.168.201.39@tcp:103:ldlm_bl.0 Request processed in 81us (911us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869567.382605:0:14155:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 1 00000100:00100000:0.0:1788869567.468778:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1788869567.468957:0:14168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765413135488 00000100:00100000:2.0:1788869567.468974:0:14168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765413135488 00000100:00100000:2.0:1788869567.469072:0:14168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 34 00000100:00100000:2.0:1788869567.469082:0:14168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c83fbb2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8eec8521-73a5-4f2d-941c-80b702633766+21:14400:x1875765413135488:12345-192.168.201.39@tcp:101:dd.0 00010000:00010000:2.0:1788869567.469114:0:14168:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788869567.469150:0:14168:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94c805038e00/0x3d2d1916761d79f2 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x375c010249035d4f expref: -99 pid: 14168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869567.469316:0:14168:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94c805038200/0x3d2d1916761d79f9 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869567.469331:0:14168:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff94c805038800/0x3d2d1916761d7997 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0x375c010249035d2c expref: 22 pid: 14168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869567.469436:0:14168:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff94c805039400/0x3d2d1916761d79ac lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0x375c010249035d33 expref: 22 pid: 14170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869567.469445:0:14168:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff94c805038200/0x3d2d1916761d79f9 lrc: 5/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869567.469562:0:14168:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff94c805039400/0x3d2d1916761d79ac lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.39@tcp remote: 0x375c010249035d33 expref: 22 pid: 14170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869567.469575:0:14168:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff94c805039400/0x3d2d1916761d79ac lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.39@tcp remote: 0x375c010249035d33 expref: 22 pid: 14170 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788869567.469587:0:14168:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94c82cdc7480 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14168:1875765421498752:192.168.201.39@tcp:104: 00010000:00010000:2.0:1788869567.469754:0:14168:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff94c805038800/0x3d2d1916761d7997 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.39@tcp remote: 0x375c010249035d2c expref: 22 pid: 14168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869567.469773:0:14168:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff94c805038800/0x3d2d1916761d7997 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.39@tcp remote: 0x375c010249035d2c expref: 22 pid: 14168 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788869567.469780:0:14168:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94c82cdc6680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14168:1875765421498880:192.168.201.39@tcp:104: 00000100:00100000:2.0:1788869567.469802:0:14168:0:(client.c:2702:ptlrpc_set_wait()) set ffff94c804e5e600 going to sleep for 11 seconds 00000100:00100000:0.0:1788869567.472792:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1788869567.472829:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1788869567.472920:0:14153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765413135744 00000100:00100000:1.0:1788869567.472933:0:14153:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765413135744 00010000:00010000:1.0:1788869567.472999:0:14153:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff94c805038800/0x3d2d1916761d7997 lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.39@tcp remote: 0x375c010249035d2c expref: 23 pid: 14168 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788869567.473065:0:14153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765413135616 00000100:00100000:1.0:1788869567.473068:0:14153:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765413135616 00010000:00010000:1.0:1788869567.473081:0:14153:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff94c805039400/0x3d2d1916761d79ac lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.39@tcp remote: 0x375c010249035d33 expref: 24 pid: 14170 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788869567.473096:0:14153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 11 00000100:00100000:1.0:1788869567.473103:0:14153:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c816f04450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8eec8521-73a5-4f2d-941c-80b702633766+24:2348:x1875765413135744:12345-192.168.201.39@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788869567.473116:0:14153:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788869567.473121:0:14153:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff94c805038800/0x3d2d1916761d7997 lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.39@tcp remote: 0x375c010249035d2c expref: 24 pid: 14168 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869567.473144:0:14153:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff94c805038800/0x3d2d1916761d7997 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.39@tcp remote: 0x375c010249035d2c expref: 24 pid: 14168 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869567.473174:0:14153:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff94c802db2600) 00010000:00010000:1.0:1788869567.473180:0:14153:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff94c805038200/0x3d2d1916761d79f9 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869567.473190:0:14153:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff94c805038200/0x3d2d1916761d79f9 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869567.473197:0:14153:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788869567.473284:0:14153:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c816f04450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8eec8521-73a5-4f2d-941c-80b702633766+24:2348:x1875765413135744:12345-192.168.201.39@tcp:103:ldlm_bl.0 Request processed in 180us (504us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869567.473287:0:14154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 12 00000100:00100000:1.0:1788869567.473293:0:14153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 11 00000100:00100000:0.0:1788869567.473296:0:14154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c83fbb0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8eec8521-73a5-4f2d-941c-80b702633766+24:2348:x1875765413135616:12345-192.168.201.39@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788869567.473308:0:14154:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788869567.473314:0:14154:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff94c805039400/0x3d2d1916761d79ac lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.39@tcp remote: 0x375c010249035d33 expref: 23 pid: 14170 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869567.473336:0:14154:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff94c805039400/0x3d2d1916761d79ac lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.39@tcp remote: 0x375c010249035d33 expref: 23 pid: 14170 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869567.473348:0:14154:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff94c802db2600) 00010000:00010000:0.0:1788869567.473352:0:14154:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff94c805038200/0x3d2d1916761d79f9 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869567.473360:0:14154:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff94c805038200/0x3d2d1916761d79f9 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 14168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869567.474450:0:14154:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94c805038200/0x3d2d1916761d79f9 lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 14168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869567.474478:0:14154:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788869567.474524:0:14154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c83fbb0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8eec8521-73a5-4f2d-941c-80b702633766+23:2348:x1875765413135616:12345-192.168.201.39@tcp:103:ldlm_bl.0 Request processed in 1227us (1689us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869567.474532:0:14154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 12 00010000:00010000:2.0:1788869567.475227:0:14168:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94c805039400/0x3d2d1916761d79ac lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.39@tcp remote: 0x375c010249035d33 expref: 22 pid: 14170 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788869567.475283:0:14168:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94c82cdc7480 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14168:1875765421498752:192.168.201.39@tcp:104: 00010000:00010000:2.0:1788869567.475315:0:14168:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94c805038800/0x3d2d1916761d7997 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.39@tcp remote: 0x375c010249035d2c expref: 21 pid: 14168 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788869567.475327:0:14168:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94c82cdc6680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14168:1875765421498880:192.168.201.39@tcp:104: 00010000:00010000:2.0:1788869567.475371:0:14168:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff94c805038200/0x3d2d1916761d79f9 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869567.475382:0:14168:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff94c805038200/0x3d2d1916761d79f9 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869567.475388:0:14168:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94c805038200/0x3d2d1916761d79f9 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14168 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788869567.475417:0:14168:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1788869567.475789:0:14168:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94c805038e00/0x3d2d1916761d79f2 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0x375c010249035d4f expref: 22 pid: 14168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869567.475831:0:14168:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94c805038200/0x3d2d1916761d79f9 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0x375c010249035d4f expref: 21 pid: 14168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869567.475840:0:14168:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff94c802db2600) 00010000:00010000:2.0:1788869567.475844:0:14168:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1788869567.475848:0:14168:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94c805038200, rc 0) 00000100:00100000:2.0:1788869567.475903:0:14168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c83fbb2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8eec8521-73a5-4f2d-941c-80b702633766+21:14400:x1875765413135488:12345-192.168.201.39@tcp:101:dd.0 Request processed in 6820us (7145us total) trans 8589934608 rc 0/0 00000100:00100000:2.0:1788869567.475912:0:14168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 34 00000100:00100000:3.0:1788869567.480063:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1788869567.480330:0:14170:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765413136000 00000100:00100000:2.0:1788869567.480354:0:14170:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765413136000 00000100:00100000:2.0:1788869567.480428:0:14170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 35 00000100:00100000:2.0:1788869567.480440:0:14170:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c83513d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8eec8521-73a5-4f2d-941c-80b702633766+21:14400:x1875765413136000:12345-192.168.201.39@tcp:36:dd.0 00010000:00010000:2.0:1788869567.481220:0:14170:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94c805038a00/0x3d2d1916761d7a07 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869567.481247:0:14170:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94c805038a00/0x3d2d1916761d7a07 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869567.481304:0:14170:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94c805038a00/0x3d2d1916761d7a07 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14170 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788869567.481392:0:14170:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934609 00000004:00010000:2.0:1788869567.481440:0:14170:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000abcfd4b1 reply state 000000006f8bcd13 transno 8589934610 ns: mdt-lustre-MDT0000_UUID lock: ffff94c805038a00/0x3d2d1916761d7a07 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14170 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788869567.481451:0:14170:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788869567.481622:0:14170:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c83513d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8eec8521-73a5-4f2d-941c-80b702633766+24:14400:x1875765413136000:12345-192.168.201.39@tcp:36:dd.0 Request processed in 1180us (1576us total) trans 8589934610 rc 0/0 00000100:00100000:2.0:1788869567.481631:0:14170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 35 00000020:00080000:2.0:1788869567.481636:0:14170:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1788869567.484494:0:3270:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94c805038a00/0x3d2d1916761d7a07 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869567.484522:0:3270:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94c805038a00/0x3d2d1916761d7a07 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869567.484531:0:3270:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94c805038a00/0x3d2d1916761d7a07 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869567.484538:0:3270:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94c805038a00 already unused, calling callback (ffffffffc21124f0) 00010000:00010000:2.0:1788869567.484544:0:3270:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94c805038a00/0x3d2d1916761d7a07 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869567.484554:0:3270:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94c805038a00/0x3d2d1916761d7a07 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869567.484577:0:3270:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff94c802db2600) 00010000:00010000:2.0:1788869567.484581:0:3270:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788869567.484587:0:3270:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94c805038a00/0x3d2d1916761d7a07 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869567.484594:0:3270:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94c805038a00/0x3d2d1916761d7a07 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14170 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788869567.485158:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1788869567.485304:0:14169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765413136128 00000100:00100000:2.0:1788869567.485318:0:14169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765413136128 00000100:00100000:2.0:1788869567.485744:0:14169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 36 00000100:00100000:2.0:1788869567.485758:0:14169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c83fbb2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8eec8521-73a5-4f2d-941c-80b702633766+23:14400:x1875765413136128:12345-192.168.201.39@tcp:101:dd.0 00010000:00010000:2.0:1788869567.485814:0:14169:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788869567.485842:0:14169:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94c805038e00/0x3d2d1916761d7a0e lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x375c010249035d56 expref: -99 pid: 14169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869567.485926:0:14169:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94c805038e00/0x3d2d1916761d7a0e lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.39@tcp remote: 0x375c010249035d56 expref: 24 pid: 14169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869567.485945:0:14169:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94c805038e00/0x3d2d1916761d7a0e lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.39@tcp remote: 0x375c010249035d56 expref: 24 pid: 14169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869567.485980:0:14169:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff94c802db2600) 00010000:00010000:2.0:1788869567.485984:0:14169:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788869567.485988:0:14169:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94c805038e00, rc 0) 00000100:00100000:2.0:1788869567.486062:0:14169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c83fbb2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8eec8521-73a5-4f2d-941c-80b702633766+24:14400:x1875765413136128:12345-192.168.201.39@tcp:101:dd.0 Request processed in 307us (910us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869567.486070:0:14169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 36 00000100:00100000:3.0:1788869567.513561:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1788869567.513805:0:16188:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765413136384 00000100:00100000:2.0:1788869567.513820:0:16188:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765413136384 00000100:00100000:2.0:1788869567.513914:0:16188:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 2 00000100:00100000:2.0:1788869567.513929:0:16188:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c83513c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8eec8521-73a5-4f2d-941c-80b702633766+24:14400:x1875765413136384:12345-192.168.201.39@tcp:103:dd.0 00010000:00010000:2.0:1788869567.513950:0:16188:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788869567.513990:0:16188:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94c805038e00/0x3d2d1916761d7a0e lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.39@tcp remote: 0x375c010249035d56 expref: 24 pid: 14169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869567.514020:0:16188:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff94c802db2600) 00010000:00010000:2.0:1788869567.514028:0:16188:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788869567.514114:0:16188:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c83513c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8eec8521-73a5-4f2d-941c-80b702633766+23:14400:x1875765413136384:12345-192.168.201.39@tcp:103:dd.0 Request processed in 189us (568us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869567.514152:0:16188:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 2 00000100:00100000:3.0:1788869567.529955:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1788869567.530935:0:15030:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765413136512 00000100:00100000:0.0:1788869567.530953:0:15030:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765413136512 00000100:00100000:0.0:1788869567.531055:0:15030:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 37 00000100:00100000:0.0:1788869567.531067:0:15030:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c83513dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8eec8521-73a5-4f2d-941c-80b702633766+23:14400:x1875765413136512:12345-192.168.201.39@tcp:58:dd.0 00010000:00010000:0.0:1788869567.531243:0:15030:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94c818d1e600/0x3d2d1916761d7a15 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15030 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869567.531298:0:15030:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94c818d1e600/0x3d2d1916761d7a15 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15030 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869567.531338:0:15030:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94c818d1e600/0x3d2d1916761d7a15 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15030 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788869567.533143:0:15030:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788869567.533373:0:15030:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 64 off8320 00000040:00080000:0.0:1788869567.533477:0:15030:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xe:0x0].1, 136 off8328 00000100:00100000:0.0:1788869567.533683:0:15030:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c83513dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8eec8521-73a5-4f2d-941c-80b702633766+23:14400:x1875765413136512:12345-192.168.201.39@tcp:58:dd.0 Request processed in 2609us (3734us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869567.533699:0:15030:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 37 00000100:00100000:0.0:1788869567.536985:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1788869567.537800:0:14168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765413136640 00000100:00100000:2.0:1788869567.537815:0:14168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765413136640 00000100:00100000:3.0:1788869567.540694:0:14168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 38 00000100:00100000:3.0:1788869567.540717:0:14168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c83fbb1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8eec8521-73a5-4f2d-941c-80b702633766+23:14400:x1875765413136640:12345-192.168.201.39@tcp:101:dd.0 00010000:00010000:3.0:1788869567.540746:0:14168:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788869567.540776:0:14168:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94c702257e00/0x3d2d1916761d7a1c lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x375c010249035d5d expref: -99 pid: 14168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869567.540858:0:14168:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff94c818d1e600/0x3d2d1916761d7a15 lrc: 2/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15030 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869567.540869:0:14168:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff94c702257e00/0x3d2d1916761d7a1c lrc: 4/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.39@tcp remote: 0x375c010249035d5d expref: 24 pid: 14168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869567.540892:0:14168:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff94c818d1e600/0x3d2d1916761d7a15 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 15030 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869567.540907:0:14168:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94c702257e00/0x3d2d1916761d7a1c lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.39@tcp remote: 0x375c010249035d5d expref: 24 pid: 14168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869567.540924:0:14168:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff94c802db2600) 00010000:00010000:3.0:1788869567.541350:0:14168:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788869567.541358:0:14168:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff94c702257e00/0x3d2d1916761d7a1c lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.39@tcp remote: 0x375c010249035d5d expref: 24 pid: 14168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869567.541367:0:14168:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94c702257e00, rc 0) 00000100:00100000:3.0:1788869567.541548:0:14168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c83fbb1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8eec8521-73a5-4f2d-941c-80b702633766+24:14400:x1875765413136640:12345-192.168.201.39@tcp:101:dd.0 Request processed in 838us (4580us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869567.541557:0:14168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 38 00000040:00080000:3.0:1788869567.708097:0:14201:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:3.0:1788869567.708110:0:14201:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788869567.708169:0:14201:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:3.0:1788869567.708179:0:14201:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:3.0:1788869567.711585:0:14201:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94c83513ed80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:14201:1875765421499008:192.168.201.39@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1788869567.712375:0:14201:0:(client.c:2702:ptlrpc_set_wait()) set ffff94c802f410c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788869567.719770:0:14201:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94c83513ed80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:14201:1875765421499008:192.168.201.39@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1788869567.722539:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1788869567.723765:0:14179:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765413136768 00000100:00100000:2.0:1788869567.723783:0:14179:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765413136768 00000100:00100000:2.0:1788869567.723933:0:14179:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 0 00000100:00100000:2.0:1788869567.723946:0:14179:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c835154e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:8eec8521-73a5-4f2d-941c-80b702633766+24:14401:x1875765413136768:12345-192.168.201.39@tcp:900:lhsmtool_posix.0 00000100:00100000:2.0:1788869567.724097:0:14179:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c835154e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:8eec8521-73a5-4f2d-941c-80b702633766+24:14401:x1875765413136768:12345-192.168.201.39@tcp:900:lhsmtool_posix.0 Request processed in 145us (1565us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869567.724105:0:14179:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 0 00000100:00100000:3.0:1788869567.727035:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1788869567.727217:0:14170:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765413136896 00000100:00100000:1.0:1788869567.727287:0:14170:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765413136896 00000100:00100000:1.0:1788869567.727373:0:14170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 39 00000100:00100000:1.0:1788869567.727385:0:14170:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c83513ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8eec8521-73a5-4f2d-941c-80b702633766+24:14401:x1875765413136896:12345-192.168.201.39@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1788869567.727436:0:14170:0:(mdt_handler.c:8041:mdt_fid2path()) path get [0x200000bd1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1788869567.727578:0:14170:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c83513ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8eec8521-73a5-4f2d-941c-80b702633766+24:14401:x1875765413136896:12345-192.168.201.39@tcp:53:lhsmtool_posix.0 Request processed in 195us (557us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869567.727586:0:14170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 39 00000100:00100000:1.0:1788869567.743728:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1788869567.743966:0:14169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765413137024 00000100:00100000:2.0:1788869567.743989:0:14169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765413137024 00000100:00100000:2.0:1788869567.744071:0:14169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 40 00000100:00100000:2.0:1788869567.744083:0:14169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c83fae9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8eec8521-73a5-4f2d-941c-80b702633766+24:14401:x1875765413137024:12345-192.168.201.39@tcp:34:lhsmtool_posix.0 00010000:00010000:2.0:1788869567.744221:0:14169:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff94c805038e00/0x3d2d1916761d7a23 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869567.744245:0:14169:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94c805038e00/0x3d2d1916761d7a23 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869567.744301:0:14169:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94c805038e00/0x3d2d1916761d7a23 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869567.744322:0:14169:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94c805038a00/0x3d2d1916761d7a2a lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869567.744330:0:14169:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94c805038a00/0x3d2d1916761d7a2a lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869567.744658:0:14169:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94c805038a00/0x3d2d1916761d7a2a lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869567.744694:0:14169:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94c805038800/0x3d2d1916761d7a31 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869567.744705:0:14169:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94c805038800/0x3d2d1916761d7a31 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869567.744712:0:14169:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94c805038800/0x3d2d1916761d7a31 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14169 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788869567.744774:0:14169:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:2.0:1788869567.744779:0:14169:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1788869567.744802:0:14169:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff94c805038800/0x3d2d1916761d7a31 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869567.744817:0:14169:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff94c805038e00/0x3d2d1916761d7a23 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869567.744825:0:14169:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94c805038e00/0x3d2d1916761d7a23 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869567.744832:0:14169:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94c805038e00/0x3d2d1916761d7a23 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869567.744839:0:14169:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94c805038e00 already unused, calling callback (ffffffffc21124f0) 00010000:00010000:2.0:1788869567.744844:0:14169:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94c805038e00/0x3d2d1916761d7a23 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869567.744852:0:14169:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94c805038e00/0x3d2d1916761d7a23 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869567.744874:0:14169:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff94c810a48000) 00010000:00010000:2.0:1788869567.744877:0:14169:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788869567.744882:0:14169:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94c805038e00/0x3d2d1916761d7a23 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869567.744889:0:14169:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94c805038e00/0x3d2d1916761d7a23 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869567.744905:0:14169:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94c805038a00/0x3d2d1916761d7a2a lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869567.744911:0:14169:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94c805038a00/0x3d2d1916761d7a2a lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869567.744916:0:14169:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94c805038a00/0x3d2d1916761d7a2a lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869567.744921:0:14169:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94c805038a00 already unused, calling callback (ffffffffc21124f0) 00010000:00010000:2.0:1788869567.744924:0:14169:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94c805038a00/0x3d2d1916761d7a2a lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869567.744930:0:14169:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94c805038a00/0x3d2d1916761d7a2a lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869567.744936:0:14169:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x4549062c (ffff94c802db2500) 00010000:00010000:2.0:1788869567.744938:0:14169:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788869567.744941:0:14169:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94c805038a00/0x3d2d1916761d7a2a lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869567.744947:0:14169:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94c805038a00/0x3d2d1916761d7a2a lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869567.744972:0:14169:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94c805038800/0x3d2d1916761d7a31 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869567.744978:0:14169:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94c805038800/0x3d2d1916761d7a31 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869567.744984:0:14169:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94c805038800/0x3d2d1916761d7a31 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869567.744988:0:14169:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94c805038800 already unused, calling callback (ffffffffc21124f0) 00010000:00010000:2.0:1788869567.744990:0:14169:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94c805038800/0x3d2d1916761d7a31 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869567.744997:0:14169:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94c805038800/0x3d2d1916761d7a31 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869567.745004:0:14169:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff94c802db2600) 00010000:00010000:2.0:1788869567.745006:0:14169:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788869567.745009:0:14169:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94c805038800/0x3d2d1916761d7a31 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869567.745015:0:14169:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94c805038800/0x3d2d1916761d7a31 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14169 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788869567.745183:0:14169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c83fae9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8eec8521-73a5-4f2d-941c-80b702633766+24:14401:x1875765413137024:12345-192.168.201.39@tcp:34:lhsmtool_posix.0 Request processed in 1101us (1471us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869567.745193:0:14169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 40 00000100:00100000:1.0:1788869567.749858:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1788869567.750072:0:14170:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765413137280 00000100:00100000:2.0:1788869567.750165:0:14170:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765413137280 00000100:00100000:2.0:1788869567.754565:0:14170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 41 00000100:00100000:2.0:1788869567.754618:0:14170:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c83faead80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8eec8521-73a5-4f2d-941c-80b702633766+24:14401:x1875765413137280:12345-192.168.201.39@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788869567.754654:0:14170:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788869567.754688:0:14170:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94c805039400/0x3d2d1916761d7a38 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x375c010249035d64 expref: -99 pid: 14170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869567.754851:0:14170:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504ce00/0x3d2d1916761d7a3f lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869567.754870:0:14170:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504ce00/0x3d2d1916761d7a3f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869567.754883:0:14170:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504ce00/0x3d2d1916761d7a3f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14170 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788869567.754897:0:14170:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1788869567.755640:0:14170:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504ce00/0x3d2d1916761d7a3f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869567.755652:0:14170:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504ce00/0x3d2d1916761d7a3f lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869567.755660:0:14170:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504ce00/0x3d2d1916761d7a3f lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869567.755667:0:14170:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94c83504ce00 already unused, calling callback (ffffffffc21124f0) 00010000:00010000:2.0:1788869567.755672:0:14170:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504ce00/0x3d2d1916761d7a3f lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869567.755682:0:14170:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504ce00/0x3d2d1916761d7a3f lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869567.755699:0:14170:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff94c802db2600) 00010000:00010000:2.0:1788869567.755712:0:14170:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1788869567.755720:0:14170:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504ce00/0x3d2d1916761d7a3f lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869567.755726:0:14170:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504ce00/0x3d2d1916761d7a3f lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869567.755788:0:14170:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94c805039400/0x3d2d1916761d7a38 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0x375c010249035d64 expref: 26 pid: 14170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869567.755799:0:14170:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff94c810a48000) 00010000:00010000:2.0:1788869567.755802:0:14170:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788869567.755806:0:14170:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94c805039400/0x3d2d1916761d7a38 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.39@tcp remote: 0x375c010249035d64 expref: 26 pid: 14170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869567.755817:0:14170:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94c805039400, rc 0) 00000100:00100000:2.0:1788869567.755918:0:14170:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c83faead80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8eec8521-73a5-4f2d-941c-80b702633766+25:14401:x1875765413137280:12345-192.168.201.39@tcp:101:lhsmtool_posix.0 Request processed in 1313us (6073us total) trans 8589934611 rc 301/301 00000100:00100000:2.0:1788869567.755928:0:14170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 41 00000100:00100000:3.0:1788869567.763878:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1788869567.764563:0:14170:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765413137408 00000100:00100000:2.0:1788869567.764578:0:14170:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765413137408 00000100:00100000:2.0:1788869567.764654:0:14170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 42 00000100:00100000:2.0:1788869567.764667:0:14170:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c83513e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8eec8521-73a5-4f2d-941c-80b702633766+25:14401:x1875765413137408:12345-192.168.201.39@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1788869567.764721:0:14170:0:(mdt_handler.c:8041:mdt_fid2path()) path get [0x200000bd1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1788869567.764870:0:14170:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c83513e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8eec8521-73a5-4f2d-941c-80b702633766+25:14401:x1875765413137408:12345-192.168.201.39@tcp:53:lhsmtool_posix.0 Request processed in 205us (1007us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869567.764879:0:14170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 42 00000100:00100000:2.0:1788869567.771033:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1788869567.771292:0:15030:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765413137664 00000100:00100000:3.0:1788869567.771305:0:15030:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765413137664 00000100:00100000:3.0:1788869567.771398:0:15030:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 43 00000100:00100000:3.0:1788869567.771410:0:15030:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c82cdc6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8eec8521-73a5-4f2d-941c-80b702633766+25:14401:x1875765413137664:12345-192.168.201.39@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788869567.771441:0:15030:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788869567.771469:0:15030:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94c702256800/0x3d2d1916761d7a4d lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x375c010249035d6b expref: -99 pid: 15030 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1788869567.775911:0:15030:0:(osp_internal.h:570:osp_update_last_fid()) Gap in objids: start=[0x240000400:0x6:0x0], count =28 00000004:00080000:0.0:1788869567.775930:0:15030:0:(osp_object.c:1645:osp_create()) Writing gap [0x240000400:0x6:0x0]+28 in llog 00000004:00080000:0.0:1788869567.777230:0:15030:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x22:0x0], index 0: 0 00010000:00010000:1.0:1788869567.780055:0:15030:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94c83fde6200/0x3d2d1916761d7a54 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15030 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869567.780094:0:15030:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94c83fde6200/0x3d2d1916761d7a54 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15030 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869567.780109:0:15030:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94c83fde6200/0x3d2d1916761d7a54 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15030 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869567.780209:0:15030:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94c702256800/0x3d2d1916761d7a4d lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0x375c010249035d6b expref: 28 pid: 15030 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869567.780231:0:15030:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94c83fde6200/0x3d2d1916761d7a54 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0x375c010249035d6b expref: 27 pid: 15030 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869567.780242:0:15030:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff94c81a585000) 00010000:00010000:1.0:1788869567.780245:0:15030:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788869567.780263:0:15030:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94c83fde6200, rc 0) 00000100:00100000:1.0:1788869567.781134:0:15030:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c82cdc6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8eec8521-73a5-4f2d-941c-80b702633766+27:14401:x1875765413137664:12345-192.168.201.39@tcp:101:lhsmtool_posix.0 Request processed in 9713us (10104us total) trans 8589934612 rc 0/0 00000100:00100000:1.0:1788869567.781169:0:15030:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 43 00000100:00100000:1.0:1788869567.787116:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1788869567.787347:0:14168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765413137920 00000100:00100000:3.0:1788869567.787372:0:14168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765413137920 00000100:00100000:3.0:1788869567.787461:0:14168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 44 00000100:00100000:3.0:1788869567.787473:0:14168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c83fae8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8eec8521-73a5-4f2d-941c-80b702633766+27:14401:x1875765413137920:12345-192.168.201.39@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1788869567.787558:0:14168:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788869567.787601:0:14168:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94c83fde6200/0x3d2d1916761d7a54 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.39@tcp remote: 0x375c010249035d6b expref: 27 pid: 15030 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869567.787969:0:14168:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff94c81a585000) 00010000:00010000:3.0:1788869567.787986:0:14168:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788869567.788020:0:14168:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94c702257a00/0x3d2d1916761d7a62 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869567.788037:0:14168:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94c702257a00/0x3d2d1916761d7a62 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869567.788048:0:14168:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94c702257a00/0x3d2d1916761d7a62 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869567.788064:0:14168:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94c702256400/0x3d2d1916761d7a69 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0xebe6f8cc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869567.788072:0:14168:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94c702256400/0x3d2d1916761d7a69 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xebe6f8cc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869567.788078:0:14168:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94c702256400/0x3d2d1916761d7a69 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xebe6f8cc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869567.788631:0:14168:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94c702257a00/0x3d2d1916761d7a62 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869567.788641:0:14168:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94c702257a00/0x3d2d1916761d7a62 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869567.788649:0:14168:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94c702257a00/0x3d2d1916761d7a62 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869567.788655:0:14168:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94c702257a00 already unused, calling callback (ffffffffc21124f0) 00010000:00010000:3.0:1788869567.788660:0:14168:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94c702257a00/0x3d2d1916761d7a62 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869567.788678:0:14168:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94c702257a00/0x3d2d1916761d7a62 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869567.788690:0:14168:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff94c802db2800) 00010000:00010000:3.0:1788869567.788693:0:14168:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788869567.788697:0:14168:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94c702257a00/0x3d2d1916761d7a62 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869567.788705:0:14168:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94c702257a00/0x3d2d1916761d7a62 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869567.788717:0:14168:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94c702256400/0x3d2d1916761d7a69 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xebe6f8cc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869567.788723:0:14168:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94c702256400/0x3d2d1916761d7a69 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xebe6f8cc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869567.788729:0:14168:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94c702256400/0x3d2d1916761d7a69 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xebe6f8cc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869567.788735:0:14168:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94c702256400 already unused, calling callback (ffffffffc21124f0) 00010000:00010000:3.0:1788869567.788738:0:14168:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94c702256400/0x3d2d1916761d7a69 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xebe6f8cc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869567.788744:0:14168:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94c702256400/0x3d2d1916761d7a69 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xebe6f8cc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869567.788751:0:14168:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xebe6f8cc (ffff94c810a48400) 00010000:00010000:3.0:1788869567.788754:0:14168:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788869567.788757:0:14168:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94c702256400/0x3d2d1916761d7a69 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xebe6f8cc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869567.788773:0:14168:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94c702256400/0x3d2d1916761d7a69 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xebe6f8cc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14168 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788869567.788890:0:14168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c83fae8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8eec8521-73a5-4f2d-941c-80b702633766+26:14401:x1875765413137920:12345-192.168.201.39@tcp:36:lhsmtool_posix.0 Request processed in 1417us (1799us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788869567.788900:0:14168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 44 00000100:00100000:2.0:1788869567.796600:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1788869567.797209:0:14170:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765413138048 00000100:00100000:1.0:1788869567.797228:0:14170:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765413138048 00000100:00100000:1.0:1788869567.797508:0:14170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 45 00000100:00100000:1.0:1788869567.797522:0:14170:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c82cdc7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8eec8521-73a5-4f2d-941c-80b702633766+26:14401:x1875765413138048:12345-192.168.201.39@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788869567.797553:0:14170:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788869567.797586:0:14170:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94c83fde7200/0x3d2d1916761d7a70 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x375c010249035d72 expref: -99 pid: 14170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869567.797648:0:14170:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94c83fde7000/0x3d2d1916761d7a77 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869567.797666:0:14170:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94c83fde7000/0x3d2d1916761d7a77 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869567.797681:0:14170:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94c83fde7000/0x3d2d1916761d7a77 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869567.797819:0:14170:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94c83fde7200/0x3d2d1916761d7a70 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0x375c010249035d72 expref: 28 pid: 14170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869567.797842:0:14170:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94c83fde7000/0x3d2d1916761d7a77 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0x375c010249035d72 expref: 27 pid: 14170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869567.797852:0:14170:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff94c81a585600) 00010000:00010000:1.0:1788869567.797855:0:14170:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1788869567.797866:0:14170:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94c83fde7000, rc 0) 00000100:00100000:1.0:1788869567.797960:0:14170:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c82cdc7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8eec8521-73a5-4f2d-941c-80b702633766+27:14401:x1875765413138048:12345-192.168.201.39@tcp:101:lhsmtool_posix.0 Request processed in 440us (1378us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869567.797975:0:14170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 45 00000100:00100000:0.0:1788869567.805998:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1788869567.807486:0:15030:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765413138304 00000100:00100000:2.0:1788869567.807516:0:15030:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765413138304 00000100:00100000:2.0:1788869567.807706:0:15030:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 46 00000100:00100000:2.0:1788869567.807721:0:15030:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c835157b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8eec8521-73a5-4f2d-941c-80b702633766+27:14401:x1875765413138304:12345-192.168.201.39@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1788869567.807843:0:15030:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504ce00/0x3d2d1916761d7a7e lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15030 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869567.807866:0:15030:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504ce00/0x3d2d1916761d7a7e lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15030 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869567.807880:0:15030:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504ce00/0x3d2d1916761d7a7e lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15030 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788869567.809309:0:15030:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].2, 88 off8344 00000004:00080000:2.0:1788869567.809328:0:15030:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 316101077376ns, next at 317101073339ns, rc = 0 00000004:00010000:2.0:1788869567.809467:0:15030:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000008ddebf4d reply state 00000000a1a20604 transno 8589934613 ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504ce00/0x3d2d1916761d7a7e lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15030 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788869567.809481:0:15030:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788869567.809654:0:15030:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c835157b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8eec8521-73a5-4f2d-941c-80b702633766+29:14401:x1875765413138304:12345-192.168.201.39@tcp:36:lhsmtool_posix.0 Request processed in 1933us (3670us total) trans 8589934613 rc 0/0 00000100:00100000:2.0:1788869567.809664:0:15030:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 46 00010000:00010000:1.0:1788869567.813688:0:3269:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504ce00/0x3d2d1916761d7a7e lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15030 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869567.813711:0:3269:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504ce00/0x3d2d1916761d7a7e lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15030 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869567.813719:0:3269:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504ce00/0x3d2d1916761d7a7e lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15030 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869567.813725:0:3269:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94c83504ce00 already unused, calling callback (ffffffffc21124f0) 00010000:00010000:1.0:1788869567.813730:0:3269:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504ce00/0x3d2d1916761d7a7e lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15030 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869567.813738:0:3269:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504ce00/0x3d2d1916761d7a7e lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 15030 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869567.813761:0:3269:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff94c81a585600) 00010000:00010000:1.0:1788869567.813764:0:3269:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1788869567.813769:0:3269:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504ce00/0x3d2d1916761d7a7e lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15030 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869567.813776:0:3269:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504ce00/0x3d2d1916761d7a7e lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15030 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788869567.814432:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1788869567.814691:0:14168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765413138432 00000100:00100000:0.0:1788869567.814707:0:14168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765413138432 00000100:00100000:0.0:1788869567.814796:0:14168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 47 00000100:00100000:0.0:1788869567.814809:0:14168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c83513f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8eec8521-73a5-4f2d-941c-80b702633766+28:14401:x1875765413138432:12345-192.168.201.39@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788869567.814846:0:14168:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788869567.814872:0:14168:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94c818d1e400/0x3d2d1916761d7a85 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x375c010249035d79 expref: -99 pid: 14168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869567.814977:0:14168:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94c818d1e400/0x3d2d1916761d7a85 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.39@tcp remote: 0x375c010249035d79 expref: 29 pid: 14168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869567.814994:0:14168:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94c818d1e400/0x3d2d1916761d7a85 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.39@tcp remote: 0x375c010249035d79 expref: 29 pid: 14168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869567.815039:0:14168:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff94c81a585600) 00010000:00010000:0.0:1788869567.815043:0:14168:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788869567.815047:0:14168:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94c818d1e400, rc 0) 00000100:00100000:0.0:1788869567.815464:0:14168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c83513f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8eec8521-73a5-4f2d-941c-80b702633766+29:14401:x1875765413138432:12345-192.168.201.39@tcp:101:lhsmtool_posix.0 Request processed in 655us (1103us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869567.815474:0:14168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 47 00000100:00100000:0.0:1788869567.826599:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1788869567.826664:0:15767:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765413138560 00000100:00100000:0.0:1788869567.826675:0:15767:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765413138560 00000100:00080000:3.0:1788869567.826723:0:14164:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788869567.826765:0:15767:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 14 00000100:00100000:0.0:1788869567.826780:0:15767:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c83661d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8eec8521-73a5-4f2d-941c-80b702633766+5:2348:x1875765413138560:12345-192.168.201.39@tcp:2:lhsmtool_posix.0 00000100:00100000:0.0:1788869567.827857:0:15767:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c83661d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8eec8521-73a5-4f2d-941c-80b702633766+6:2348:x1875765413138560:12345-192.168.201.39@tcp:2:lhsmtool_posix.0 Request processed in 1076us (1263us total) trans 8589934594 rc 0/0 00000100:00100000:0.0:1788869567.827867:0:15767:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 14 00000100:00100000:3.0:1788869567.830926:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1788869567.830986:0:14171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765413138816 00000100:00100000:3.0:1788869567.830995:0:14171:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765413138816 00000100:00100000:3.0:1788869567.831052:0:14171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 9 00000100:00100000:3.0:1788869567.831063:0:14171:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c83513fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8eec8521-73a5-4f2d-941c-80b702633766+29:14401:x1875765413138816:12345-192.168.201.39@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1788869567.831456:0:14171:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c83513fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8eec8521-73a5-4f2d-941c-80b702633766+30:14401:x1875765413138816:12345-192.168.201.39@tcp:35:lhsmtool_posix.0 Request processed in 393us (537us total) trans 8589934614 rc 0/0 00000100:00100000:3.0:1788869567.831463:0:14171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 9 00000100:00100000:3.0:1788869567.834534:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1788869567.834605:0:14170:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765413139072 00000100:00100000:1.0:1788869567.834633:0:14170:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765413139072 00000100:00100000:1.0:1788869567.834733:0:14170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 48 00000100:00100000:1.0:1788869567.834744:0:14170:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c82c841180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8eec8521-73a5-4f2d-941c-80b702633766+30:14401:x1875765413139072:12345-192.168.201.39@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1788869567.834946:0:14170:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c82c841180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8eec8521-73a5-4f2d-941c-80b702633766+30:14401:x1875765413139072:12345-192.168.201.39@tcp:57:lhsmtool_posix.0 Request processed in 203us (420us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869567.834954:0:14170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 48 00000100:00100000:0.0:1788869567.837501:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1788869567.837597:0:14168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765413139200 00000100:00100000:3.0:1788869567.837613:0:14168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765413139200 00000100:00100000:3.0:1788869567.837737:0:14168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 49 00000100:00100000:3.0:1788869567.837749:0:14168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c83661fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8eec8521-73a5-4f2d-941c-80b702633766+30:14401:x1875765413139200:12345-192.168.201.39@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788869567.837773:0:14168:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788869567.837807:0:14168:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94c702256400/0x3d2d1916761d7a8c lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x375c010249035d80 expref: -99 pid: 14168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869567.837907:0:14168:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94c702257a00/0x3d2d1916761d7a93 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869567.837938:0:14168:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94c702257a00/0x3d2d1916761d7a93 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869567.837950:0:14168:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94c702257a00/0x3d2d1916761d7a93 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14168 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788869567.838000:0:14168:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1788869567.838020:0:14168:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff94c702257a00/0x3d2d1916761d7a93 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869567.838048:0:14168:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94c702256400/0x3d2d1916761d7a8c lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0x375c010249035d80 expref: 32 pid: 14168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869567.838068:0:14168:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94c702257a00/0x3d2d1916761d7a93 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0x375c010249035d80 expref: 31 pid: 14168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869567.838077:0:14168:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff94c81a585600) 00010000:00010000:3.0:1788869567.838081:0:14168:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1788869567.838084:0:14168:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94c702257a00, rc 0) 00000100:00100000:3.0:1788869567.838163:0:14168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c83661fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8eec8521-73a5-4f2d-941c-80b702633766+31:14401:x1875765413139200:12345-192.168.201.39@tcp:101:lhsmtool_posix.0 Request processed in 416us (687us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869567.838171:0:14168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 49 00000100:00100000:0.0:1788869567.843340:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1788869567.843425:0:14806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765413139328 00000100:00100000:3.0:1788869567.843442:0:14806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765413139328 00000100:00100000:3.0:1788869567.843508:0:14806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 15 00000100:00100000:3.0:1788869567.843520:0:14806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c83661c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8eec8521-73a5-4f2d-941c-80b702633766+6:2347:x1875765413139328:12345-192.168.201.39@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788869567.843544:0:14806:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788869567.843587:0:14806:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c483ebf6/0x3d2d1916761d7a9a lrc: 2/0,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x375c010249035d87 expref: -99 pid: 14806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788869567.843623:0:14806:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x22:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a9ffbbe, blocks: 0x1 00010000:00010000:3.0:1788869567.843650:0:14806:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=316s v=(0 0) 00010000:00010000:3.0:1788869567.843655:0:14806:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788869567.843669:0:14806:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c483ebf6/0x3d2d1916761d7a9a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.39@tcp remote: 0x375c010249035d87 expref: 7 pid: 14806 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869567.843691:0:14806:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000c483ebf6/0x3d2d1916761d7a9a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.39@tcp remote: 0x375c010249035d87 expref: 7 pid: 14806 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869567.843706:0:14806:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94c702256800, rc 0) 00000100:00100000:3.0:1788869567.843791:0:14806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c83661c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8eec8521-73a5-4f2d-941c-80b702633766+7:2347:x1875765413139328:12345-192.168.201.39@tcp:101:lhsmtool_posix.0 Request processed in 274us (469us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869567.843800:0:14806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 15 00000100:00100000:1.0:1788869567.846945:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1788869567.847369:0:14170:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765413139584 00000100:00100000:2.0:1788869567.847384:0:14170:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765413139584 00000100:00100000:2.0:1788869567.847515:0:14170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 50 00000100:00100000:2.0:1788869567.847526:0:14170:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c83fae8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8eec8521-73a5-4f2d-941c-80b702633766+31:14401:x1875765413139584:12345-192.168.201.39@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1788869567.850620:0:14170:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c83fae8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8eec8521-73a5-4f2d-941c-80b702633766+31:14401:x1875765413139584:12345-192.168.201.39@tcp:57:lhsmtool_posix.0 Request processed in 3079us (3680us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869567.850668:0:14170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 50 00000100:00100000:0.0:1788869567.859102:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1788869567.859171:0:15030:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765413139712 00000100:00100000:2.0:1788869567.859180:0:15030:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765413139712 00000100:00100000:2.0:1788869567.859356:0:15030:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 51 00000100:00100000:2.0:1788869567.859371:0:15030:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c83661d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8eec8521-73a5-4f2d-941c-80b702633766+31:14401:x1875765413139712:12345-192.168.201.39@tcp:44:lhsmtool_posix.0 00000001:00080000:1.0:1788869567.969610:0:5777:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934612 is committed 00000001:00080000:1.0:1788869567.969637:0:5777:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934595 is committed 00000001:00080000:1.0:1788869567.969645:0:5777:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934597 is committed 00000001:00080000:1.0:1788869567.969665:0:5777:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934613 is committed 00000004:00080000:1.0:1788869567.969670:0:5777:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2 committed 00000001:00080000:1.0:1788869567.969726:0:5777:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934599 is committed 00000001:00080000:1.0:1788869567.969739:0:5777:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934614 is committed 00000100:00100000:1.0:1788869567.970102:0:3286:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94c82c843100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3286:1875765421499136:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1788869567.970346:0:15030:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c83661d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8eec8521-73a5-4f2d-941c-80b702633766+14:14401:x1875765413139712:12345-192.168.201.39@tcp:44:lhsmtool_posix.0 Request processed in 110967us (111242us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869567.970908:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869567.971055:0:15030:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 51 00000100:00100000:0.0:1788869567.971184:0:14805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765421499136 00000100:00100000:0.0:1788869567.971196:0:14805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765421499136 00000100:00100000:0.0:1788869567.971297:0:14805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1788869567.971309:0:14805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c83fae9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3286:x1875765421499136:12345-0@lo:2:osp-syn-0-0.0 00000100:00080000:2.0:1788869567.973545:0:14164:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788869567.974517:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1788869567.974638:0:14804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765413139840 00000100:00100000:2.0:1788869567.974651:0:14804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765413139840 00000100:00100000:2.0:1788869567.974722:0:14804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 17 00000100:00100000:2.0:1788869567.974735:0:14804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c82c840000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8eec8521-73a5-4f2d-941c-80b702633766+7:2348:x1875765413139840:12345-192.168.201.39@tcp:16:lhsmtool_posix.0 00002000:00010000:1.0:1788869567.974884:0:14805:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1788869567.974890:0:14805:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:1.0:1788869567.974892:0:14805:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1788869567.974895:0:14805:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb ctime from disk: 1788869566 -> 1788869566 00002000:00010000:1.0:1788869567.974897:0:14805:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:1.0:1788869567.974980:0:14805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c83fae9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3286:x1875765421499136:12345-0@lo:2:osp-syn-0-0.0 Request processed in 3672us (4073us total) trans 8589934595 rc 0/0 00000100:00100000:1.0:1788869567.974990:0:14805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000004:00080000:1.0:1788869567.975064:0:3286:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94c82c843100/2, rc 0, transno 8589934595 00000100:00100000:1.0:1788869567.975072:0:3286:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94c82c843100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3286:1875765421499136:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1788869567.976107:0:14804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c82c840000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8eec8521-73a5-4f2d-941c-80b702633766+7:2348:x1875765413139840:12345-192.168.201.39@tcp:16:lhsmtool_posix.0 Request processed in 1369us (1603us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869567.976130:0:14804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 17 00000100:00100000:3.0:1788869567.980190:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1788869567.980338:0:14169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765413140096 00000100:00100000:2.0:1788869567.980348:0:14169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765413140096 00000100:00100000:2.0:1788869567.980458:0:14169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 52 00000100:00100000:2.0:1788869567.980468:0:14169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c82c841500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8eec8521-73a5-4f2d-941c-80b702633766+14:14401:x1875765413140096:12345-192.168.201.39@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1788869567.980579:0:14169:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788869567.980614:0:14169:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94c702257a00/0x3d2d1916761d7a93 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.39@tcp remote: 0x375c010249035d80 expref: 14 pid: 14168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869567.980638:0:14169:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff94c81a585600) 00010000:00010000:2.0:1788869567.980718:0:14169:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788869567.980773:0:14169:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504c600/0x3d2d1916761d7aa1 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869567.980809:0:14169:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504c600/0x3d2d1916761d7aa1 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869567.980820:0:14169:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504c600/0x3d2d1916761d7aa1 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14169 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788869567.981226:0:14169:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000002da2f132 reply state 0000000017f658fe transno 8589934615 ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504c600/0x3d2d1916761d7aa1 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14169 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788869567.981373:0:14169:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788869567.981812:0:14169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c82c841500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8eec8521-73a5-4f2d-941c-80b702633766+15:14401:x1875765413140096:12345-192.168.201.39@tcp:36:lhsmtool_posix.0 Request processed in 1332us (1633us total) trans 8589934615 rc 0/0 00000100:00100000:2.0:1788869567.981822:0:14169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 52 00010000:00010000:2.0:1788869567.985001:0:3270:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504c600/0x3d2d1916761d7aa1 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869567.985024:0:3270:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504c600/0x3d2d1916761d7aa1 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869567.985030:0:3270:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504c600/0x3d2d1916761d7aa1 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869567.985035:0:3270:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94c83504c600 already unused, calling callback (ffffffffc21124f0) 00010000:00010000:2.0:1788869567.985038:0:3270:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504c600/0x3d2d1916761d7aa1 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869567.985043:0:3270:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504c600/0x3d2d1916761d7aa1 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869567.985088:0:3270:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff94c81a585600) 00010000:00010000:2.0:1788869567.985090:0:3270:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788869567.985093:0:3270:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504c600/0x3d2d1916761d7aa1 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869567.985098:0:3270:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94c83504c600/0x3d2d1916761d7aa1 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14169 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788869567.993807:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1788869567.994204:0:15767:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765413140224 00000100:00100000:0.0:1788869567.994230:0:15767:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765413140224 00000100:00100000:0.0:1788869567.994361:0:15767:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 18 00000100:00100000:0.0:1788869567.994371:0:15767:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c83faeaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8eec8521-73a5-4f2d-941c-80b702633766+7:14401:x1875765413140224:12345-192.168.201.39@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788869567.994423:0:15767:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788869567.994455:0:15767:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f3c5cfee/0x3d2d1916761d7aa8 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x375c010249035d8e expref: -99 pid: 15767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869567.994508:0:15767:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000c483ebf6/0x3d2d1916761d7a9a lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.39@tcp remote: 0x375c010249035d87 expref: 8 pid: 14806 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869567.994517:0:15767:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788869567.994521:0:15767:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788869567.994540:0:15767:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f3c5cfee/0x3d2d1916761d7aa8 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.201.39@tcp remote: 0x375c010249035d8e expref: 8 pid: 15767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869567.994588:0:15767:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000c483ebf6/0x3d2d1916761d7a9a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.39@tcp remote: 0x375c010249035d87 expref: 8 pid: 14806 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869567.994632:0:15767:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000c483ebf6/0x3d2d1916761d7a9a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.39@tcp remote: 0x375c010249035d87 expref: 8 pid: 14806 timeout: 416 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788869567.994647:0:15767:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94c810e6a680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:15767:1875765421499264:192.168.201.39@tcp:104: 00000100:00100000:0.0:1788869567.994790:0:15767:0:(client.c:2702:ptlrpc_set_wait()) set ffff94c8033c4780 going to sleep for 11 seconds 00000100:00100000:3.0:1788869568.000609:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1788869568.001197:0:15767:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94c810e6a680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:15767:1875765421499264:192.168.201.39@tcp:104: 00010000:00010000:0.0:1788869568.001794:0:15767:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000f3c5cfee/0x3d2d1916761d7aa8 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.201.39@tcp remote: 0x375c010249035d8e expref: 8 pid: 15767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869568.001848:0:15767:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94c818d1e200, rc 0) 00000100:00100000:1.0:1788869568.002030:0:14153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765413140352 00000100:00100000:1.0:1788869568.002047:0:14153:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765413140352 00010000:00010000:1.0:1788869568.002110:0:14153:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000c483ebf6/0x3d2d1916761d7a9a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.39@tcp remote: 0x375c010249035d87 expref: 9 pid: 14806 timeout: 416 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788869568.002224:0:14153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 13 00000100:00100000:1.0:1788869568.002234:0:14153:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c82c843800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8eec8521-73a5-4f2d-941c-80b702633766+9:2348:x1875765413140352:12345-192.168.201.39@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788869568.002293:0:14153:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788869568.002343:0:14153:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000c483ebf6/0x3d2d1916761d7a9a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.39@tcp remote: 0x375c010249035d87 expref: 9 pid: 14806 timeout: 416 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869568.002364:0:14153:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000c483ebf6/0x3d2d1916761d7a9a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.39@tcp remote: 0x375c010249035d87 expref: 9 pid: 14806 timeout: 416 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869568.002417:0:14153:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c483ebf6/0x3d2d1916761d7a9a lrc: 0/0,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.39@tcp remote: 0x375c010249035d87 expref: 9 pid: 14806 timeout: 416 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869568.002448:0:14153:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788869568.002453:0:14153:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788869568.002470:0:14153:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000f3c5cfee/0x3d2d1916761d7aa8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.201.39@tcp remote: 0x375c010249035d8e expref: 8 pid: 15767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788869568.002890:0:15767:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c83faeaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8eec8521-73a5-4f2d-941c-80b702633766+8:14401:x1875765413140224:12345-192.168.201.39@tcp:101:lhsmtool_posix.0 Request processed in 8519us (9092us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869568.002908:0:15767:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 18 00010000:00010000:1.0:1788869568.005689:0:14153:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f3c5cfee/0x3d2d1916761d7aa8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.201.39@tcp remote: 0x375c010249035d8e expref: 7 pid: 15767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869568.005839:0:14153:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000f3c5cfee/0x3d2d1916761d7aa8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.201.39@tcp remote: 0x375c010249035d8e expref: 7 pid: 15767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788869568.005909:0:14153:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94c83faeb480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:14153:1875765421499392:192.168.201.39@tcp:105: 00000100:00100000:1.0:1788869568.006079:0:14153:0:(client.c:2702:ptlrpc_set_wait()) set ffff94c820d000c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788869568.015469:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1788869568.015634:0:14804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765413140480 00000100:00100000:3.0:1788869568.015654:0:14804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765413140480 00000100:00100000:3.0:1788869568.015821:0:14804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 19 00000100:00100000:3.0:1788869568.015836:0:14804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c82cdc4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8eec8521-73a5-4f2d-941c-80b702633766+8:2347:x1875765413140480:12345-192.168.201.39@tcp:2:lhsmtool_posix.0 00002000:00010000:3.0:1788869568.016185:0:14804:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1788869568.016190:0:14804:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb mtime from disk: 0 -> 1788869566 00002000:00010000:3.0:1788869568.016193:0:14804:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb atime from disk: 0 -> 1788869565 00002000:00010000:3.0:1788869568.016215:0:14804:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb ctime from disk: 1788869566 -> 1788869566 00002000:00010000:3.0:1788869568.016218:0:14804:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:3.0:1788869568.016372:0:14804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c82cdc4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8eec8521-73a5-4f2d-941c-80b702633766+9:2347:x1875765413140480:12345-192.168.201.39@tcp:2:lhsmtool_posix.0 Request processed in 539us (915us total) trans 8589934596 rc 0/0 00000100:00100000:3.0:1788869568.016382:0:14804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 19 00000100:00100000:1.0:1788869568.019576:0:14153:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94c83faeb480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:14153:1875765421499392:192.168.201.39@tcp:105: 00010000:00010000:1.0:1788869568.019620:0:14153:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788869568.019746:0:14153:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c82c843800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8eec8521-73a5-4f2d-941c-80b702633766+8:2348:x1875765413140352:12345-192.168.201.39@tcp:103:ldlm_bl.0 Request processed in 17511us (19151us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869568.019760:0:14153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 13 00000100:00100000:3.0:1788869568.030642:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1788869568.030786:0:14805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765413140608 00000100:00100000:1.0:1788869568.030801:0:14805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765413140608 00000100:00100000:1.0:1788869568.030935:0:14805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 20 00000100:00100000:1.0:1788869568.030949:0:14805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c82c842680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8eec8521-73a5-4f2d-941c-80b702633766+8:2348:x1875765413140608:12345-192.168.201.39@tcp:1:lhsmtool_posix.0 00010000:00010000:1.0:1788869568.031147:0:14805:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000008c0ee66d/0x3d2d1916761d7aaf lrc: 3/1,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869568.031177:0:14805:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000f3c5cfee/0x3d2d1916761d7aa8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.201.39@tcp remote: 0x375c010249035d8e expref: 8 pid: 15767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869568.031189:0:14805:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788869568.031194:0:14805:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788869568.031200:0:14805:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008c0ee66d/0x3d2d1916761d7aaf lrc: 4/1,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869568.031295:0:14805:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000f3c5cfee/0x3d2d1916761d7aa8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000020020 nid: 192.168.201.39@tcp remote: 0x375c010249035d8e expref: 8 pid: 15767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869568.031339:0:14805:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000f3c5cfee/0x3d2d1916761d7aa8 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400020020 nid: 192.168.201.39@tcp remote: 0x375c010249035d8e expref: 8 pid: 15767 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788869568.031368:0:14805:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94c83faeb480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:14805:1875765421499520:192.168.201.39@tcp:104: 00000100:00100000:1.0:1788869568.031595:0:14805:0:(client.c:2702:ptlrpc_set_wait()) set ffff94c820d000c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788869568.034175:0:14805:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94c83faeb480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:14805:1875765421499520:192.168.201.39@tcp:104: 00010000:00010000:1.0:1788869568.034222:0:14805:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000008c0ee66d/0x3d2d1916761d7aaf lrc: 3/1,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788869568.040493:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1788869568.040608:0:16188:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765413140736 00000100:00100000:2.0:1788869568.040623:0:16188:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765413140736 00010000:00010000:2.0:1788869568.040677:0:16188:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000f3c5cfee/0x3d2d1916761d7aa8 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.201.39@tcp remote: 0x375c010249035d8e expref: 9 pid: 15767 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788869568.040729:0:16188:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 14 00000100:00100000:2.0:1788869568.040740:0:16188:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c82c840a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8eec8521-73a5-4f2d-941c-80b702633766+9:2348:x1875765413140736:12345-192.168.201.39@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788869568.040760:0:16188:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788869568.040792:0:16188:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000f3c5cfee/0x3d2d1916761d7aa8 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.201.39@tcp remote: 0x375c010249035d8e expref: 9 pid: 15767 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869568.040808:0:16188:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000f3c5cfee/0x3d2d1916761d7aa8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400020020 nid: 192.168.201.39@tcp remote: 0x375c010249035d8e expref: 9 pid: 15767 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869568.040842:0:16188:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f3c5cfee/0x3d2d1916761d7aa8 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400020020 nid: 192.168.201.39@tcp remote: 0x375c010249035d8e expref: 9 pid: 15767 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869568.040889:0:16188:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788869568.040895:0:16188:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788869568.040902:0:16188:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000008c0ee66d/0x3d2d1916761d7aaf lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 14805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869568.040927:0:16188:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008c0ee66d/0x3d2d1916761d7aaf lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 14805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869568.040973:0:16188:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788869568.041072:0:16188:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c82c840a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8eec8521-73a5-4f2d-941c-80b702633766+8:2348:x1875765413140736:12345-192.168.201.39@tcp:103:ldlm_bl.0 Request processed in 332us (593us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869568.041083:0:16188:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 14 00010000:00010000:1.0:1788869568.041561:0:14805:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000008c0ee66d/0x3d2d1916761d7aaf lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869568.041578:0:14805:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008c0ee66d/0x3d2d1916761d7aaf lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869568.041622:0:14805:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000008c0ee66d/0x3d2d1916761d7aaf lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869568.041632:0:14805:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008c0ee66d/0x3d2d1916761d7aaf lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869568.041641:0:14805:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008c0ee66d/0x3d2d1916761d7aaf lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869568.041671:0:14805:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94c83fde7200 already unused, calling callback (ffffffffc1703220) 00010000:00010000:1.0:1788869568.041678:0:14805:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008c0ee66d/0x3d2d1916761d7aaf lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869568.041690:0:14805:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008c0ee66d/0x3d2d1916761d7aaf lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869568.041709:0:14805:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008c0ee66d/0x3d2d1916761d7aaf lrc: 2/0,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869568.041717:0:14805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008c0ee66d/0x3d2d1916761d7aaf lrc: 0/0,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788869568.041820:0:14805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c82c842680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8eec8521-73a5-4f2d-941c-80b702633766+7:2348:x1875765413140608:12345-192.168.201.39@tcp:1:lhsmtool_posix.0 Request processed in 10872us (11193us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869568.041830:0:14805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 20 00000100:00100000:3.0:1788869568.048852:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1788869568.049193:0:14168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765413140992 00000100:00100000:0.0:1788869568.049207:0:14168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765413140992 00000100:00080000:2.0:1788869568.049314:0:14164:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788869568.049448:0:14168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 53 00000100:00100000:0.0:1788869568.049463:0:14168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c82c840e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8eec8521-73a5-4f2d-941c-80b702633766+14:14401:x1875765413140992:12345-192.168.201.39@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1788869568.049583:0:14168:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94c818d1f000/0x3d2d1916761d7ab6 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869568.049608:0:14168:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94c818d1f000/0x3d2d1916761d7ab6 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869568.049623:0:14168:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94c818d1f000/0x3d2d1916761d7ab6 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869568.049973:0:14168:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94c818d1e200/0x3d2d1916761d7abd lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869568.049986:0:14168:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff94c818d1e400/0x3d2d1916761d7a85 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.39@tcp remote: 0x375c010249035d79 expref: 15 pid: 14168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869568.049996:0:14168:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff94c818d1e200/0x3d2d1916761d7abd lrc: 4/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869568.050040:0:14168:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff94c818d1e400/0x3d2d1916761d7a85 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.201.39@tcp remote: 0x375c010249035d79 expref: 15 pid: 14168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869568.050056:0:14168:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff94c818d1e400/0x3d2d1916761d7a85 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.201.39@tcp remote: 0x375c010249035d79 expref: 15 pid: 14168 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788869568.054781:0:14168:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94c810e6a680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14168:1875765421499648:192.168.201.39@tcp:104: 00000100:00100000:0.0:1788869568.054946:0:14168:0:(client.c:2702:ptlrpc_set_wait()) set ffff94c8033c4780 going to sleep for 11 seconds 00000100:00100000:0.0:1788869568.061719:0:14168:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94c810e6a680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14168:1875765421499648:192.168.201.39@tcp:104: 00010000:00010000:0.0:1788869568.061764:0:14168:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff94c818d1e200/0x3d2d1916761d7abd lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14168 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788869568.062187:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1788869568.062302:0:14154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765413141120 00000100:00100000:2.0:1788869568.062312:0:14154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765413141120 00010000:00010000:2.0:1788869568.062375:0:14154:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff94c818d1e400/0x3d2d1916761d7a85 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.39@tcp remote: 0x375c010249035d79 expref: 16 pid: 14168 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788869568.062428:0:14154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 15 00000100:00100000:2.0:1788869568.062440:0:14154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c82c840700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8eec8521-73a5-4f2d-941c-80b702633766+16:2348:x1875765413141120:12345-192.168.201.39@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788869568.062466:0:14154:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788869568.062473:0:14154:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff94c818d1e400/0x3d2d1916761d7a85 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.39@tcp remote: 0x375c010249035d79 expref: 16 pid: 14168 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869568.062487:0:14154:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff94c818d1e400/0x3d2d1916761d7a85 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.201.39@tcp remote: 0x375c010249035d79 expref: 16 pid: 14168 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869568.062538:0:14154:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94c818d1e400/0x3d2d1916761d7a85 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.201.39@tcp remote: 0x375c010249035d79 expref: 16 pid: 14168 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869568.062565:0:14154:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff94c81a585600) 00010000:00010000:2.0:1788869568.062572:0:14154:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff94c818d1e200/0x3d2d1916761d7abd lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869568.062584:0:14154:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff94c818d1e200/0x3d2d1916761d7abd lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 14168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869568.062595:0:14154:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94c818d1e200/0x3d2d1916761d7abd lrc: 4/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 14168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869568.062634:0:14154:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788869568.062706:0:14154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c82c840700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8eec8521-73a5-4f2d-941c-80b702633766+15:2348:x1875765413141120:12345-192.168.201.39@tcp:103:ldlm_bl.0 Request processed in 267us (520us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869568.062716:0:14154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 15 00010000:00010000:0.0:1788869568.064164:0:14168:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff94c818d1e200/0x3d2d1916761d7abd lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869568.064185:0:14168:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94c818d1e200/0x3d2d1916761d7abd lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14168 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788869568.064898:0:14168:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934616 00000001:00080000:0.0:1788869568.065096:0:14168:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934617 00000001:00080000:0.0:1788869568.065164:0:14168:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934618 00000100:00100000:0.0:1788869568.065338:0:14168:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94c810e6a680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:14168:1875765421499776:0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1788869568.067850:0:14168:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869568.067906:0:14168:0:(client.c:2702:ptlrpc_set_wait()) set ffff94c8033c4900 going to sleep for 11 seconds 00000100:00100000:2.0:1788869568.068714:0:14173:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765421499776 00000100:00100000:2.0:1788869568.068729:0:14173:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765421499776 00000100:00100000:2.0:1788869568.068829:0:14173:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788869568.068841:0:14173:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c810e69c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:14168:x1875765421499776:12345-0@lo:1000:mdt00_000.0 00000100:00100000:2.0:1788869568.069059:0:14173:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c810e69c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:14168:x1875765421499776:12345-0@lo:1000:mdt00_000.0 Request processed in 220us (1218us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869568.069069:0:14173:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788869568.069193:0:14168:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94c810e6a680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:14168:1875765421499776:0@lo:1000:mdt00_000.0 00000001:00080000:3.0:1788869568.070150:0:14168:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934619 00000100:00100000:3.0:1788869568.070303:0:14168:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94c82c840380 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:14168:1875765421499904:0@lo:1000:mdt00_000.0 00000100:00100000:3.0:1788869568.070378:0:14168:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869568.071641:0:14168:0:(client.c:2702:ptlrpc_set_wait()) set ffff94c80893bf00 going to sleep for 11 seconds 00000100:00100000:0.0:1788869568.071730:0:14174:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765421499904 00000100:00100000:0.0:1788869568.071742:0:14174:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765421499904 00000100:00100000:0.0:1788869568.071802:0:14174:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788869568.071812:0:14174:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c82c841c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:14168:x1875765421499904:12345-0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1788869568.072727:0:14174:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c82c841c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:14168:x1875765421499904:12345-0@lo:1000:mdt00_000.0 Request processed in 910us (2342us total) trans 8589934597 rc 0/0 00000100:00100000:0.0:1788869568.072739:0:14174:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788869568.072833:0:14168:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94c82c840380 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:14168:1875765421499904:0@lo:1000:mdt00_000.0 00010000:00010000:3.0:1788869568.072892:0:14168:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94c818d1e200/0x3d2d1916761d7abd lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869568.072904:0:14168:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94c818d1e200/0x3d2d1916761d7abd lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869568.073055:0:14168:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94c818d1e200/0x3d2d1916761d7abd lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869568.073062:0:14168:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94c818d1e200 already unused, calling callback (ffffffffc21124f0) 00010000:00010000:3.0:1788869568.073067:0:14168:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94c818d1e200/0x3d2d1916761d7abd lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869568.073718:0:14168:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94c818d1e200/0x3d2d1916761d7abd lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869568.073743:0:14168:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff94c81a585600) 00010000:00010000:3.0:1788869568.073746:0:14168:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788869568.073752:0:14168:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94c818d1e200/0x3d2d1916761d7abd lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869568.073759:0:14168:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94c818d1e200/0x3d2d1916761d7abd lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869568.073812:0:14168:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94c818d1e600/0x3d2d1916761d7a15 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 15030 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869568.073820:0:14168:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94c818d1e600/0x3d2d1916761d7a15 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 15030 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869568.073826:0:14168:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94c818d1e600/0x3d2d1916761d7a15 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 15030 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869568.073831:0:14168:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94c818d1e600 already unused, calling callback (ffffffffc21124f0) 00010000:00010000:3.0:1788869568.073834:0:14168:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94c818d1e600/0x3d2d1916761d7a15 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 15030 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869568.073840:0:14168:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94c818d1e600/0x3d2d1916761d7a15 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 15030 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869568.073849:0:14168:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff94c802db2600) 00010000:00010000:3.0:1788869568.073851:0:14168:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788869568.073861:0:14168:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff94c702257e00/0x3d2d1916761d7a1c lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.39@tcp remote: 0x375c010249035d5d expref: 18 pid: 14168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869568.073888:0:14168:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff94c702257e00/0x3d2d1916761d7a1c lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.201.39@tcp remote: 0x375c010249035d5d expref: 18 pid: 14168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869568.073899:0:14168:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94c702257e00/0x3d2d1916761d7a1c lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.201.39@tcp remote: 0x375c010249035d5d expref: 18 pid: 14168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869568.074218:0:14168:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff94c702257e00/0x3d2d1916761d7a1c lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.39@tcp remote: 0x375c010249035d5d expref: 18 pid: 14168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788869568.074242:0:14168:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94c82c843480 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14168:1875765421500032:192.168.201.39@tcp:105: 00000100:00100000:3.0:1788869568.075072:0:14168:0:(client.c:2702:ptlrpc_set_wait()) set ffff94c80893b0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788869568.079365:0:14168:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94c82c843480 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14168:1875765421500032:192.168.201.39@tcp:105: 00010000:00010000:3.0:1788869568.079415:0:14168:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94c818d1e600/0x3d2d1916761d7a15 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 15030 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869568.079431:0:14168:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94c818d1e600/0x3d2d1916761d7a15 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 15030 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869568.079491:0:14168:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94c702256400/0x3d2d1916761d7ac4 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869568.079512:0:14168:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94c702256400/0x3d2d1916761d7ac4 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869568.079529:0:14168:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94c702256400/0x3d2d1916761d7ac4 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869568.079543:0:14168:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94c702256400/0x3d2d1916761d7ac4 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869568.079572:0:14168:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94c702256400/0x3d2d1916761d7ac4 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869568.079579:0:14168:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94c702256400/0x3d2d1916761d7ac4 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869568.079586:0:14168:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94c702256400 already unused, calling callback (ffffffffc21124f0) 00010000:00010000:3.0:1788869568.079591:0:14168:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94c702256400/0x3d2d1916761d7ac4 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869568.079601:0:14168:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94c702256400/0x3d2d1916761d7ac4 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869568.079618:0:14168:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff94c802db2600) 00010000:00010000:3.0:1788869568.079622:0:14168:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788869568.079627:0:14168:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94c702256400/0x3d2d1916761d7ac4 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869568.079633:0:14168:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94c702256400/0x3d2d1916761d7ac4 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869568.079646:0:14168:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94c818d1f000/0x3d2d1916761d7ab6 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869568.079653:0:14168:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94c818d1f000/0x3d2d1916761d7ab6 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869568.079659:0:14168:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94c818d1f000/0x3d2d1916761d7ab6 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869568.079664:0:14168:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94c818d1f000 already unused, calling callback (ffffffffc21124f0) 00010000:00010000:3.0:1788869568.079676:0:14168:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94c818d1f000/0x3d2d1916761d7ab6 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869568.079683:0:14168:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94c818d1f000/0x3d2d1916761d7ab6 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869568.079692:0:14168:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff94c802db2600) 00010000:00010000:3.0:1788869568.079695:0:14168:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1788869568.079698:0:14168:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94c818d1f000/0x3d2d1916761d7ab6 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869568.079704:0:14168:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94c818d1f000/0x3d2d1916761d7ab6 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14168 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788869568.080346:0:14201:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:2.0:1788869568.080354:0:14201:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788869568.080385:0:14201:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:2.0:1788869568.080400:0:14201:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:3.0:1788869568.081135:0:14168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c82c840e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8eec8521-73a5-4f2d-941c-80b702633766+18:14401:x1875765413140992:12345-192.168.201.39@tcp:57:lhsmtool_posix.0 Request processed in 31657us (32281us total) trans 8589934620 rc 0/0 00000100:00100000:3.0:1788869568.081154:0:14168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 53 00000020:00080000:3.0:1788869568.081162:0:14168:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000100:00100000:1.0:1788869568.081506:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1788869568.081854:0:14171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765413141248 00000100:00100000:3.0:1788869568.081867:0:14171:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765413141248 00000100:00100000:3.0:1788869568.081939:0:14171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 10 00000100:00100000:3.0:1788869568.081950:0:14171:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c83c6af050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8eec8521-73a5-4f2d-941c-80b702633766+18:14400:x1875765413141248:12345-192.168.201.39@tcp:49:dd.0 00000100:00100000:3.0:1788869568.082156:0:14171:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c83c6af050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8eec8521-73a5-4f2d-941c-80b702633766+18:14400:x1875765413141248:12345-192.168.201.39@tcp:49:dd.0 Request processed in 206us (650us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869568.082164:0:14171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 10 00000100:00100000:1.0:1788869568.085213:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1788869568.085643:0:14171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765413141504 00000100:00100000:3.0:1788869568.085657:0:14171:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765413141504 00000100:00100000:3.0:1788869568.085731:0:14171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 11 00000100:00100000:3.0:1788869568.085743:0:14171:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c83faeb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8eec8521-73a5-4f2d-941c-80b702633766+18:14401:x1875765413141504:12345-192.168.201.39@tcp:35:lhsmtool_posix.0 00000004:00080000:3.0:1788869568.087818:0:14171:0:(mdd_object.c:4016:mdd_close()) Object [0x200000bd1:0x3:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:3.0:1788869568.088196:0:14171:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934621 00010000:00010000:3.0:1788869568.088456:0:14171:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94c702256c00/0x3d2d1916761d7acb lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869568.088482:0:14171:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94c702256c00/0x3d2d1916761d7acb lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 14171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869568.088498:0:14171:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94c702256c00/0x3d2d1916761d7acb lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 14171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869568.088510:0:14171:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94c702256c00/0x3d2d1916761d7acb lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 14171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869568.088517:0:14171:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94c702256c00/0x3d2d1916761d7acb lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 14171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869568.088525:0:14171:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94c702256c00/0x3d2d1916761d7acb lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 14171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869568.088549:0:14171:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1788869568.088735:0:14171:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c83faeb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8eec8521-73a5-4f2d-941c-80b702633766+20:14401:x1875765413141504:12345-192.168.201.39@tcp:35:lhsmtool_posix.0 Request processed in 2987us (3534us total) trans 8589934622 rc 0/0 00000100:00100000:3.0:1788869568.088749:0:14171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 11 00000020:00080000:3.0:1788869568.088756:0:14171:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1788869568.089284:0:15140:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788869568.089295:0:15140:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94c702256c00/0x3d2d1916761d7acb lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 14171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869568.089304:0:15140:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94c702256c00 already unused, calling callback (ffffffffc1703220) 00010000:00010000:2.0:1788869568.089309:0:15140:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94c702256c00/0x3d2d1916761d7acb lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 14171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869568.089318:0:15140:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94c702256c00/0x3d2d1916761d7acb lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 14171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869568.089348:0:15140:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff94c81a585600) 00010000:00010000:2.0:1788869568.089359:0:15140:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1788869568.089364:0:15140:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94c702256c00/0x3d2d1916761d7acb lrc: 1/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 14171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869568.089371:0:15140:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94c702256c00/0x3d2d1916761d7acb lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 14171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869568.089390:0:15140:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788869568.089391:0:15140:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788869568.089393:0:15140:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788869568.091866:0:3284:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788869568.092045:0:3284:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94c82c843480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3284:1875765421500160:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788869568.092412:0:3283:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94c810e69f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3283:1875765421500672:0@lo:400:kworker.0 00000100:00100000:0.0:1788869568.093774:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869568.093841:0:3283:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1788869568.093855:0:3283:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94c810e68700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:cd496ea5-7761-4e68-8a6b-58e98659ad4a:3283:1875765421500288:0@lo:400:kworker.0 00000100:00100000:0.0:1788869568.093923:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869568.094587:0:3283:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94c810e6bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3283:1875765421500800:0@lo:400:kworker.0 00000100:00100000:0.0:1788869568.094637:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869568.094759:0:14162:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765421500288 00000100:00100000:0.0:1788869568.094775:0:14162:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765421500288 00000100:00100000:0.0:1788869568.094863:0:14162:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:0.0:1788869568.094875:0:14162:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c83e0ca050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cd496ea5-7761-4e68-8a6b-58e98659ad4a+19:3283:x1875765421500288:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788869568.095099:0:14169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765421500672 00000100:00100000:2.0:1788869568.095105:0:14169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765421500672 00000100:00100000:2.0:1788869568.095167:0:14169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765421500800 00000100:00100000:2.0:1788869568.095171:0:14169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765421500800 00000100:00100000:2.0:1788869568.095201:0:14169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1788869568.095209:0:14169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c810e6a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3283:x1875765421500672:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788869568.095302:0:14169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c810e6a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3283:x1875765421500672:12345-0@lo:400:kworker.0 Request processed in 94us (1536us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869568.095311:0:14169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1788869568.095729:0:14169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1788869568.095738:0:14169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c810e69500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3283:x1875765421500800:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788869568.095775:0:14169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c810e69500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3283:x1875765421500800:12345-0@lo:400:kworker.0 Request processed in 39us (1137us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869568.095782:0:14169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00080000:2.0:1788869568.095807:0:14164:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788869568.096054:0:14162:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c83e0ca050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cd496ea5-7761-4e68-8a6b-58e98659ad4a+19:3283:x1875765421500288:12345-0@lo:400:kworker.0 Request processed in 1181us (2130us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869568.096062:0:14162:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:0.0:1788869568.096219:0:3283:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94c810e68700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:cd496ea5-7761-4e68-8a6b-58e98659ad4a:3283:1875765421500288:0@lo:400:kworker.0 00000100:00100000:0.0:1788869568.096240:0:3283:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94c810e6bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3283:1875765421500800:0@lo:400:kworker.0 00000100:00100000:0.0:1788869568.097246:0:3283:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94c810e69f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3283:1875765421500672:0@lo:400:kworker.0 00000100:00100000:0.0:1788869568.097339:0:3285:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94c810e69180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3285:1875765421500416:0@lo:400:kworker.0 00000100:00100000:0.0:1788869568.097476:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869568.097585:0:3285:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788869568.097594:0:3285:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94c810e68e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3285:1875765421500544:0@lo:400:kworker.0 00000100:00100000:0.0:1788869568.097623:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869568.097666:0:14169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765421500544 00000100:00100000:0.0:1788869568.097673:0:14169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765421500544 00000100:00100000:0.0:1788869568.097726:0:14169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1788869568.097736:0:14169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c810e6bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3285:x1875765421500544:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788869568.097804:0:14169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c810e6bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3285:x1875765421500544:12345-0@lo:400:kworker.0 Request processed in 68us (179us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869568.097812:0:14169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1788869568.097844:0:3285:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94c810e68e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3285:1875765421500544:0@lo:400:kworker.0 00000100:00100000:3.0:1788869568.098820:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788869568.098928:0:14157:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788869568.099103:0:14806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765421500416 00000100:00100000:2.0:1788869568.099138:0:14806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765421500416 00000100:00100000:2.0:1788869568.099197:0:14806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788869568.099207:0:14806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c810e69f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3285:x1875765421500416:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788869568.099306:0:14806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c810e69f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3285:x1875765421500416:12345-0@lo:400:kworker.0 Request processed in 101us (1830us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869568.099314:0:14806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00080000:2.0:1788869568.099349:0:14164:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788869568.101973:0:14808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765421500160 00000100:00100000:0.0:1788869568.101998:0:14808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765421500160 00000100:00100000:0.0:1788869568.102086:0:14808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788869568.102098:0:14808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c82c842d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3284:x1875765421500160:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788869568.102162:0:14808:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788869568.102627:0:14808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c82c842d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3284:x1875765421500160:12345-0@lo:13:osp-pre-1-0.0 Request processed in 529us (3810us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869568.102637:0:14808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788869568.102715:0:3285:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94c810e69180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3285:1875765421500416:0@lo:400:kworker.0 00000100:00100000:2.0:1788869568.103100:0:3284:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94c82c843480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3284:1875765421500160:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788869568.330031:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1788869568.330127:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1788869568.335414:0:14810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765413141760 00000100:00100000:3.0:1788869568.335445:0:14810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765413141760 00000100:00100000:3.0:1788869568.335561:0:14810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765413141632 00000100:00100000:3.0:1788869568.335566:0:14810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765413141632 00000100:00100000:3.0:1788869568.335599:0:14810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 0 00000100:00100000:3.0:1788869568.335611:0:14810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c810e69180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:8eec8521-73a5-4f2d-941c-80b702633766+8:2348:x1875765413141760:12345-192.168.201.39@tcp:4:dd.0 00002000:00010000:3.0:1788869568.336031:0:14810:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x22:0x0] initial LVB size: 0, mtime: 0x6a9ffbbe, atime: 0x6a9ffbbd, ctime: 0x6a9ffbbe, blocks: 0x1 00010000:00010000:3.0:1788869568.336045:0:14810:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e7866b8a/0x3d2d1916761d7ad2 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869568.336065:0:14810:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=316s v=(0 0) 00010000:00010000:3.0:1788869568.336070:0:14810:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788869568.336078:0:14810:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e7866b8a/0x3d2d1916761d7ad2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869568.336095:0:14810:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e7866b8a/0x3d2d1916761d7ad2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788869568.347608:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1788869568.347823:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1788869568.348833:0:14809:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 3 min 3 max 116 00000100:00100000:0.0:1788869568.349016:0:14811:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 3 min 3 max 116 00000100:00100000:1.0:1788869568.349128:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1788869568.361010:0:14809:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_003' 00000100:00100000:2.0:1788869568.364683:0:14809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765413142016 00000100:00100000:2.0:1788869568.364709:0:14809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765413142016 00000100:00100000:2.0:1788869568.364796:0:14809:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 3 min 3 max 116 00000100:00100000:2.0:1788869568.364813:0:14809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765413141888 00000100:00100000:2.0:1788869568.364816:0:14809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765413141888 00000100:00100000:3.0:1788869568.365425:0:16304:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 1 00000100:00100000:3.0:1788869568.365445:0:16304:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c810e68e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:8eec8521-73a5-4f2d-941c-80b702633766+11:2348:x1875765413141632:12345-192.168.201.39@tcp:4:dd.0 00010000:00010000:3.0:1788869568.365500:0:16304:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000250fbc51/0x3d2d1916761d7ad9 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869568.365517:0:16304:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788869568.365521:0:16304:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788869568.365527:0:16304:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000250fbc51/0x3d2d1916761d7ad9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869568.365554:0:16304:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000250fbc51/0x3d2d1916761d7ad9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788869568.366372:0:14811:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_004' 00000100:00100000:1.0:1788869568.366833:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1788869568.366852:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1788869568.367134:0:14809:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 4 min 3 max 116 00000100:00100000:2.0:1788869568.367150:0:14809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765413142272 00000100:00100000:2.0:1788869568.367163:0:14809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765413142272 00000100:00100000:2.0:1788869568.367221:0:14809:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 4 min 3 max 116 00000100:00100000:2.0:1788869568.367227:0:14809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765413142144 00000100:00100000:2.0:1788869568.367230:0:14809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765413142144 00000100:00100000:2.0:1788869568.367243:0:14809:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 4 min 3 max 116 00000100:00100000:2.0:1788869568.367269:0:14809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765413142400 00000100:00100000:2.0:1788869568.367280:0:14809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765413142400 00000100:00100000:1.0:1788869568.367364:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1788869568.367455:0:14809:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 4 min 3 max 116 00000100:00100000:2.0:1788869568.367463:0:14809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765413142528 00000100:00100000:2.0:1788869568.367466:0:14809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765413142528 00000100:00100000:3.0:1788869568.369748:0:16305:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 2 00000100:00100000:3.0:1788869568.369770:0:16305:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c83fae9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:8eec8521-73a5-4f2d-941c-80b702633766+16:2348:x1875765413142016:12345-192.168.201.39@tcp:4:dd.0 00010000:00010000:3.0:1788869568.369815:0:16305:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000519d6c7/0x3d2d1916761d7ae0 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869568.369835:0:16305:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788869568.369839:0:16305:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788869568.369845:0:16305:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000519d6c7/0x3d2d1916761d7ae0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869568.369859:0:16305:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000519d6c7/0x3d2d1916761d7ae0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788869568.430406:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1788869568.430435:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1788869568.430462:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1788869568.430483:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1788869568.430509:0:14170:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765413142912 00000100:00100000:2.0:1788869568.430520:0:14170:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765413142912 00000100:00100000:2.0:1788869568.430586:0:14170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 26 00000100:00100000:2.0:1788869568.430595:0:14170:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c82cdc6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b859f31b-9885-425c-b9a4-5a4e02335486+6:2348:x1875765413142912:12345-192.168.201.39@tcp:400:kworker.0 00000100:00100000:1.0:1788869568.430640:0:14805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765413142784 00000100:00100000:1.0:1788869568.430657:0:14805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765413142784 00000100:00100000:1.0:1788869568.430688:0:14805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765413143040 00000100:00100000:1.0:1788869568.430692:0:14805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765413143040 00000100:00100000:1.0:1788869568.430713:0:14805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 12 00000100:00100000:1.0:1788869568.430720:0:14805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c82cdc7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8eec8521-73a5-4f2d-941c-80b702633766+5:2348:x1875765413142784:12345-192.168.201.39@tcp:400:kworker.0 00000100:00100000:2.0:1788869568.430741:0:14170:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c82cdc6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b859f31b-9885-425c-b9a4-5a4e02335486+6:2348:x1875765413142912:12345-192.168.201.39@tcp:400:kworker.0 Request processed in 147us (256us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869568.430743:0:14805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c82cdc7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8eec8521-73a5-4f2d-941c-80b702633766+5:2348:x1875765413142784:12345-192.168.201.39@tcp:400:kworker.0 Request processed in 24us (348us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869568.430750:0:14170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 26 00000100:00100000:1.0:1788869568.430750:0:14805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 12 00000100:00100000:1.0:1788869568.430765:0:14805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 13 00000100:00080000:2.0:1788869568.430771:0:14164:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788869568.430771:0:14805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c82cdc5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b859f31b-9885-425c-b9a4-5a4e02335486+5:2348:x1875765413143040:12345-192.168.201.39@tcp:400:kworker.0 00000100:00080000:2.0:1788869568.430774:0:14164:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788869568.430776:0:14164:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788869568.430792:0:14805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c82cdc5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b859f31b-9885-425c-b9a4-5a4e02335486+5:2348:x1875765413143040:12345-192.168.201.39@tcp:400:kworker.0 Request processed in 21us (356us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869568.430798:0:14805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 13 00000100:00100000:2.0:1788869568.430805:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1788869568.434495:0:14806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765413143168 00000100:00100000:1.0:1788869568.434509:0:14806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765413143168 00000100:00100000:1.0:1788869568.434799:0:14806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 14 00000100:00100000:1.0:1788869568.434808:0:14806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c82cdc4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b859f31b-9885-425c-b9a4-5a4e02335486+5:2348:x1875765413143168:12345-192.168.201.39@tcp:400:kworker.0 00000100:00100000:1.0:1788869568.434914:0:14806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c82cdc4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b859f31b-9885-425c-b9a4-5a4e02335486+5:2348:x1875765413143168:12345-192.168.201.39@tcp:400:kworker.0 Request processed in 107us (4108us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869568.434922:0:14806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 14 00000100:00080000:2.0:1788869568.436158:0:14164:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788869568.437020:0:14163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765413142656 00000100:00100000:1.0:1788869568.437030:0:14163:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765413142656 00000100:00100000:1.0:1788869568.437072:0:14163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 121 00000100:00100000:1.0:1788869568.437080:0:14163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c83e0c9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:027d934b-b9c0-4e83-b9af-2634761ebef6+13:2348:x1875765413142656:12345-192.168.201.39@tcp:400:kworker.0 00000100:00100000:1.0:1788869568.437145:0:14163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c83e0c9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:027d934b-b9c0-4e83-b9af-2634761ebef6+13:2348:x1875765413142656:12345-192.168.201.39@tcp:400:kworker.0 Request processed in 66us (6682us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869568.437160:0:14163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 121 00002000:00010000:3.0:1788869568.443138:0:14810:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb size from disk: 0 -> 4194304 00002000:00010000:3.0:1788869568.443147:0:14810:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb mtime from disk: 1788869566 -> 1788869567 00002000:00010000:3.0:1788869568.443149:0:14810:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb ctime from disk: 1788869566 -> 1788869567 00002000:00010000:3.0:1788869568.443152:0:14810:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 1 -> 2055 00010000:00010000:3.0:1788869568.443167:0:14810:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e7866b8a/0x3d2d1916761d7ad2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869568.443181:0:14810:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e7866b8a/0x3d2d1916761d7ad2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869568.443210:0:14810:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e7866b8a/0x3d2d1916761d7ad2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869568.443218:0:14810:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94c702256400 already unused, calling callback (ffffffffc1703220) 00010000:00010000:3.0:1788869568.443223:0:14810:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e7866b8a/0x3d2d1916761d7ad2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869568.443232:0:14810:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e7866b8a/0x3d2d1916761d7ad2 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869568.443290:0:14810:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e7866b8a/0x3d2d1916761d7ad2 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869568.443300:0:14810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e7866b8a/0x3d2d1916761d7ad2 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788869568.443398:0:14810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c810e69180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:8eec8521-73a5-4f2d-941c-80b702633766+22:2348:x1875765413141760:12345-192.168.201.39@tcp:4:dd.0 Request processed in 107784us (113957us total) trans 8589934598 rc 0/0 00000100:00100000:3.0:1788869568.443410:0:14810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 0 00000100:00100000:3.0:1788869568.443451:0:14810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 3 00000100:00100000:3.0:1788869568.443463:0:14810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c83faea300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:8eec8521-73a5-4f2d-941c-80b702633766+21:2348:x1875765413141888:12345-192.168.201.39@tcp:4:dd.0 00010000:00010000:3.0:1788869568.443497:0:14810:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ffb8103b/0x3d2d1916761d7ae7 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869568.443509:0:14810:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788869568.443520:0:14810:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788869568.443528:0:14810:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ffb8103b/0x3d2d1916761d7ae7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869568.443541:0:14810:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ffb8103b/0x3d2d1916761d7ae7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788869568.443699:0:6571:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934597 is committed 00000001:00080000:0.0:1788869568.443711:0:6571:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934594 is committed 00000001:00080000:0.0:1788869568.443722:0:6571:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934598 is committed 00002000:00010000:3.0:1788869568.494834:0:16305:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 2055 -> 6151 00010000:00010000:3.0:1788869568.494856:0:16305:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000519d6c7/0x3d2d1916761d7ae0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869568.494867:0:16305:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000519d6c7/0x3d2d1916761d7ae0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869568.494874:0:16305:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000519d6c7/0x3d2d1916761d7ae0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869568.494879:0:16305:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94c702257800 already unused, calling callback (ffffffffc1703220) 00010000:00010000:3.0:1788869568.494884:0:16305:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000519d6c7/0x3d2d1916761d7ae0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869568.494891:0:16305:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000519d6c7/0x3d2d1916761d7ae0 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869568.494912:0:16305:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000519d6c7/0x3d2d1916761d7ae0 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869568.494916:0:16305:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000519d6c7/0x3d2d1916761d7ae0 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788869568.495022:0:16305:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c83fae9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:8eec8521-73a5-4f2d-941c-80b702633766+19:2348:x1875765413142016:12345-192.168.201.39@tcp:4:dd.0 Request processed in 125256us (147427us total) trans 8589934600 rc 0/0 00000100:00100000:3.0:1788869568.495031:0:16305:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 2 00000100:00100000:3.0:1788869568.495063:0:16305:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 4 00000100:00100000:3.0:1788869568.495075:0:16305:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c83faebb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:8eec8521-73a5-4f2d-941c-80b702633766+18:2348:x1875765413142272:12345-192.168.201.39@tcp:4:dd.0 00010000:00010000:3.0:1788869568.495139:0:16305:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e7866b8a/0x3d2d1916761d7aee lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869568.495155:0:16305:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788869568.495165:0:16305:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788869568.495173:0:16305:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e7866b8a/0x3d2d1916761d7aee lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869568.495188:0:16305:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e7866b8a/0x3d2d1916761d7aee lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788869568.498571:0:6571:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934600 is committed 00002000:00010000:0.0:1788869568.504719:0:16304:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 6151 -> 8199 00010000:00010000:0.0:1788869568.504758:0:16304:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000250fbc51/0x3d2d1916761d7ad9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869568.504780:0:16304:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000250fbc51/0x3d2d1916761d7ad9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869568.504824:0:16304:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000250fbc51/0x3d2d1916761d7ad9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869568.504833:0:16304:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94c702257200 already unused, calling callback (ffffffffc1703220) 00010000:00010000:0.0:1788869568.504839:0:16304:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000250fbc51/0x3d2d1916761d7ad9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869568.504851:0:16304:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000250fbc51/0x3d2d1916761d7ad9 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869568.504882:0:16304:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000250fbc51/0x3d2d1916761d7ad9 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869568.504891:0:16304:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000250fbc51/0x3d2d1916761d7ad9 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788869568.505667:0:16304:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c810e68e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:8eec8521-73a5-4f2d-941c-80b702633766+14:2348:x1875765413141632:12345-192.168.201.39@tcp:4:dd.0 Request processed in 140218us (175529us total) trans 8589934599 rc 0/0 00000100:00100000:0.0:1788869568.505685:0:16304:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 1 00000100:00100000:0.0:1788869568.505737:0:16304:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 5 00000100:00100000:0.0:1788869568.505753:0:16304:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c83fae8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:8eec8521-73a5-4f2d-941c-80b702633766+13:2348:x1875765413142144:12345-192.168.201.39@tcp:4:dd.0 00010000:00010000:0.0:1788869568.505804:0:16304:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000d633537/0x3d2d1916761d7af5 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869568.505823:0:16304:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788869568.505836:0:16304:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788869568.505846:0:16304:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000d633537/0x3d2d1916761d7af5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869568.505862:0:16304:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000d633537/0x3d2d1916761d7af5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788869568.566161:0:14810:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb size from disk: 4194304 -> 6291456 00010000:00010000:0.0:1788869568.566183:0:14810:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ffb8103b/0x3d2d1916761d7ae7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869568.566198:0:14810:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ffb8103b/0x3d2d1916761d7ae7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869568.566207:0:14810:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ffb8103b/0x3d2d1916761d7ae7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869568.566215:0:14810:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94c702257c00 already unused, calling callback (ffffffffc1703220) 00010000:00010000:0.0:1788869568.566221:0:14810:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ffb8103b/0x3d2d1916761d7ae7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869568.566231:0:14810:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ffb8103b/0x3d2d1916761d7ae7 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869568.566283:0:14810:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ffb8103b/0x3d2d1916761d7ae7 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869568.566292:0:14810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ffb8103b/0x3d2d1916761d7ae7 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788869568.566403:0:14810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c83faea300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:8eec8521-73a5-4f2d-941c-80b702633766+15:2348:x1875765413141888:12345-192.168.201.39@tcp:4:dd.0 Request processed in 122938us (218574us total) trans 8589934601 rc 0/0 00000100:00100000:0.0:1788869568.566414:0:14810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 3 00000100:00100000:0.0:1788869568.566454:0:14810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 6 00000100:00100000:0.0:1788869568.566468:0:14810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c83faea680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:8eec8521-73a5-4f2d-941c-80b702633766+14:2347:x1875765413142400:12345-192.168.201.39@tcp:4:dd.0 00010000:00010000:0.0:1788869568.566499:0:14810:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ade0dd42/0x3d2d1916761d7afc lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869568.566511:0:14810:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788869568.566516:0:14810:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788869568.566524:0:14810:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ade0dd42/0x3d2d1916761d7afc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869568.566536:0:14810:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ade0dd42/0x3d2d1916761d7afc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788869568.566654:0:6571:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934601 is committed 00000001:00080000:0.0:1788869568.638054:0:6571:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934602 is committed 00002000:00010000:2.0:1788869568.638197:0:16305:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb size from disk: 6291456 -> 7340032 00002000:00010000:2.0:1788869568.638202:0:16305:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 8199 -> 10247 00010000:00010000:2.0:1788869568.638217:0:16305:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e7866b8a/0x3d2d1916761d7aee lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869568.638231:0:16305:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e7866b8a/0x3d2d1916761d7aee lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869568.638240:0:16305:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e7866b8a/0x3d2d1916761d7aee lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869568.638300:0:16305:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94c702256400 already unused, calling callback (ffffffffc1703220) 00010000:00010000:2.0:1788869568.638306:0:16305:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e7866b8a/0x3d2d1916761d7aee lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869568.638315:0:16305:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e7866b8a/0x3d2d1916761d7aee lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869568.638336:0:16305:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e7866b8a/0x3d2d1916761d7aee lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869568.638344:0:16305:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e7866b8a/0x3d2d1916761d7aee lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788869568.638431:0:16305:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c83faebb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:8eec8521-73a5-4f2d-941c-80b702633766+14:2348:x1875765413142272:12345-192.168.201.39@tcp:4:dd.0 Request processed in 143355us (289317us total) trans 8589934602 rc 0/0 00000100:00100000:2.0:1788869568.638443:0:16305:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 4 00000100:00100000:2.0:1788869568.638476:0:16305:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 7 00000100:00100000:2.0:1788869568.638489:0:16305:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c83fae9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:8eec8521-73a5-4f2d-941c-80b702633766+13:2348:x1875765413142528:12345-192.168.201.39@tcp:4:dd.0 00010000:00010000:2.0:1788869568.638524:0:16305:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000075e1b7c5/0x3d2d1916761d7b03 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869568.638536:0:16305:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788869568.638541:0:16305:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788869568.638548:0:16305:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000075e1b7c5/0x3d2d1916761d7b03 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869568.638571:0:16305:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000075e1b7c5/0x3d2d1916761d7b03 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788869568.697841:0:16304:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb size from disk: 7340032 -> 7654321 00002000:00010000:1.0:1788869568.697851:0:16304:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 10247 -> 14343 00010000:00010000:1.0:1788869568.697867:0:16304:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000d633537/0x3d2d1916761d7af5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869568.697881:0:16304:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000d633537/0x3d2d1916761d7af5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869568.697890:0:16304:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000d633537/0x3d2d1916761d7af5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869568.697898:0:16304:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94c818d1fc00 already unused, calling callback (ffffffffc1703220) 00010000:00010000:1.0:1788869568.697904:0:16304:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000d633537/0x3d2d1916761d7af5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869568.697914:0:16304:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000d633537/0x3d2d1916761d7af5 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869568.697935:0:16304:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000d633537/0x3d2d1916761d7af5 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869568.697950:0:16304:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000d633537/0x3d2d1916761d7af5 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788869568.698049:0:16304:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c83fae8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:8eec8521-73a5-4f2d-941c-80b702633766+15:2348:x1875765413142144:12345-192.168.201.39@tcp:4:dd.0 Request processed in 192298us (331217us total) trans 8589934603 rc 0/0 00000100:00100000:1.0:1788869568.698088:0:16304:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 5 00010000:00010000:1.0:1788869568.698449:0:14810:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ade0dd42/0x3d2d1916761d7afc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869568.698460:0:14810:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ade0dd42/0x3d2d1916761d7afc lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869568.698467:0:14810:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ade0dd42/0x3d2d1916761d7afc lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869568.698473:0:14810:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94c818d1fa00 already unused, calling callback (ffffffffc1703220) 00010000:00010000:1.0:1788869568.698477:0:14810:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ade0dd42/0x3d2d1916761d7afc lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869568.698484:0:14810:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ade0dd42/0x3d2d1916761d7afc lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869568.698495:0:14810:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ade0dd42/0x3d2d1916761d7afc lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869568.698503:0:14810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ade0dd42/0x3d2d1916761d7afc lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788869568.698562:0:14810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c83faea680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:8eec8521-73a5-4f2d-941c-80b702633766+13:2347:x1875765413142400:12345-192.168.201.39@tcp:4:dd.0 Request processed in 132098us (331708us total) trans 8589934604 rc 0/0 00000100:00100000:1.0:1788869568.698570:0:14810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 6 00000001:00080000:1.0:1788869568.702073:0:6571:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934604 is committed 00000001:00080000:1.0:1788869568.767499:0:6571:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934605 is committed 00002000:00010000:3.0:1788869568.768302:0:16305:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 14343 -> 16391 00010000:00010000:3.0:1788869568.768320:0:16305:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000075e1b7c5/0x3d2d1916761d7b03 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869568.768333:0:16305:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000075e1b7c5/0x3d2d1916761d7b03 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869568.768344:0:16305:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000075e1b7c5/0x3d2d1916761d7b03 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869568.768367:0:16305:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94c83504d000 already unused, calling callback (ffffffffc1703220) 00010000:00010000:3.0:1788869568.768373:0:16305:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000075e1b7c5/0x3d2d1916761d7b03 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869568.768383:0:16305:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000075e1b7c5/0x3d2d1916761d7b03 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869568.768403:0:16305:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000075e1b7c5/0x3d2d1916761d7b03 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869568.768411:0:16305:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000075e1b7c5/0x3d2d1916761d7b03 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788869568.768518:0:16305:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c83fae9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:8eec8521-73a5-4f2d-941c-80b702633766+5:2348:x1875765413142528:12345-192.168.201.39@tcp:4:dd.0 Request processed in 130029us (401150us total) trans 8589934605 rc 0/0 00000100:00100000:3.0:1788869568.768530:0:16305:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 7 00010000:00010000:3.0:1788869569.115691:0:14156:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788869570.140019:0:3285:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94c83fae9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3285:1875765421500928:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788869570.140118:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869570.140327:0:14808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765421500928 00000100:00100000:3.0:1788869570.140335:0:14808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765421500928 00000100:00100000:3.0:1788869570.140398:0:14808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788869570.140408:0:14808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94c82cdc5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3285:x1875765421500928:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788869570.140445:0:14808:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 3407872 granted 71499776 pending 0 free 3851419648 avail 3849322496 00000100:00080000:1.0:1788869570.140534:0:14164:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788869570.140929:0:14808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94c82cdc5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3285:x1875765421500928:12345-0@lo:13:osp-pre-0-0.0 Request processed in 522us (811us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869570.140937:0:14808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788869570.141051:0:3285:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934597 gen 2 00000004:00080000:2.0:1788869570.141058:0:3285:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94c82c843100, transno 8589934595 00000004:00080000:2.0:1788869570.141081:0:3285:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 8589934597 committed transno 8589934597 00000100:00100000:2.0:1788869570.141108:0:3285:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94c83fae9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3285:1875765421500928:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1788869570.141164:0:15140:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1788869570.459178:0:16344:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: sanity-pcc test_1c: @@@@@@ FAIL: expected /mnt/pcc.d1c.sanity-pcc/d1c.sanity-pcc/0bd3/0x200000bd1:0x2:0x0 size: 7654321 got: 0 00010000:00010000:3.0:1788869571.163671:0:14157:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) Debug log: 27768 lines, 27768 kept, 0 dropped, 0 bad.